-- Logs begin at Mon 2022-08-08 01:09:48 UTC, end at Mon 2022-08-08 02:43:51 UTC. -- Aug 08 02:04:16.277556 dv-cinder-740146-18-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 08 02:04:16.286405 dv-cinder-740146-18-smb devstack@keystone.service[80624]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 08 02:04:16.288346 dv-cinder-740146-18-smb devstack@keystone.service[80624]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 8 02:04:16 2022] *** Aug 08 02:04:16.288453 dv-cinder-740146-18-smb devstack@keystone.service[80624]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 08 02:04:16.288453 dv-cinder-740146-18-smb devstack@keystone.service[80624]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 08 02:04:16.288453 dv-cinder-740146-18-smb devstack@keystone.service[80624]: nodename: dv-cinder-740146-18-smb Aug 08 02:04:16.288453 dv-cinder-740146-18-smb devstack@keystone.service[80624]: machine: x86_64 Aug 08 02:04:16.288453 dv-cinder-740146-18-smb devstack@keystone.service[80624]: clock source: unix Aug 08 02:04:16.288453 dv-cinder-740146-18-smb devstack@keystone.service[80624]: pcre jit disabled Aug 08 02:04:16.288453 dv-cinder-740146-18-smb devstack@keystone.service[80624]: detected number of CPU cores: 4 Aug 08 02:04:16.288453 dv-cinder-740146-18-smb devstack@keystone.service[80624]: current working directory: / Aug 08 02:04:16.288453 dv-cinder-740146-18-smb devstack@keystone.service[80624]: detected binary path: /usr/bin/uwsgi-core Aug 08 02:04:16.288453 dv-cinder-740146-18-smb devstack@keystone.service[80624]: your processes number limit is 47680 Aug 08 02:04:16.288453 dv-cinder-740146-18-smb devstack@keystone.service[80624]: your memory page size is 4096 bytes Aug 08 02:04:16.288453 dv-cinder-740146-18-smb devstack@keystone.service[80624]: detected max file descriptor number: 2048 Aug 08 02:04:16.288453 dv-cinder-740146-18-smb devstack@keystone.service[80624]: lock engine: pthread robust mutexes Aug 08 02:04:16.289084 dv-cinder-740146-18-smb devstack@keystone.service[80624]: thunder lock: enabled Aug 08 02:04:16.289084 dv-cinder-740146-18-smb devstack@keystone.service[80624]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 08 02:04:16.289084 dv-cinder-740146-18-smb devstack@keystone.service[80624]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 08 02:04:16.328812 dv-cinder-740146-18-smb devstack@keystone.service[80624]: Python main interpreter initialized at 0x5584f8fa89c0 Aug 08 02:04:16.328812 dv-cinder-740146-18-smb devstack@keystone.service[80624]: python threads support enabled Aug 08 02:04:16.328812 dv-cinder-740146-18-smb devstack@keystone.service[80624]: your server socket listen backlog is limited to 100 connections Aug 08 02:04:16.328812 dv-cinder-740146-18-smb devstack@keystone.service[80624]: your mercy for graceful operations on workers is 90 seconds Aug 08 02:04:16.329165 dv-cinder-740146-18-smb devstack@keystone.service[80624]: mapped 403077 bytes (393 KB) for 2 cores Aug 08 02:04:16.329242 dv-cinder-740146-18-smb devstack@keystone.service[80624]: *** Operational MODE: preforking *** Aug 08 02:04:16.329591 dv-cinder-740146-18-smb devstack@keystone.service[80624]: *** uWSGI is running in multiple interpreter mode *** Aug 08 02:04:16.329591 dv-cinder-740146-18-smb devstack@keystone.service[80624]: spawned uWSGI master process (pid: 80624) Aug 08 02:04:16.329783 dv-cinder-740146-18-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 08 02:04:16.330849 dv-cinder-740146-18-smb devstack@keystone.service[80624]: spawned uWSGI worker 1 (pid: 80637, cores: 1) Aug 08 02:04:16.330849 dv-cinder-740146-18-smb devstack@keystone.service[80624]: spawned uWSGI worker 2 (pid: 80638, cores: 1) Aug 08 02:04:16.330849 dv-cinder-740146-18-smb devstack@keystone.service[80624]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 08 02:04:21.877905 dv-cinder-740146-18-smb devstack@keystone.service[80638]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 02:04:21.877905 dv-cinder-740146-18-smb devstack@keystone.service[80638]: from cryptography.utils import int_from_bytes Aug 08 02:04:21.878686 dv-cinder-740146-18-smb devstack@keystone.service[80638]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 02:04:21.878686 dv-cinder-740146-18-smb devstack@keystone.service[80638]: from cryptography.utils import int_from_bytes Aug 08 02:04:21.878807 dv-cinder-740146-18-smb devstack@keystone.service[80637]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 02:04:21.878807 dv-cinder-740146-18-smb devstack@keystone.service[80637]: from cryptography.utils import int_from_bytes Aug 08 02:04:21.878807 dv-cinder-740146-18-smb devstack@keystone.service[80637]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 02:04:21.878807 dv-cinder-740146-18-smb devstack@keystone.service[80637]: from cryptography.utils import int_from_bytes Aug 08 02:04:21.934353 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 02:04:21.934557 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 02:04:21.934754 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] command line args: [] {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 02:04:21.935026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 02:04:21.935116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 02:04:21.935190 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ================================================================================ {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 02:04:21.935259 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 02:04:21.935478 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] command line args: [] {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 02:04:21.935559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] admin_token = **** {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.935730 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] config_dir = [] {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.935815 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 02:04:21.935916 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ================================================================================ {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 02:04:21.936001 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.936082 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] config_source = [] {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.936156 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] admin_token = **** {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.936269 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] debug = True {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.936410 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] config_dir = [] {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.936495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.936724 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.936788 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] config_source = [] {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.936843 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.936968 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] debug = True {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.937058 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.937155 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.937261 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.937383 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.937490 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.937596 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.937720 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] list_limit = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.937832 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.937928 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] log_config_append = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.938041 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.938156 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.938257 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] log_dir = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.938356 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] list_limit = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.938462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] log_file = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.938570 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] log_config_append = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.938668 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.938777 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.938856 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] log_dir = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.938971 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.939053 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] log_file = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.939170 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.939248 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.939390 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.939481 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.939553 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.939663 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.939747 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.939913 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.939996 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.940119 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.940202 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.940273 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.940416 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.940495 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.940654 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.940773 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.940891 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.940974 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.941128 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.941247 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.941382 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.941465 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.941677 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.941781 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.941879 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.941955 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.942128 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.942392 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.942470 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.942580 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] publish_errors = False {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.942817 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.942957 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.943054 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.943135 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] publish_errors = False {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.943236 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.943319 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.945581 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.945661 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.945661 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.945805 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.945887 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.945963 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] standard_threads = False {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.946039 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.946108 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.946226 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] standard_threads = False {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.946306 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.946386 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.946462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.946462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] use_journal = False {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.946592 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.946660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] use_json = False {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.946726 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.946804 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] use_stderr = False {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.946874 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] use_journal = False {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.946941 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] use_syslog = False {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.947020 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] use_json = False {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.947020 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] use_stderr = False {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.947144 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.947288 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] use_syslog = False {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.947386 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.947460 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:04:21.947539 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.947609 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.947677 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.947753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.947822 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.947890 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.947963 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.948031 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.948099 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.948099 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.948234 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.948307 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.948376 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.948376 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.948503 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.948581 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.948656 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.948726 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.948798 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.948908 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.948986 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.949063 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.949139 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.949209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.949209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.949351 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.949430 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.949508 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.949582 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.949702 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.949779 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.949994 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.950078 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.950254 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.950337 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.950510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.950615 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.950758 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.950944 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.951021 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.951267 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.951396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.951650 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.951770 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.952033 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.952119 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.952391 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.952473 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.952733 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.952809 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.953034 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.953117 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.953346 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.953421 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.953657 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.953732 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.953969 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.954045 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.954280 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.954362 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.954575 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.954651 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.954860 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.954936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.955099 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.955188 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.955391 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.955476 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.955631 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.955784 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.955866 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.956097 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.956173 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.956341 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.956424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.956584 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.956665 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.956824 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.957012 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.957129 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.957288 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.957394 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.957489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.957585 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.957725 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.957841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.957963 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.958110 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.958197 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.958369 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.958450 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.958657 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.958745 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.958892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.958981 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.959132 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.959243 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.959393 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.959569 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.959670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.959861 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.959956 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.960102 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.960178 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.960344 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.960456 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.960589 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.960734 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.960816 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.961045 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.961121 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.961280 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.961363 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.961533 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.961609 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.961775 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.961914 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.961998 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.962213 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.962291 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.962496 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.962599 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.962842 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.962947 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.963020 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.963143 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.963264 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.963454 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.963535 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.963750 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.963829 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.964040 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.964116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.964296 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.964393 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.964546 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.964678 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.964787 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.964976 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.965058 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.965253 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.965417 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.965493 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.965607 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.965735 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.965900 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.965979 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.966210 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.966289 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.966451 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.966532 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.966692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.966803 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.966933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.967100 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.967179 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.967420 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.967502 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.967687 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.967798 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.967946 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.968023 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.968163 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.968317 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.968408 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.968640 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.968725 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.968881 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.968983 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.969122 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.969286 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.969362 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.969585 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.969662 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.969821 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.969897 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.970055 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.970171 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.970294 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.970506 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.970585 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.970758 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.970835 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.970997 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.971082 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.971250 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.971397 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.971522 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.971705 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.971782 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.972006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.972086 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.972263 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.972339 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.972500 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] auth.external = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.972577 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.972734 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.972868 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.973033 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.973161 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.973274 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.973454 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.973542 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] auth.password = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.973737 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] auth.token = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.973813 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.973988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.974083 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.974225 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.974330 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.974477 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.974623 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.974700 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.974933 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.975019 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.975193 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.975284 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.975458 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.975546 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.975701 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] credential.caching = True {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.975891 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.975977 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.976190 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.976288 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.976444 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.976532 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] auth.external = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.976685 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.976772 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.976935 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.977173 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.977258 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.977437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.977524 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.977694 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.977780 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] auth.password = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.977935 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.978021 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] auth.token = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.978192 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.978840 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.979000 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.979140 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.979243 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.979475 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.979562 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.979760 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.979839 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.980021 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.980101 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.980260 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] federation.caching = True {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.980367 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.980502 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.980659 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.980745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.980991 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.981068 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] credential.caching = True {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.981226 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.981425 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.981502 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.981705 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.981799 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.981962 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.982046 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.982203 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.982287 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.982461 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.982549 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.982703 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.982781 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.982952 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.983031 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.983192 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] identity.caching = True {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.983271 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.983462 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.983543 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.983713 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.983801 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.983960 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.984039 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.984200 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.984281 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.984451 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.984529 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.984685 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.984771 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.984928 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.985006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.985181 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] federation.caching = True {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.985299 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.985422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.985502 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.985659 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.985737 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.985894 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.985973 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.986126 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.986205 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.986372 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.986449 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.986611 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.986688 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.986861 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.986946 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.987098 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.987181 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.987374 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.987455 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.987616 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.987696 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.987867 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.987944 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.988105 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] identity.caching = True {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.988182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.988346 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.988430 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.988588 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.988667 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.988824 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.988904 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.989061 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.989140 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.989303 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.989380 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.989535 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.989619 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.989775 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.989852 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.990008 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.990085 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.990259 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.990345 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.990491 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.990568 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.990723 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.990801 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.990954 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.991040 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.991200 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.991284 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.991463 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.991543 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.991706 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.991795 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.991943 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.992021 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.992184 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.992262 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.992425 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.992510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.992671 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.992749 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.992914 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.992991 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.993149 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.993235 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.993389 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.993467 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.993622 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.993699 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.993857 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.993943 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.994647 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.994731 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.994892 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.994969 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.995144 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.995231 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.995396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.995482 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.995636 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.995713 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.995876 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.995966 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.996113 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.user = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.996191 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.996358 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.996444 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.996605 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.996691 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.996840 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.996918 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.997080 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.997158 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.997314 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.997399 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.997554 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.997633 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.997792 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.997876 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.998027 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.998113 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.998264 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.998344 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.998500 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.998577 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.998741 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.998827 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.998977 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.999060 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.999213 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.999289 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.999471 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.999564 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.999722 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.999800 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:21.999971 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.000048 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.000209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.000295 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.000441 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.000518 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.000676 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.000753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.000911 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.user = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.000997 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.001149 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.001227 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.001389 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.001467 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.001628 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.001715 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.001875 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.001952 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.002124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.002244 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.002365 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.002452 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.002597 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.002697 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.002829 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.002908 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.003065 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.003151 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.003300 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.003396 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.003563 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.003645 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.003794 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.003883 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.004042 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.004120 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.004287 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.004363 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.004525 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.004603 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.004766 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.004843 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.005010 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] resource.caching = True {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.005087 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.005227 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.005300 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.005472 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.005557 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.005710 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.005789 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.005947 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.006026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.006183 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.006261 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.006423 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.006500 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.006672 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.006750 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.006913 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.006990 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.007150 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.007232 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.007408 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] role.caching = True {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.007490 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.007660 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.007737 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] role.driver = sql {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.007893 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.007970 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.008133 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.008211 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.008370 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.008447 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.008608 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.008686 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.008857 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.008937 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.009100 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.009178 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.009335 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.009461 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.009608 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.009687 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.009853 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] resource.caching = True {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.009931 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.010087 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.010163 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.010338 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.010417 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.010573 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.010650 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.010823 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.010900 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.011069 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.011149 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.011304 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.011524 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.011657 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.011780 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.011912 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.012036 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.012164 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.012284 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.012406 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] role.caching = True {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.012529 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] role.driver = sql {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.012658 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.012782 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.012903 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.013025 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.013159 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.013283 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.013414 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.013538 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.013660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.013783 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.013905 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.014035 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.014158 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.014282 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.014404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.014527 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.014649 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.014789 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.014913 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.015036 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.015169 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.015306 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.015460 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.015615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.015694 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.015765 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.015836 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.015905 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.015974 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.016099 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] token.caching = True {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.016179 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.016344 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.016422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.016598 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.016675 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.016839 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.016919 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.017088 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.017165 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.017339 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.017417 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.017576 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.017655 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.017830 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.017913 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.018080 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.018187 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.018332 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.018433 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.018575 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.018652 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.018819 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.018897 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.019058 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.019137 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.019309 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.019405 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.019585 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.019663 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.019820 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.019899 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.020064 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.020142 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.020311 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.020388 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.020547 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.020627 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] database.connection = **** {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.020784 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] token.caching = True {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.020870 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.021024 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.021102 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.021275 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.021362 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.021514 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.021592 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.021772 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.021850 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.022014 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.022099 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.022251 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.022328 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.022489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.022566 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.022731 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.022823 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.022969 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.023047 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.023209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.023285 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.023452 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.023542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.023708 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.023786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.023946 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.024023 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.024195 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.024316 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.024425 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.024508 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.024668 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.024748 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.024906 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.024992 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.025065 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 02:04:22.025335 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] database.connection = **** {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.025587 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.025839 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.026080 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.026323 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.026567 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.026806 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.027044 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.027282 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.027554 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.027795 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.028040 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.028277 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.028526 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.028763 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.029008 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.029239 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.029480 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.029716 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:04:22.029887 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 02:04:22.054992 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.055224 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.055481 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.055716 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.055949 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.056177 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.065288 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.065881 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.094544 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.094730 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.094857 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.094997 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.147480 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.147689 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.198723 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.198916 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.199045 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.199171 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.263632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.263817 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.263947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.264072 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.264209 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.264334 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.264471 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.264601 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.264731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.264862 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.264991 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.265129 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.288311 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.288480 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.288640 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.288769 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.288917 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.289046 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.289191 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.289318 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.289459 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.289604 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.289737 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.289875 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.290006 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.290143 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.300644 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.300896 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.314130 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.314360 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.314488 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.314614 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.314751 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.314878 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.315003 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.315140 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.315264 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.315419 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.315546 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.315688 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.315850 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.315850 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 02:04:22.332085 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.332253 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.332382 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 08 02:04:22.332507 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 08 02:04:22.332641 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.332770 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.332907 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 08 02:04:22.333034 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 08 02:04:22.333163 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.333291 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.333418 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.333545 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.333681 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.333810 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.333938 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.334066 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.345751 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.345909 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.346037 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.346189 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.346316 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.346465 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.346593 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.346752 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.353517 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:04:22.353852 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:04:22.356658 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:04:22.356943 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.357082 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:04:22.357239 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.357366 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.357525 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.357650 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.357814 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.357941 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.358071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.358200 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.358328 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.358464 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.358598 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.358723 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.358855 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.358980 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.359130 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.359273 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.359431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.359556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.359681 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.383078 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.383212 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.384682 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:04:22.384799 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:04:22.384971 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.385060 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.389596 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:04:22.389708 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:04:22.389880 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.389964 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.390163 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.390260 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.396749 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:04:22.396865 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:04:22.397036 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.397157 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.401670 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:04:22.401908 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:04:22.401990 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.402190 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.402271 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.402477 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.402564 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.402753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.402854 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.403032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.403117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.403303 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.403410 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.403605 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.403684 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.403900 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.419341 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.419652 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.419979 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.420264 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.423681 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:04:22.424254 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:04:22.426837 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.427134 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.427453 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.427753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.432311 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:04:22.432971 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:04:22.436216 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:04:22.439434 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.439578 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:04:22.439741 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.440036 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.440330 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.440611 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.440892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.442682 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.442980 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.443270 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.443587 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.443870 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.444158 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.457583 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:04:22.457872 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.458142 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.458409 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.460840 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:04:22.461130 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.461401 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.461675 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.465500 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.467070 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.467370 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.468729 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.470259 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:04:22.470350 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.470546 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.470653 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.470848 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.471140 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.471452 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.473377 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:04:22.473662 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.473962 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.474254 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.474535 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.483003 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:04:22.483287 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.483594 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.483877 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.484161 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.484440 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.484719 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.486026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:04:22.486311 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.486592 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.486872 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.487150 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.487449 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.487728 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.502096 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:04:22.504784 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:04:22.505116 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:04:22.507790 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:04:22.508092 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.510266 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.511296 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.511802 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:04:22.512090 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.512384 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.512912 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.514399 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:04:22.514695 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.514980 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.518873 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.520526 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:04:22.521478 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.523088 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:04:22.523504 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.523799 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.524084 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.524362 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.526080 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.526373 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.526662 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.526945 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.532494 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:04:22.532787 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.533069 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.534966 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:04:22.535256 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.535564 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.540048 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:04:22.540341 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.540626 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.540930 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.541207 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.541495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.541771 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.542050 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.542444 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.542524 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 02:04:22.542724 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.542817 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.543002 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.543094 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.543278 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.543384 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.543575 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.543653 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.543843 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.543934 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.544115 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.544383 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.544777 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.545062 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.545336 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.545601 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.545883 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.546145 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 02:04:22.578113 dv-cinder-740146-18-smb devstack@keystone.service[80637]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5584f8fa89c0 pid: 80637 (default app) Aug 08 02:04:22.580107 dv-cinder-740146-18-smb devstack@keystone.service[80638]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5584f8fa89c0 pid: 80638 (default app) Aug 08 02:04:22.581417 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d3805-89bb-4bed-a695-3f8192a0676d None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:22.581711 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d3805-89bb-4bed-a695-3f8192a0676d None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:22.581993 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d3805-89bb-4bed-a695-3f8192a0676d None None] PATH_INFO: `/v3` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:22.586301 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 791 bytes} [Mon Aug 8 02:04:22 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:31.095935 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dff1f0-67b8-418b-8ed4-ace9ac4d227d None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:31.096505 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dff1f0-67b8-418b-8ed4-ace9ac4d227d None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:31.096505 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dff1f0-67b8-418b-8ed4-ace9ac4d227d None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:31.100992 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:04:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:31.106111 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54035814-7769-43e2-9578-17ee00c7c0a0 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:31.110562 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54035814-7769-43e2-9578-17ee00c7c0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:31.110562 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54035814-7769-43e2-9578-17ee00c7c0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:31.176197 dv-cinder-740146-18-smb devstack@keystone.service[80637]: INFO dbcounter [None req-54035814-7769-43e2-9578-17ee00c7c0a0 None None] Registered counter for database keystone Aug 08 02:04:31.197885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG oslo_db.sqlalchemy.engines [None req-54035814-7769-43e2-9578-17ee00c7c0a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 02:04:31.204011 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writer thread running {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 02:04:31.381418 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG passlib.handlers.bcrypt [None req-54035814-7769-43e2-9578-17ee00c7c0a0 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80637) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 08 02:04:31.382234 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG passlib.handlers.bcrypt [None req-54035814-7769-43e2-9578-17ee00c7c0a0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80637) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 08 02:04:31.436687 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-54035814-7769-43e2-9578-17ee00c7c0a0 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:31.438374 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-54035814-7769-43e2-9578-17ee00c7c0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:31.566881 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 08 02:04:31.715135 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dff1f0-67b8-418b-8ed4-ace9ac4d227d None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:31.783381 dv-cinder-740146-18-smb devstack@keystone.service[80638]: INFO dbcounter [None req-85dff1f0-67b8-418b-8ed4-ace9ac4d227d None None] Registered counter for database keystone Aug 08 02:04:31.802264 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG oslo_db.sqlalchemy.engines [None req-85dff1f0-67b8-418b-8ed4-ace9ac4d227d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80638) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 02:04:31.809282 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writer thread running {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 02:04:31.926702 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dff1f0-67b8-418b-8ed4-ace9ac4d227d None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:31.931279 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7253c3cf-cbcf-48c1-aafd-221515953838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:31.931928 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253c3cf-cbcf-48c1-aafd-221515953838 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:31.932212 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253c3cf-cbcf-48c1-aafd-221515953838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:31.932486 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253c3cf-cbcf-48c1-aafd-221515953838 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:31.940427 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7253c3cf-cbcf-48c1-aafd-221515953838 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:31.992406 dv-cinder-740146-18-smb devstack@keystone.service[80638]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7253c3cf-cbcf-48c1-aafd-221515953838 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 08 02:04:31.992701 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7253c3cf-cbcf-48c1-aafd-221515953838 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:32.002458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1324 bytes} [Mon Aug 8 02:04:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:04:32.008531 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54035814-7769-43e2-9578-17ee00c7c0a0 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:32.023200 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54035814-7769-43e2-9578-17ee00c7c0a0 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:32.027623 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78761d9-a683-4f9c-855a-47ba162a5a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:32.028734 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78761d9-a683-4f9c-855a-47ba162a5a59 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:32.029016 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78761d9-a683-4f9c-855a-47ba162a5a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:32.029296 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78761d9-a683-4f9c-855a-47ba162a5a59 admin admin] PATH_INFO: `/v3/projects/4b600a834cd24825ac13e271234139ce` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:32.030720 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78761d9-a683-4f9c-855a-47ba162a5a59 admin admin] RBAC: Authorizing `identity:get_project(project_id=4b600a834cd24825ac13e271234139ce)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:32.081922 dv-cinder-740146-18-smb devstack@keystone.service[80637]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c78761d9-a683-4f9c-855a-47ba162a5a59 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 08 02:04:32.082267 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78761d9-a683-4f9c-855a-47ba162a5a59 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:32.086823 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 3/5] 10.222.0.23 () {56 vars in 1207 bytes} [Mon Aug 8 02:04:32 2022] GET /identity/v3/projects/4b600a834cd24825ac13e271234139ce => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:34.092177 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd10ab1-5374-40f1-8fda-33da633899a1 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:34.092727 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd10ab1-5374-40f1-8fda-33da633899a1 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:34.092727 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd10ab1-5374-40f1-8fda-33da633899a1 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:34.096887 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 3/6] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:04:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:34.102207 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57e4dc-135c-41f7-a464-971e293cd53f None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:34.102579 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57e4dc-135c-41f7-a464-971e293cd53f None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:34.102767 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57e4dc-135c-41f7-a464-971e293cd53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:34.123588 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-cc57e4dc-135c-41f7-a464-971e293cd53f None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:34.125098 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-cc57e4dc-135c-41f7-a464-971e293cd53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:34.132811 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 08 02:04:34.155229 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd10ab1-5374-40f1-8fda-33da633899a1 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:34.167188 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd10ab1-5374-40f1-8fda-33da633899a1 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:34.171412 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd14809-1b90-49c2-92af-29fefd3ce753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:34.172006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd14809-1b90-49c2-92af-29fefd3ce753 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:34.172291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd14809-1b90-49c2-92af-29fefd3ce753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:34.172573 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd14809-1b90-49c2-92af-29fefd3ce753 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:34.180375 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd14809-1b90-49c2-92af-29fefd3ce753 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:34.182143 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd14809-1b90-49c2-92af-29fefd3ce753 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:34.190777 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1324 bytes} [Mon Aug 8 02:04:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:04:34.196102 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57e4dc-135c-41f7-a464-971e293cd53f None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:34.205355 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57e4dc-135c-41f7-a464-971e293cd53f None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:34.209683 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb06ce-4c54-4aed-8153-e5e6b35b336c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:34.210296 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb06ce-4c54-4aed-8153-e5e6b35b336c admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:34.210576 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb06ce-4c54-4aed-8153-e5e6b35b336c admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:34.210851 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb06ce-4c54-4aed-8153-e5e6b35b336c admin admin] PATH_INFO: `/v3/users/b1ada570ae344936898861ab4af182fb` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:34.212168 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb06ce-4c54-4aed-8153-e5e6b35b336c admin admin] RBAC: Authorizing `identity:get_user(user_id=b1ada570ae344936898861ab4af182fb)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:34.214584 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb06ce-4c54-4aed-8153-e5e6b35b336c admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:34.216100 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 5/9] 10.222.0.23 () {56 vars in 1198 bytes} [Mon Aug 8 02:04:34 2022] GET /identity/v3/users/b1ada570ae344936898861ab4af182fb => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:36.247222 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07577903-311c-4b72-9d69-06c323abc793 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:36.247798 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07577903-311c-4b72-9d69-06c323abc793 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:36.247798 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07577903-311c-4b72-9d69-06c323abc793 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:36.249128 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:04:36.254220 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6041e-5f75-4be5-bd48-b4207157e28f None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:36.254611 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6041e-5f75-4be5-bd48-b4207157e28f None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:36.254885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6041e-5f75-4be5-bd48-b4207157e28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:36.272781 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-fce6041e-5f75-4be5-bd48-b4207157e28f None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:36.273939 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-fce6041e-5f75-4be5-bd48-b4207157e28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:36.316947 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d946f29-cacc-422a-9348-ceaa9311f01e None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:36.317234 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d946f29-cacc-422a-9348-ceaa9311f01e None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:36.317513 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d946f29-cacc-422a-9348-ceaa9311f01e None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:36.318828 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 6/11] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:04:36.324730 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97cd04-74d7-44a4-a123-9c5b4326c5c3 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:36.325014 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97cd04-74d7-44a4-a123-9c5b4326c5c3 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:36.325596 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97cd04-74d7-44a4-a123-9c5b4326c5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:36.352288 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 6/12] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:04:36.368492 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG passlib.handlers.bcrypt [None req-7a97cd04-74d7-44a4-a123-9c5b4326c5c3 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80638) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 08 02:04:36.368943 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG passlib.handlers.bcrypt [None req-7a97cd04-74d7-44a4-a123-9c5b4326c5c3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80638) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 08 02:04:36.374813 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6041e-5f75-4be5-bd48-b4207157e28f None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:36.402244 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:36.414901 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-7a97cd04-74d7-44a4-a123-9c5b4326c5c3 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:36.416547 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-7a97cd04-74d7-44a4-a123-9c5b4326c5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:36.478995 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6041e-5f75-4be5-bd48-b4207157e28f None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:36.512059 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62eff5-f8d3-4a18-a0ff-1d8555377862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:36.512620 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62eff5-f8d3-4a18-a0ff-1d8555377862 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:36.512778 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 7/13] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:04:36.512908 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62eff5-f8d3-4a18-a0ff-1d8555377862 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:36.515747 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62eff5-f8d3-4a18-a0ff-1d8555377862 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:36.527151 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b62eff5-f8d3-4a18-a0ff-1d8555377862 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:04:36.534779 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97cd04-74d7-44a4-a123-9c5b4326c5c3 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:36.535947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-3b62eff5-f8d3-4a18-a0ff-1d8555377862 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:04:36.535947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:36.535947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:36.535947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:36.535947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:36.535947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:36.535947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:36.535947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:36.535947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:36.535947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:36.535947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:36.535947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:36.535947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:04:36.535947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:04:36.535947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:04:36.535947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:04:36.536934 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:04:36.536934 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:04:36.536934 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:04:36.536934 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:04:36.536934 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:36.536934 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:36.536934 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:36.536934 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:36.536934 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:36.536934 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:36.536934 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:36.536934 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:36.536934 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:36.536934 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:36.536934 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:36.536934 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:36.537712 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:36.537712 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:36.537712 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:36.537712 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:36.537712 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:04:36.537712 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:04:36.537712 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:04:36.537712 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:04:36.537712 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:04:36.537712 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:04:36.537712 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:04:36.537712 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:04:36.537712 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 7/14] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 02:04:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:04:36.543205 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62eff5-f8d3-4a18-a0ff-1d8555377862 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:36.623809 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:36.636425 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97cd04-74d7-44a4-a123-9c5b4326c5c3 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:36.638681 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:36.644826 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62eff5-f8d3-4a18-a0ff-1d8555377862 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:36.675569 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea27add-cd20-4951-abde-04ea61cd3170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:36.676431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea27add-cd20-4951-abde-04ea61cd3170 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:36.676775 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea27add-cd20-4951-abde-04ea61cd3170 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:36.677058 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea27add-cd20-4951-abde-04ea61cd3170 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:36.681019 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872be6d9-03d4-43ea-927e-29c2db2231a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:36.682150 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872be6d9-03d4-43ea-927e-29c2db2231a5 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:36.682442 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872be6d9-03d4-43ea-927e-29c2db2231a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:36.682795 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872be6d9-03d4-43ea-927e-29c2db2231a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:36.683384 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872be6d9-03d4-43ea-927e-29c2db2231a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:36.683703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872be6d9-03d4-43ea-927e-29c2db2231a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:36.685084 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872be6d9-03d4-43ea-927e-29c2db2231a5 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:36.696246 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 8/15] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:04:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:36.702365 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872be6d9-03d4-43ea-927e-29c2db2231a5 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:36.746967 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea27add-cd20-4951-abde-04ea61cd3170 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:36.748572 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea27add-cd20-4951-abde-04ea61cd3170 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:36.848238 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 8/16] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:04:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 08 02:04:36.854306 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea27add-cd20-4951-abde-04ea61cd3170 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:36.857016 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:36.904961 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872be6d9-03d4-43ea-927e-29c2db2231a5 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:36.938504 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f6e3e-15c3-49a7-b038-b81063cf1f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:36.939138 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f6e3e-15c3-49a7-b038-b81063cf1f06 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:36.939447 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f6e3e-15c3-49a7-b038-b81063cf1f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:36.939755 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f6e3e-15c3-49a7-b038-b81063cf1f06 None admin] PATH_INFO: `/v3/users/b1ada570ae344936898861ab4af182fb` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:36.940876 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f6e3e-15c3-49a7-b038-b81063cf1f06 None admin] RBAC: Authorizing `identity:get_user(user_id=b1ada570ae344936898861ab4af182fb)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:36.942307 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f6e3e-15c3-49a7-b038-b81063cf1f06 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:36.943891 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 9/17] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:04:36 2022] GET /identity/v3/users/b1ada570ae344936898861ab4af182fb => generated 247 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:36.949783 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f6e3e-15c3-49a7-b038-b81063cf1f06 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:36.952833 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea27add-cd20-4951-abde-04ea61cd3170 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:36.964115 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:36.986158 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8b828-6a20-42a8-8c7b-b8526c7d4b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:36.987007 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8b828-6a20-42a8-8c7b-b8526c7d4b8c None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:36.987288 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8b828-6a20-42a8-8c7b-b8526c7d4b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:36.987592 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8b828-6a20-42a8-8c7b-b8526c7d4b8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:37.005243 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac8b828-6a20-42a8-8c7b-b8526c7d4b8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:37.006705 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac8b828-6a20-42a8-8c7b-b8526c7d4b8c None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:37.024721 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-eac8b828-6a20-42a8-8c7b-b8526c7d4b8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:37.024721 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:37.024721 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:37.024721 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:37.024721 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:37.024721 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:37.024721 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:37.024721 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:37.024721 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:37.024721 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:37.024721 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:37.024721 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:37.024721 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:04:37.024721 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:04:37.024721 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:04:37.024721 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:04:37.025662 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:37.025662 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:37.025662 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:37.025662 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:37.025662 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:37.025662 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:37.025662 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:37.025662 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:37.025662 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:37.025662 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:37.025662 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:37.025662 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:37.025662 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:37.025662 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:37.025662 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:37.025662 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:37.025662 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:04:37.026442 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:04:37.026442 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:37.026442 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:04:37.026442 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 9/18] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:04:37.031700 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8b828-6a20-42a8-8c7b-b8526c7d4b8c None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:37.047627 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f6e3e-15c3-49a7-b038-b81063cf1f06 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:37.085818 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ffc8f-bd88-41d0-aa55-d449308d9c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:37.086450 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ffc8f-bd88-41d0-aa55-d449308d9c07 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:37.086734 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ffc8f-bd88-41d0-aa55-d449308d9c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:37.087012 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ffc8f-bd88-41d0-aa55-d449308d9c07 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:37.087622 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:37.088231 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ffc8f-bd88-41d0-aa55-d449308d9c07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:37.089654 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ffc8f-bd88-41d0-aa55-d449308d9c07 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:37.091202 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 10/19] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:37.096895 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ffc8f-bd88-41d0-aa55-d449308d9c07 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:37.131434 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8b828-6a20-42a8-8c7b-b8526c7d4b8c None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:37.164082 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437586f-2f20-4f4c-8c33-aa2604cc00fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:37.164892 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437586f-2f20-4f4c-8c33-aa2604cc00fb None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:37.165175 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437586f-2f20-4f4c-8c33-aa2604cc00fb None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:37.165454 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437586f-2f20-4f4c-8c33-aa2604cc00fb None admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:37.166095 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437586f-2f20-4f4c-8c33-aa2604cc00fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:37.166398 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437586f-2f20-4f4c-8c33-aa2604cc00fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:37.167839 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437586f-2f20-4f4c-8c33-aa2604cc00fb None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:37.176002 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:37.184987 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 10/20] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:37.195066 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ffc8f-bd88-41d0-aa55-d449308d9c07 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:37.231919 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867c94d-4ce1-4f16-8a87-cef3dfed4b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:37.232558 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867c94d-4ce1-4f16-8a87-cef3dfed4b09 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:37.232842 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867c94d-4ce1-4f16-8a87-cef3dfed4b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:37.233120 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867c94d-4ce1-4f16-8a87-cef3dfed4b09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:37.233866 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5867c94d-4ce1-4f16-8a87-cef3dfed4b09 None admin] RBAC: Adding query filter params (role.id=84da65a75e544d1191ec53cb6b05aa73, scope.domain.id=default, user.id=b1ada570ae344936898861ab4af182fb) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:37.234179 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5867c94d-4ce1-4f16-8a87-cef3dfed4b09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:37.235719 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5867c94d-4ce1-4f16-8a87-cef3dfed4b09 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:37.243196 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 11/21] 10.222.0.23 () {56 vars in 1322 bytes} [Mon Aug 8 02:04:37 2022] GET /identity/v3/role_assignments?user.id=b1ada570ae344936898861ab4af182fb&scope.domain.id=default&role.id=84da65a75e544d1191ec53cb6b05aa73 => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:39.715831 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168b47e-ff5d-460b-8677-c48f182c6e0d None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:39.716361 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168b47e-ff5d-460b-8677-c48f182c6e0d None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:39.716441 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168b47e-ff5d-460b-8677-c48f182c6e0d None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:39.717711 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 11/22] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:39.723048 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470790d-1e3c-49d5-94f6-fdee8af9802b None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:39.723895 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470790d-1e3c-49d5-94f6-fdee8af9802b None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:39.724369 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470790d-1e3c-49d5-94f6-fdee8af9802b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:39.752299 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-4470790d-1e3c-49d5-94f6-fdee8af9802b None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:39.753782 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-4470790d-1e3c-49d5-94f6-fdee8af9802b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:39.776549 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b4902-2a6c-4dd0-92dc-351ad70a3b12 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:39.777102 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b4902-2a6c-4dd0-92dc-351ad70a3b12 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:39.777598 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b4902-2a6c-4dd0-92dc-351ad70a3b12 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:39.779137 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 12/23] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:04:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:04:39.799060 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b2aca-bad3-4bf8-82ec-4309e7885476 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:39.799660 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b2aca-bad3-4bf8-82ec-4309e7885476 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:39.800135 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b2aca-bad3-4bf8-82ec-4309e7885476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:39.831137 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-bf4b2aca-bad3-4bf8-82ec-4309e7885476 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:39.838517 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-bf4b2aca-bad3-4bf8-82ec-4309e7885476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:39.896806 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 12/24] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:04:39.936729 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4470790d-1e3c-49d5-94f6-fdee8af9802b None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:39.979061 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 13/25] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:04:40.012069 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b2aca-bad3-4bf8-82ec-4309e7885476 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:40.049137 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:40.096622 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4470790d-1e3c-49d5-94f6-fdee8af9802b None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:40.129576 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:40.155717 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a590f1-499a-4091-947a-098bd63982fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:40.156345 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a590f1-499a-4091-947a-098bd63982fa None admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:40.159640 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a590f1-499a-4091-947a-098bd63982fa None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:40.159952 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a590f1-499a-4091-947a-098bd63982fa None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:40.160650 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a590f1-499a-4091-947a-098bd63982fa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:40.162040 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a590f1-499a-4091-947a-098bd63982fa None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:40.208004 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b2aca-bad3-4bf8-82ec-4309e7885476 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:40.250951 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a51834-f101-45cb-860e-16d700985c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:40.251947 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a51834-f101-45cb-860e-16d700985c08 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:40.252427 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a51834-f101-45cb-860e-16d700985c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:40.252914 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a51834-f101-45cb-860e-16d700985c08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:40.269296 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a51834-f101-45cb-860e-16d700985c08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:40.271102 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a51834-f101-45cb-860e-16d700985c08 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:40.296017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-73a51834-f101-45cb-860e-16d700985c08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:40.296017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:40.296017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:40.296017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:40.296017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:40.296017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:40.296017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:40.296017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:40.296017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:40.296017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:40.296017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:40.296017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:40.296017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:04:40.296017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:04:40.296017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:04:40.296017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:04:40.296928 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:40.296928 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:40.296928 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:40.296928 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:40.296928 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:40.296928 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:40.296928 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:40.296928 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:40.296928 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:40.296928 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:40.296928 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:40.296928 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:40.296928 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:40.296928 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:40.296928 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:40.296928 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:40.296928 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:04:40.297696 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:04:40.297696 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:04:40.297696 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:04:40.297696 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 14/26] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:04:40.304238 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a51834-f101-45cb-860e-16d700985c08 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:40.400909 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 13/27] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Aug 8 02:04:39 2022] POST /identity/v3/roles => generated 219 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:04:40.402716 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bb1e9-cff9-43ba-9d49-efeda2b325e1 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:40.403162 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bb1e9-cff9-43ba-9d49-efeda2b325e1 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:40.403676 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bb1e9-cff9-43ba-9d49-efeda2b325e1 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:40.405526 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 14/28] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:04:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:40.411237 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c3b5e-fa3a-4de3-9ddc-5e518b2c8299 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:40.411805 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c3b5e-fa3a-4de3-9ddc-5e518b2c8299 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:40.412344 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c3b5e-fa3a-4de3-9ddc-5e518b2c8299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:40.437970 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-183c3b5e-fa3a-4de3-9ddc-5e518b2c8299 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:40.440020 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-183c3b5e-fa3a-4de3-9ddc-5e518b2c8299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:40.518273 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 15/29] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:04:40.557439 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c3b5e-fa3a-4de3-9ddc-5e518b2c8299 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:40.660952 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:40.671390 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:40.671923 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a51834-f101-45cb-860e-16d700985c08 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:40.721119 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c3b5e-fa3a-4de3-9ddc-5e518b2c8299 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:40.726848 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ae65c-9598-43ba-bb63-3718218804bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:40.728917 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ae65c-9598-43ba-bb63-3718218804bf None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:40.729402 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ae65c-9598-43ba-bb63-3718218804bf None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:40.730093 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ae65c-9598-43ba-bb63-3718218804bf None admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:40.731000 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ae65c-9598-43ba-bb63-3718218804bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:40.731552 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ae65c-9598-43ba-bb63-3718218804bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:40.733730 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ae65c-9598-43ba-bb63-3718218804bf None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:40.749676 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 15/30] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 446 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:40.751012 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b96b0f-9e68-442f-898c-b22ffb613bc3 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:40.751307 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b96b0f-9e68-442f-898c-b22ffb613bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:40.752039 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b96b0f-9e68-442f-898c-b22ffb613bc3 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:40.752884 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 16/31] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:40.753933 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8117985-f306-4d34-a8b3-51e7213b12a0 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:40.754223 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8117985-f306-4d34-a8b3-51e7213b12a0 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:40.754532 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8117985-f306-4d34-a8b3-51e7213b12a0 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:40.761568 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 17/32] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:04:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:40.762429 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8117985-f306-4d34-a8b3-51e7213b12a0 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:40.772745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46668cc6-a3ec-4341-bbdc-b1a0ee3bc935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:40.774600 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46668cc6-a3ec-4341-bbdc-b1a0ee3bc935 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:40.775633 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46668cc6-a3ec-4341-bbdc-b1a0ee3bc935 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:40.775916 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46668cc6-a3ec-4341-bbdc-b1a0ee3bc935 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:40.792745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46668cc6-a3ec-4341-bbdc-b1a0ee3bc935 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:04:40.797754 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-46668cc6-a3ec-4341-bbdc-b1a0ee3bc935 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:04:40.797754 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:40.797754 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:40.797754 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:40.797754 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:40.797754 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:40.797754 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:40.797754 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:40.797754 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:40.797754 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:40.797754 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:40.797754 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:40.797754 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:04:40.797754 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:04:40.797754 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:04:40.797754 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:04:40.798562 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:04:40.798562 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:04:40.798562 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:04:40.798562 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:04:40.798562 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:40.798562 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:40.798562 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:40.798562 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:40.798562 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:40.798562 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:40.798562 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:40.798562 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:40.798562 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:40.798562 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:40.798562 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:40.798562 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:40.799305 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:40.799305 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:40.799305 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:40.799305 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:40.799305 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:04:40.799305 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:04:40.799305 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:04:40.799305 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:04:40.799305 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:04:40.799305 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:04:40.799305 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:04:40.799305 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:04:40.799305 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 16/33] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 02:04:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:40.800724 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0436ba-81c3-40b7-9586-55a2df43589d None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:40.800724 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0436ba-81c3-40b7-9586-55a2df43589d None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:40.800724 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0436ba-81c3-40b7-9586-55a2df43589d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:40.819852 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-bc0436ba-81c3-40b7-9586-55a2df43589d None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:40.821178 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-bc0436ba-81c3-40b7-9586-55a2df43589d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:40.891726 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8117985-f306-4d34-a8b3-51e7213b12a0 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:40.892875 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 17/34] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:04:40.899559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f3c52-93c9-492c-9b1d-f0167bc51726 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:40.899559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f3c52-93c9-492c-9b1d-f0167bc51726 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:40.899559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f3c52-93c9-492c-9b1d-f0167bc51726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:40.912687 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-354f3c52-93c9-492c-9b1d-f0167bc51726 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:40.913882 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-354f3c52-93c9-492c-9b1d-f0167bc51726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:40.929468 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b2364-059f-4dc2-82f1-60444f95fa1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:40.930086 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b2364-059f-4dc2-82f1-60444f95fa1b None admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:40.930368 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b2364-059f-4dc2-82f1-60444f95fa1b None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:40.930647 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b2364-059f-4dc2-82f1-60444f95fa1b None admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:40.931634 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b2364-059f-4dc2-82f1-60444f95fa1b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:40.933077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b2364-059f-4dc2-82f1-60444f95fa1b None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:40.965409 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:40.982956 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 18/35] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:04:40.983550 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f3c52-93c9-492c-9b1d-f0167bc51726 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:41.089140 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f3c52-93c9-492c-9b1d-f0167bc51726 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:41.123635 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89971a5b-d197-46a0-91d8-4f9139955339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:41.124243 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89971a5b-d197-46a0-91d8-4f9139955339 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:41.124528 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89971a5b-d197-46a0-91d8-4f9139955339 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:41.124806 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89971a5b-d197-46a0-91d8-4f9139955339 None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:41.125472 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89971a5b-d197-46a0-91d8-4f9139955339 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:41.125778 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89971a5b-d197-46a0-91d8-4f9139955339 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:41.127274 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89971a5b-d197-46a0-91d8-4f9139955339 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:41.135544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 18/36] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Aug 8 02:04:40 2022] POST /identity/v3/projects => generated 301 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:04:41.137485 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 19/37] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:04:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:41.138200 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a51440-89fb-496e-b3a4-c71f61f36caa None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:41.138566 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a51440-89fb-496e-b3a4-c71f61f36caa None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:41.138713 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89971a5b-d197-46a0-91d8-4f9139955339 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:41.138860 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a51440-89fb-496e-b3a4-c71f61f36caa None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:41.141347 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 19/38] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:04:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:41.143816 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a51440-89fb-496e-b3a4-c71f61f36caa None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:41.169739 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:41.197872 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:41.271840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89971a5b-d197-46a0-91d8-4f9139955339 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:41.288725 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a51440-89fb-496e-b3a4-c71f61f36caa None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:41.322491 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa1c62-ffa1-45b8-ad28-86f5b29c5d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:41.323159 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa1c62-ffa1-45b8-ad28-86f5b29c5d4d None admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:41.323579 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa1c62-ffa1-45b8-ad28-86f5b29c5d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:41.326732 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa1c62-ffa1-45b8-ad28-86f5b29c5d4d None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:41.326732 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa1c62-ffa1-45b8-ad28-86f5b29c5d4d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:41.326732 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa1c62-ffa1-45b8-ad28-86f5b29c5d4d None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:41.334527 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d6264-98ac-44d9-b098-2f8f5ffd3a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:41.335229 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d6264-98ac-44d9-b098-2f8f5ffd3a80 None admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:41.335602 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d6264-98ac-44d9-b098-2f8f5ffd3a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:41.335948 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d6264-98ac-44d9-b098-2f8f5ffd3a80 None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:41.336626 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d6264-98ac-44d9-b098-2f8f5ffd3a80 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:41.344024 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d6264-98ac-44d9-b098-2f8f5ffd3a80 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:41.398832 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 20/39] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Aug 8 02:04:41 2022] POST /identity/v3/roles => generated 225 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:04:41.399688 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa1c62-ffa1-45b8-ad28-86f5b29c5d4d None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:41.431759 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 20/40] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Aug 8 02:04:41 2022] POST /identity/v3/roles => generated 223 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:04:41.434125 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46262194-2338-4871-8fc8-c62ea603bee5 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:41.434815 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46262194-2338-4871-8fc8-c62ea603bee5 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:41.435392 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46262194-2338-4871-8fc8-c62ea603bee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:41.471635 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-46262194-2338-4871-8fc8-c62ea603bee5 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:41.474254 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-46262194-2338-4871-8fc8-c62ea603bee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:41.521697 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa1c62-ffa1-45b8-ad28-86f5b29c5d4d None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:41.531748 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:41.567882 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d82d0-3b0e-4842-9cd7-40bf99af8713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:41.568555 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d82d0-3b0e-4842-9cd7-40bf99af8713 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:41.568841 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d82d0-3b0e-4842-9cd7-40bf99af8713 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:41.569123 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d82d0-3b0e-4842-9cd7-40bf99af8713 None admin] PATH_INFO: `/v3/users/b1ada570ae344936898861ab4af182fb` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:41.573035 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d82d0-3b0e-4842-9cd7-40bf99af8713 None admin] RBAC: Authorizing `identity:get_user(user_id=b1ada570ae344936898861ab4af182fb)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:41.574482 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d82d0-3b0e-4842-9cd7-40bf99af8713 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:41.578018 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 21/41] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:04:41 2022] GET /identity/v3/users/b1ada570ae344936898861ab4af182fb => generated 247 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:41.583147 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d82d0-3b0e-4842-9cd7-40bf99af8713 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:41.585632 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:41.592658 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 21/42] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:04:41.617974 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46262194-2338-4871-8fc8-c62ea603bee5 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:41.698389 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d82d0-3b0e-4842-9cd7-40bf99af8713 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:41.730185 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46262194-2338-4871-8fc8-c62ea603bee5 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:41.731873 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ac0e2-8acf-4945-b76d-ff04ec7aac80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:41.732500 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ac0e2-8acf-4945-b76d-ff04ec7aac80 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:41.732779 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ac0e2-8acf-4945-b76d-ff04ec7aac80 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:41.733050 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ac0e2-8acf-4945-b76d-ff04ec7aac80 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:41.734436 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ac0e2-8acf-4945-b76d-ff04ec7aac80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:41.735905 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ac0e2-8acf-4945-b76d-ff04ec7aac80 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:41.737616 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 22/43] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:41.743044 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ac0e2-8acf-4945-b76d-ff04ec7aac80 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:41.765479 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff0e51-8dca-4710-b803-ea7f93a09153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:41.766110 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff0e51-8dca-4710-b803-ea7f93a09153 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:41.766396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff0e51-8dca-4710-b803-ea7f93a09153 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:41.766674 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff0e51-8dca-4710-b803-ea7f93a09153 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:41.767817 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff0e51-8dca-4710-b803-ea7f93a09153 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:41.769257 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff0e51-8dca-4710-b803-ea7f93a09153 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:41.770826 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 22/44] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:41.777033 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff0e51-8dca-4710-b803-ea7f93a09153 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:41.784531 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:41.840206 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ac0e2-8acf-4945-b76d-ff04ec7aac80 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:41.841661 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:41.873277 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89eafaf-47c1-4e4a-a5c8-8b589e8a52dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:41.873869 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89eafaf-47c1-4e4a-a5c8-8b589e8a52dc None admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:41.874155 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89eafaf-47c1-4e4a-a5c8-8b589e8a52dc None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:41.874440 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89eafaf-47c1-4e4a-a5c8-8b589e8a52dc None admin] PATH_INFO: `/v3/domains/default/users/b1ada570ae344936898861ab4af182fb/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:41.876504 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89eafaf-47c1-4e4a-a5c8-8b589e8a52dc None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=b1ada570ae344936898861ab4af182fb, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:41.877087 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff0e51-8dca-4710-b803-ea7f93a09153 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:41.877949 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89eafaf-47c1-4e4a-a5c8-8b589e8a52dc None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:41.910114 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e901d6d7-e9f3-45a1-88fa-22e3d3e24ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:41.910713 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901d6d7-e9f3-45a1-88fa-22e3d3e24ed8 None admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:41.911003 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901d6d7-e9f3-45a1-88fa-22e3d3e24ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:41.911329 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901d6d7-e9f3-45a1-88fa-22e3d3e24ed8 None admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:41.912012 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e901d6d7-e9f3-45a1-88fa-22e3d3e24ed8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:41.913447 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e901d6d7-e9f3-45a1-88fa-22e3d3e24ed8 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:41.945818 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 23/45] 10.222.0.23 () {58 vars in 1361 bytes} [Mon Aug 8 02:04:41 2022] PUT /identity/v3/domains/default/users/b1ada570ae344936898861ab4af182fb/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:04:42.019385 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 23/46] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Aug 8 02:04:41 2022] POST /identity/v3/projects => generated 312 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:04:43.911834 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419d269-c14c-4450-8de6-0e799c7a7681 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:43.916705 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419d269-c14c-4450-8de6-0e799c7a7681 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:43.916705 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419d269-c14c-4450-8de6-0e799c7a7681 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:43.916705 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 24/47] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:43.919389 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6500473-3f20-4a73-820f-5d554b17db91 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:43.919776 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6500473-3f20-4a73-820f-5d554b17db91 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:43.919966 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6500473-3f20-4a73-820f-5d554b17db91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:43.938619 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-d6500473-3f20-4a73-820f-5d554b17db91 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:43.939842 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-d6500473-3f20-4a73-820f-5d554b17db91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:44.007765 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 24/48] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:04:44.030337 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419d269-c14c-4450-8de6-0e799c7a7681 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:44.040385 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4fac2-7688-48f8-980e-610c307b98e6 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:44.041245 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4fac2-7688-48f8-980e-610c307b98e6 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:44.041531 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4fac2-7688-48f8-980e-610c307b98e6 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:44.042913 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 25/49] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:04:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:04:44.047861 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e664556-b9a9-4aec-8afd-a45923a0dce9 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:44.048155 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e664556-b9a9-4aec-8afd-a45923a0dce9 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:44.048440 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e664556-b9a9-4aec-8afd-a45923a0dce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:44.066154 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-2e664556-b9a9-4aec-8afd-a45923a0dce9 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:44.067347 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-2e664556-b9a9-4aec-8afd-a45923a0dce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:44.114237 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:44.131845 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419d269-c14c-4450-8de6-0e799c7a7681 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:44.133346 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:44.133468 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 26/50] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:04:44.156458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e664556-b9a9-4aec-8afd-a45923a0dce9 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:44.166253 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b084fa8-bc92-47c4-8974-3b6b565fd187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:44.166253 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b084fa8-bc92-47c4-8974-3b6b565fd187 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:44.166253 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b084fa8-bc92-47c4-8974-3b6b565fd187 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:44.166253 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b084fa8-bc92-47c4-8974-3b6b565fd187 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:44.176276 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b084fa8-bc92-47c4-8974-3b6b565fd187 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:04:44.181840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-8b084fa8-bc92-47c4-8974-3b6b565fd187 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:04:44.181840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:44.181840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:44.181840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:44.181840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:44.181840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:44.181840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:44.181840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:44.181840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:44.181840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:44.181840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:44.181840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:44.181840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:04:44.181840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:04:44.181840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:04:44.181840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:04:44.182660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:04:44.182660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:04:44.182660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:04:44.182660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:04:44.182660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:44.182660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:44.182660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:44.182660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:44.182660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:44.182660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:44.182660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:44.182660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:44.182660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:44.182660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:44.182660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:44.182660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:44.183433 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:44.183433 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:44.183433 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:44.183433 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:44.183433 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:04:44.183433 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:04:44.183433 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:04:44.183433 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:04:44.183433 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:04:44.183433 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:04:44.183433 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:04:44.183433 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:04:44.183433 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 25/51] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 02:04:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:44.188594 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b084fa8-bc92-47c4-8974-3b6b565fd187 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:44.252350 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e664556-b9a9-4aec-8afd-a45923a0dce9 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:44.284640 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b084fa8-bc92-47c4-8974-3b6b565fd187 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:44.285370 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9fe967-8d7f-4833-8c6c-dbdea7979184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:44.286012 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fe967-8d7f-4833-8c6c-dbdea7979184 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:44.286295 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fe967-8d7f-4833-8c6c-dbdea7979184 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:44.286573 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fe967-8d7f-4833-8c6c-dbdea7979184 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:44.287750 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9fe967-8d7f-4833-8c6c-dbdea7979184 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:44.289289 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9fe967-8d7f-4833-8c6c-dbdea7979184 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:44.291463 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 27/52] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:44.297292 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9fe967-8d7f-4833-8c6c-dbdea7979184 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:44.322784 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5603d93-dc5e-4b59-ae01-677832d0faed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:44.323411 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5603d93-dc5e-4b59-ae01-677832d0faed None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:44.323703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5603d93-dc5e-4b59-ae01-677832d0faed None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:44.323982 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5603d93-dc5e-4b59-ae01-677832d0faed None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:44.324646 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5603d93-dc5e-4b59-ae01-677832d0faed None admin] RBAC: Adding query filter params (name=admin) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:44.324953 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5603d93-dc5e-4b59-ae01-677832d0faed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:44.326346 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5603d93-dc5e-4b59-ae01-677832d0faed None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:44.334200 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 26/53] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:04:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:44.342039 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5603d93-dc5e-4b59-ae01-677832d0faed None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:44.346421 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:44.366038 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:44.395324 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9fe967-8d7f-4833-8c6c-dbdea7979184 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:44.429837 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4135481e-64f2-4889-98f4-cb36717555d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:44.430372 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135481e-64f2-4889-98f4-cb36717555d0 None admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:44.430654 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135481e-64f2-4889-98f4-cb36717555d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:44.430930 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135481e-64f2-4889-98f4-cb36717555d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:44.431652 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4135481e-64f2-4889-98f4-cb36717555d0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:44.433075 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4135481e-64f2-4889-98f4-cb36717555d0 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:44.440250 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5603d93-dc5e-4b59-ae01-677832d0faed None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:44.473867 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e7611-53a3-466e-b5ef-3e50ffffe5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:44.474493 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e7611-53a3-466e-b5ef-3e50ffffe5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:44.474776 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e7611-53a3-466e-b5ef-3e50ffffe5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:44.475055 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e7611-53a3-466e-b5ef-3e50ffffe5e4 None admin] PATH_INFO: `/v3/users/b1ada570ae344936898861ab4af182fb` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:44.476224 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33e7611-53a3-466e-b5ef-3e50ffffe5e4 None admin] RBAC: Authorizing `identity:get_user(user_id=b1ada570ae344936898861ab4af182fb)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:44.477670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33e7611-53a3-466e-b5ef-3e50ffffe5e4 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:44.479805 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 27/54] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:04:44 2022] GET /identity/v3/users/b1ada570ae344936898861ab4af182fb => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:44.485198 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e7611-53a3-466e-b5ef-3e50ffffe5e4 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:44.536122 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 28/55] 10.222.0.23 () {60 vars in 1140 bytes} [Mon Aug 8 02:04:44 2022] POST /identity/v3/projects => generated 298 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:04:44.580186 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:44.589482 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e7611-53a3-466e-b5ef-3e50ffffe5e4 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:44.627233 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca5a28-1ecd-4f9d-889d-211fd9d01c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:44.627913 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca5a28-1ecd-4f9d-889d-211fd9d01c46 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:44.628199 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca5a28-1ecd-4f9d-889d-211fd9d01c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:44.628477 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca5a28-1ecd-4f9d-889d-211fd9d01c46 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:44.629632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca5a28-1ecd-4f9d-889d-211fd9d01c46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:44.631118 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca5a28-1ecd-4f9d-889d-211fd9d01c46 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:44.632765 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 28/56] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:04:44.638795 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4135481e-64f2-4889-98f4-cb36717555d0 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:44.743694 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:44.746529 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4135481e-64f2-4889-98f4-cb36717555d0 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:44.779598 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5627c83-0908-4d68-a22a-86e047755f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:44.780452 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5627c83-0908-4d68-a22a-86e047755f77 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:44.780999 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5627c83-0908-4d68-a22a-86e047755f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:44.781766 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5627c83-0908-4d68-a22a-86e047755f77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:44.782704 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5627c83-0908-4d68-a22a-86e047755f77 None admin] RBAC: Adding query filter params (role.id=84da65a75e544d1191ec53cb6b05aa73, scope.domain.id=default, user.id=b1ada570ae344936898861ab4af182fb) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:44.783018 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5627c83-0908-4d68-a22a-86e047755f77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:44.784475 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5627c83-0908-4d68-a22a-86e047755f77 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:44.793547 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 29/57] 10.222.0.23 () {56 vars in 1322 bytes} [Mon Aug 8 02:04:44 2022] GET /identity/v3/role_assignments?user.id=b1ada570ae344936898861ab4af182fb&scope.domain.id=default&role.id=84da65a75e544d1191ec53cb6b05aa73 => generated 530 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:46.543439 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a3e03-940e-4449-ae80-8d581209ee3d None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:46.543943 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a3e03-940e-4449-ae80-8d581209ee3d None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:46.544050 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a3e03-940e-4449-ae80-8d581209ee3d None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:46.545351 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 29/58] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:46.550450 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640cf27-04d9-4641-b116-71813ed150d0 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:46.550840 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640cf27-04d9-4641-b116-71813ed150d0 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:46.551014 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640cf27-04d9-4641-b116-71813ed150d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:46.569344 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-1640cf27-04d9-4641-b116-71813ed150d0 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:46.570510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-1640cf27-04d9-4641-b116-71813ed150d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:46.634325 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 30/59] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:04:46.656962 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a3e03-940e-4449-ae80-8d581209ee3d None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:46.763017 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a3e03-940e-4449-ae80-8d581209ee3d None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:46.794969 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b3612-7b7f-4619-915d-07f29264ad7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:46.795609 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b3612-7b7f-4619-915d-07f29264ad7a None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:46.795892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b3612-7b7f-4619-915d-07f29264ad7a None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:46.796166 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b3612-7b7f-4619-915d-07f29264ad7a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:46.797254 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b3612-7b7f-4619-915d-07f29264ad7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:46.798676 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b3612-7b7f-4619-915d-07f29264ad7a None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:46.800240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 30/60] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:46.806074 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640cf27-04d9-4641-b116-71813ed150d0 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:46.895099 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:46.902019 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640cf27-04d9-4641-b116-71813ed150d0 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:46.934407 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed7e9c-0585-4249-b08c-1494601bd8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:46.935008 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed7e9c-0585-4249-b08c-1494601bd8cf None admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:46.935295 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed7e9c-0585-4249-b08c-1494601bd8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:46.935600 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed7e9c-0585-4249-b08c-1494601bd8cf None admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:46.936238 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed7e9c-0585-4249-b08c-1494601bd8cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:46.937680 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed7e9c-0585-4249-b08c-1494601bd8cf None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:47.008896 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 31/61] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 8 02:04:46 2022] POST /identity/v3/users => generated 275 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:04:50.094477 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13f15c-88f5-4aef-ab76-aace575dee19 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:50.094988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13f15c-88f5-4aef-ab76-aace575dee19 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:50.095061 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13f15c-88f5-4aef-ab76-aace575dee19 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:50.096394 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 31/62] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:04:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:50.101488 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f11787-5618-47d0-8cfb-fb2325ab6915 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:50.102313 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f11787-5618-47d0-8cfb-fb2325ab6915 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:50.102784 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f11787-5618-47d0-8cfb-fb2325ab6915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:50.132355 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-56f11787-5618-47d0-8cfb-fb2325ab6915 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:50.133887 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-56f11787-5618-47d0-8cfb-fb2325ab6915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:50.226641 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 32/63] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:04:50.259637 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5c9eb-8eba-4a7c-9838-d8b0e864e187 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:50.264304 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5c9eb-8eba-4a7c-9838-d8b0e864e187 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:50.264836 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5c9eb-8eba-4a7c-9838-d8b0e864e187 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:50.266513 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 32/64] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:04:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:50.271303 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f11787-5618-47d0-8cfb-fb2325ab6915 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:50.272733 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c377ef-d4d3-4652-bd3c-0fc26d10ea62 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:50.273226 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c377ef-d4d3-4652-bd3c-0fc26d10ea62 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:50.273698 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c377ef-d4d3-4652-bd3c-0fc26d10ea62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:50.302775 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-08c377ef-d4d3-4652-bd3c-0fc26d10ea62 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:50.304692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-08c377ef-d4d3-4652-bd3c-0fc26d10ea62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:50.350371 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:50.401217 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:50.412636 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 33/65] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:04:50.414097 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990ab62-b033-41ef-b982-a7ce5cc0dcaa None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:50.414545 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990ab62-b033-41ef-b982-a7ce5cc0dcaa None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:50.414947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990ab62-b033-41ef-b982-a7ce5cc0dcaa None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:50.416927 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 34/66] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:04:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:50.423582 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f39115-820a-40c1-92da-147a5605172e None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:50.424039 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f39115-820a-40c1-92da-147a5605172e None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:50.424476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f39115-820a-40c1-92da-147a5605172e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:50.440754 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f11787-5618-47d0-8cfb-fb2325ab6915 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:50.451767 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-62f39115-820a-40c1-92da-147a5605172e None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:50.453050 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-62f39115-820a-40c1-92da-147a5605172e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:50.480848 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406277f2-e648-435c-a8a7-5664b5b7e8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:50.482046 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406277f2-e648-435c-a8a7-5664b5b7e8f7 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:50.482920 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406277f2-e648-435c-a8a7-5664b5b7e8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:50.483697 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406277f2-e648-435c-a8a7-5664b5b7e8f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:50.496566 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406277f2-e648-435c-a8a7-5664b5b7e8f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:04:50.503033 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-406277f2-e648-435c-a8a7-5664b5b7e8f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:04:50.503033 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:50.503033 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:50.503033 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:50.503033 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:50.503033 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:50.503033 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:50.503033 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:50.503033 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:50.503033 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:50.503033 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:50.503033 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:50.503033 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:04:50.503033 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:04:50.503033 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:04:50.503033 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:04:50.503924 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:04:50.503924 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:04:50.503924 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:04:50.503924 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:04:50.503924 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:50.503924 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:50.503924 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:50.503924 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:50.503924 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:50.503924 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:50.503924 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:50.503924 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:50.503924 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:50.503924 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:50.503924 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:50.503924 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:50.504660 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:50.504660 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:50.504660 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:50.504660 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:50.504660 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:04:50.504660 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:04:50.504660 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:04:50.504660 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:04:50.504660 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:04:50.504660 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:04:50.504660 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:04:50.504660 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:04:50.504660 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 33/67] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:04:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:50.505483 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406277f2-e648-435c-a8a7-5664b5b7e8f7 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:50.530083 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 35/68] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:04:50.531141 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f39115-820a-40c1-92da-147a5605172e None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:50.640192 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406277f2-e648-435c-a8a7-5664b5b7e8f7 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:50.667336 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:50.676883 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a271315-1d4e-4857-a7f9-78d020ca0738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:50.677735 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a271315-1d4e-4857-a7f9-78d020ca0738 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:50.678156 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a271315-1d4e-4857-a7f9-78d020ca0738 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:50.678592 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a271315-1d4e-4857-a7f9-78d020ca0738 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:50.681618 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f39115-820a-40c1-92da-147a5605172e None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:50.687328 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:50.691330 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a271315-1d4e-4857-a7f9-78d020ca0738 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:04:50.696309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-1a271315-1d4e-4857-a7f9-78d020ca0738 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:04:50.696309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:50.696309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:50.696309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:50.696309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:50.696309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:50.696309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:50.696309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:50.696309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:50.696309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:50.696309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:50.696309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:50.696309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:04:50.696309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:04:50.696309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:04:50.696309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:04:50.697728 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:04:50.697728 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:04:50.697728 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:04:50.697728 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:04:50.697728 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:50.697728 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:50.697728 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:50.697728 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:50.697728 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:50.697728 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:50.697728 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:50.697728 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:50.697728 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:50.697728 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:50.697728 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:50.697728 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:50.698598 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:50.698598 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:50.698598 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:50.698598 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:50.698598 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:04:50.698598 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:04:50.698598 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:04:50.698598 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:04:50.698598 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:04:50.698598 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:04:50.698598 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:04:50.698598 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:04:50.698598 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 34/69] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 02:04:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:50.700277 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a271315-1d4e-4857-a7f9-78d020ca0738 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:50.720321 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8f91d-93ef-4277-bec8-04c544e3d23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:50.720936 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8f91d-93ef-4277-bec8-04c544e3d23d None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:50.721219 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8f91d-93ef-4277-bec8-04c544e3d23d None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:50.721497 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8f91d-93ef-4277-bec8-04c544e3d23d None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:50.722167 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af8f91d-93ef-4277-bec8-04c544e3d23d None admin] RBAC: Adding query filter params (name=member) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:50.722479 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af8f91d-93ef-4277-bec8-04c544e3d23d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:50.723912 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af8f91d-93ef-4277-bec8-04c544e3d23d None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:50.731824 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 36/70] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 02:04:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:50.733026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595f8f6-cb2f-4cd0-8704-3e90cb380d14 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:50.733316 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595f8f6-cb2f-4cd0-8704-3e90cb380d14 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:50.733596 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595f8f6-cb2f-4cd0-8704-3e90cb380d14 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:50.734800 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 37/71] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:04:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:50.735899 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29f20a-d84d-4c7b-add4-bf7a1fc068db None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:50.736353 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29f20a-d84d-4c7b-add4-bf7a1fc068db None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:50.736598 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29f20a-d84d-4c7b-add4-bf7a1fc068db None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:50.737786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 38/72] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:04:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:50.738542 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29f20a-d84d-4c7b-add4-bf7a1fc068db None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:50.804489 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a271315-1d4e-4857-a7f9-78d020ca0738 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:50.838342 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8561d9-3252-4481-8e35-b4ae42c481f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:50.838971 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8561d9-3252-4481-8e35-b4ae42c481f8 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:50.839264 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8561d9-3252-4481-8e35-b4ae42c481f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:50.839577 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8561d9-3252-4481-8e35-b4ae42c481f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:50.839677 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29f20a-d84d-4c7b-add4-bf7a1fc068db None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:50.850010 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8561d9-3252-4481-8e35-b4ae42c481f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:04:50.855162 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-2e8561d9-3252-4481-8e35-b4ae42c481f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:04:50.855162 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:50.855162 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:50.855162 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:50.855162 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:50.855162 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:50.855162 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:50.855162 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:50.855162 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:50.855162 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:50.855162 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:50.855162 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:50.855162 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:04:50.855162 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:04:50.855162 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:04:50.855162 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:04:50.856258 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:04:50.856258 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:04:50.856258 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:04:50.856258 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:04:50.856258 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:50.856258 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:50.856258 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:50.856258 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:50.856258 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:50.856258 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:50.856258 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:50.856258 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:50.856258 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:50.856258 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:50.856258 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:50.856258 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:50.862209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:50.862209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:50.862209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:50.862209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:50.862209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:04:50.862209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:04:50.862209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:04:50.862209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:04:50.862209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:04:50.862209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:04:50.862209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:04:50.862209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:04:50.862209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 35/73] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 02:04:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:50.862209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8561d9-3252-4481-8e35-b4ae42c481f8 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:50.879953 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893996e-2b7b-45fc-9e00-be375355320d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:50.880564 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893996e-2b7b-45fc-9e00-be375355320d None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:50.880850 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893996e-2b7b-45fc-9e00-be375355320d None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:50.881132 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893996e-2b7b-45fc-9e00-be375355320d None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:50.881801 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893996e-2b7b-45fc-9e00-be375355320d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:50.882111 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893996e-2b7b-45fc-9e00-be375355320d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:50.883539 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893996e-2b7b-45fc-9e00-be375355320d None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:50.891460 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 39/74] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:04:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:50.892401 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897213f-2252-48fb-b003-e96cfe159a3f None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:50.892696 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897213f-2252-48fb-b003-e96cfe159a3f None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:50.892978 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897213f-2252-48fb-b003-e96cfe159a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:50.910756 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-d897213f-2252-48fb-b003-e96cfe159a3f None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:50.912028 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-d897213f-2252-48fb-b003-e96cfe159a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:50.920131 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:50.929864 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:50.971313 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8561d9-3252-4481-8e35-b4ae42c481f8 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:50.981751 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 40/75] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:04:50.982804 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82689022-cede-4b0d-99c1-f7926bfb122c None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:50.983098 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82689022-cede-4b0d-99c1-f7926bfb122c None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:50.983424 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82689022-cede-4b0d-99c1-f7926bfb122c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:51.005474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-82689022-cede-4b0d-99c1-f7926bfb122c None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:51.006313 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674db47-41db-459d-b2a3-4da9052df8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:51.006644 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-82689022-cede-4b0d-99c1-f7926bfb122c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:51.006947 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674db47-41db-459d-b2a3-4da9052df8d5 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:51.007234 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674db47-41db-459d-b2a3-4da9052df8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:51.007556 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674db47-41db-459d-b2a3-4da9052df8d5 None admin] PATH_INFO: `/v3/users/450125842ade4df78abacc89d27d87bc` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:51.023060 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674db47-41db-459d-b2a3-4da9052df8d5 None admin] RBAC: Authorizing `identity:get_user(user_id=450125842ade4df78abacc89d27d87bc)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:51.024555 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674db47-41db-459d-b2a3-4da9052df8d5 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:51.026681 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 36/76] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:04:50 2022] GET /identity/v3/users/450125842ade4df78abacc89d27d87bc => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:51.027535 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674db47-41db-459d-b2a3-4da9052df8d5 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:51.073976 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 41/77] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:04:51.074953 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82689022-cede-4b0d-99c1-f7926bfb122c None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:51.128751 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674db47-41db-459d-b2a3-4da9052df8d5 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:51.140822 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:51.149681 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:51.162504 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846f2fd-c5ec-4ebc-a5f1-11c22eff03c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:51.163116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846f2fd-c5ec-4ebc-a5f1-11c22eff03c7 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:51.163432 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846f2fd-c5ec-4ebc-a5f1-11c22eff03c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:51.163718 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846f2fd-c5ec-4ebc-a5f1-11c22eff03c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:51.164383 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846f2fd-c5ec-4ebc-a5f1-11c22eff03c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:51.164693 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846f2fd-c5ec-4ebc-a5f1-11c22eff03c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:51.166583 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846f2fd-c5ec-4ebc-a5f1-11c22eff03c7 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:51.169726 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82689022-cede-4b0d-99c1-f7926bfb122c None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:51.183301 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 37/78] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:04:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:51.183301 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846f2fd-c5ec-4ebc-a5f1-11c22eff03c7 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:51.208419 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2adaecd-b5d0-4b2e-984b-8ccee7bcc0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:51.209052 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adaecd-b5d0-4b2e-984b-8ccee7bcc0a6 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:51.209343 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adaecd-b5d0-4b2e-984b-8ccee7bcc0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:51.209626 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adaecd-b5d0-4b2e-984b-8ccee7bcc0a6 None admin] PATH_INFO: `/v3/users/450125842ade4df78abacc89d27d87bc` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:51.210753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2adaecd-b5d0-4b2e-984b-8ccee7bcc0a6 None admin] RBAC: Authorizing `identity:get_user(user_id=450125842ade4df78abacc89d27d87bc)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:51.212301 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2adaecd-b5d0-4b2e-984b-8ccee7bcc0a6 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:51.213882 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 42/79] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:04:51 2022] GET /identity/v3/users/450125842ade4df78abacc89d27d87bc => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:51.214636 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2adaecd-b5d0-4b2e-984b-8ccee7bcc0a6 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:51.279966 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846f2fd-c5ec-4ebc-a5f1-11c22eff03c7 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:51.309741 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2adaecd-b5d0-4b2e-984b-8ccee7bcc0a6 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:51.313182 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4eecb-4154-431a-8d07-e0b664e940b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:51.313806 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4eecb-4154-431a-8d07-e0b664e940b3 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:51.314089 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4eecb-4154-431a-8d07-e0b664e940b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:51.314364 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4eecb-4154-431a-8d07-e0b664e940b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:51.315493 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c4eecb-4154-431a-8d07-e0b664e940b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:51.316936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c4eecb-4154-431a-8d07-e0b664e940b3 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:51.318491 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 38/80] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:51.320234 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4eecb-4154-431a-8d07-e0b664e940b3 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:51.343035 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a36b0-ee16-4f62-aa68-e1f2199128aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:51.343659 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a36b0-ee16-4f62-aa68-e1f2199128aa None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:51.343951 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a36b0-ee16-4f62-aa68-e1f2199128aa None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:51.344227 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a36b0-ee16-4f62-aa68-e1f2199128aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:51.355858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:51.367774 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:51.412447 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a36b0-ee16-4f62-aa68-e1f2199128aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:51.414005 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a36b0-ee16-4f62-aa68-e1f2199128aa None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:51.417257 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4eecb-4154-431a-8d07-e0b664e940b3 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:51.450152 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41de469-7928-48a3-9bef-fe1a79351522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:51.450776 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41de469-7928-48a3-9bef-fe1a79351522 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:51.451065 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41de469-7928-48a3-9bef-fe1a79351522 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:51.451348 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41de469-7928-48a3-9bef-fe1a79351522 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:51.461279 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41de469-7928-48a3-9bef-fe1a79351522 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:04:51.466889 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-c41de469-7928-48a3-9bef-fe1a79351522 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:04:51.466889 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:51.466889 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:51.466889 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:51.466889 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:51.466889 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:51.466889 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:51.466889 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:51.466889 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:51.466889 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:51.466889 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:51.466889 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:51.466889 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:04:51.466889 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:04:51.466889 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:04:51.466889 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:04:51.467780 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:04:51.467780 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:04:51.467780 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:04:51.467780 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:04:51.467780 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:51.467780 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:51.467780 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:51.467780 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:51.467780 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:51.467780 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:51.467780 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:51.467780 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:51.467780 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:51.467780 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:51.467780 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:51.467780 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:51.468517 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:51.468517 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:51.468517 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:51.468517 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:51.468517 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:04:51.468517 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:04:51.468517 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:04:51.468517 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:04:51.468517 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:04:51.468517 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:04:51.468517 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:04:51.468517 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:04:51.468517 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 39/81] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:04:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:51.469132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41de469-7928-48a3-9bef-fe1a79351522 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:51.514647 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 43/82] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:04:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:04:51.515517 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a36b0-ee16-4f62-aa68-e1f2199128aa None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:51.555417 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:51.568075 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41de469-7928-48a3-9bef-fe1a79351522 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:51.576938 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:51.601386 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2346d6-61df-4115-868a-fbd308b9768d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:51.602007 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2346d6-61df-4115-868a-fbd308b9768d None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:51.602294 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2346d6-61df-4115-868a-fbd308b9768d None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:51.602600 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2346d6-61df-4115-868a-fbd308b9768d None admin] PATH_INFO: `/v3/users/b1ada570ae344936898861ab4af182fb` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:51.603820 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2346d6-61df-4115-868a-fbd308b9768d None admin] RBAC: Authorizing `identity:get_user(user_id=b1ada570ae344936898861ab4af182fb)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:51.605256 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2346d6-61df-4115-868a-fbd308b9768d None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:51.606821 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 40/83] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:04:51 2022] GET /identity/v3/users/b1ada570ae344936898861ab4af182fb => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:51.609123 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2346d6-61df-4115-868a-fbd308b9768d None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:51.613139 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a36b0-ee16-4f62-aa68-e1f2199128aa None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:51.649631 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29e3dd-0794-485b-8347-ebc11e1320d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:51.650264 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29e3dd-0794-485b-8347-ebc11e1320d7 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:51.650547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29e3dd-0794-485b-8347-ebc11e1320d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:51.650823 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29e3dd-0794-485b-8347-ebc11e1320d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:51.707503 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2346d6-61df-4115-868a-fbd308b9768d None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:51.715910 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f29e3dd-0794-485b-8347-ebc11e1320d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:51.717388 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f29e3dd-0794-485b-8347-ebc11e1320d7 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:51.740950 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4161e2-8140-4f15-b731-2ee9e3a76c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:51.741559 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4161e2-8140-4f15-b731-2ee9e3a76c31 None admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:51.741855 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4161e2-8140-4f15-b731-2ee9e3a76c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:51.742133 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4161e2-8140-4f15-b731-2ee9e3a76c31 None admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:51.742781 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4161e2-8140-4f15-b731-2ee9e3a76c31 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:51.744244 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4161e2-8140-4f15-b731-2ee9e3a76c31 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:51.755199 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:51.810135 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 44/84] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:04:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:04:51.810940 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29e3dd-0794-485b-8347-ebc11e1320d7 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:51.849271 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 41/85] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 8 02:04:51 2022] POST /identity/v3/users => generated 289 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:04:51.850091 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4161e2-8140-4f15-b731-2ee9e3a76c31 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:51.885160 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:51.936907 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29e3dd-0794-485b-8347-ebc11e1320d7 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:51.960380 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4161e2-8140-4f15-b731-2ee9e3a76c31 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:51.997574 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173a98e-6181-4938-960c-e00fc85f7ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:51.998229 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173a98e-6181-4938-960c-e00fc85f7ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:51.998519 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173a98e-6181-4938-960c-e00fc85f7ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:51.998867 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173a98e-6181-4938-960c-e00fc85f7ae5 None admin] PATH_INFO: `/v3/projects/265f4aa2137047adb6e3cdec9bd23b99` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:52.000062 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d173a98e-6181-4938-960c-e00fc85f7ae5 None admin] RBAC: Authorizing `identity:get_project(project_id=265f4aa2137047adb6e3cdec9bd23b99)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:52.001519 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d173a98e-6181-4938-960c-e00fc85f7ae5 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:52.003232 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 42/86] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:04:51 2022] GET /identity/v3/projects/265f4aa2137047adb6e3cdec9bd23b99 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:52.004023 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173a98e-6181-4938-960c-e00fc85f7ae5 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:52.010114 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9823273-86d9-4bab-8729-658b408667b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:52.010114 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9823273-86d9-4bab-8729-658b408667b2 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:52.010314 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9823273-86d9-4bab-8729-658b408667b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:52.010525 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9823273-86d9-4bab-8729-658b408667b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:52.011148 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9823273-86d9-4bab-8729-658b408667b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:52.011491 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9823273-86d9-4bab-8729-658b408667b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:52.012858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9823273-86d9-4bab-8729-658b408667b2 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:52.023316 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 45/87] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 02:04:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:52.024191 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9823273-86d9-4bab-8729-658b408667b2 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:52.030368 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:52.125542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173a98e-6181-4938-960c-e00fc85f7ae5 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:52.128050 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:52.150353 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9823273-86d9-4bab-8729-658b408667b2 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:52.170330 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20957b-5557-4756-819f-9eb9407f04b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:52.171214 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20957b-5557-4756-819f-9eb9407f04b9 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:52.171554 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20957b-5557-4756-819f-9eb9407f04b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:52.171844 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20957b-5557-4756-819f-9eb9407f04b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:52.196386 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cbfc8-d697-4ea4-8dc5-5f6d6677a458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:52.197569 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cbfc8-d697-4ea4-8dc5-5f6d6677a458 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:52.197855 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cbfc8-d697-4ea4-8dc5-5f6d6677a458 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:52.198133 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cbfc8-d697-4ea4-8dc5-5f6d6677a458 None admin] PATH_INFO: `/v3/projects/265f4aa2137047adb6e3cdec9bd23b99` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:52.199418 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510cbfc8-d697-4ea4-8dc5-5f6d6677a458 None admin] RBAC: Authorizing `identity:get_project(project_id=265f4aa2137047adb6e3cdec9bd23b99)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:52.200888 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510cbfc8-d697-4ea4-8dc5-5f6d6677a458 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:52.202990 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 46/88] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:04:52 2022] GET /identity/v3/projects/265f4aa2137047adb6e3cdec9bd23b99 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:52.203556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cbfc8-d697-4ea4-8dc5-5f6d6677a458 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:52.270493 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20957b-5557-4756-819f-9eb9407f04b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:52.272819 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20957b-5557-4756-819f-9eb9407f04b9 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:52.282124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:52.317896 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cbfc8-d697-4ea4-8dc5-5f6d6677a458 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:52.362244 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1321d-9178-47a7-a593-ab8020578443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:52.362862 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1321d-9178-47a7-a593-ab8020578443 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:52.363562 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1321d-9178-47a7-a593-ab8020578443 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:52.363843 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1321d-9178-47a7-a593-ab8020578443 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:52.364843 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1321d-9178-47a7-a593-ab8020578443 None admin] RBAC: Adding query filter params (role.id=5691bce246d6452990f13933e19f2825, scope.project.id=265f4aa2137047adb6e3cdec9bd23b99, user.id=450125842ade4df78abacc89d27d87bc) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:52.365155 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1321d-9178-47a7-a593-ab8020578443 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:52.367285 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1321d-9178-47a7-a593-ab8020578443 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:52.374822 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 47/89] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:04:52 2022] GET /identity/v3/role_assignments?user.id=450125842ade4df78abacc89d27d87bc&scope.project.id=265f4aa2137047adb6e3cdec9bd23b99&role.id=5691bce246d6452990f13933e19f2825 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:52.375790 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1321d-9178-47a7-a593-ab8020578443 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:52.401990 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:52.407172 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 43/90] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:04:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:04:52.408168 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20957b-5557-4756-819f-9eb9407f04b9 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:52.525540 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1321d-9178-47a7-a593-ab8020578443 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:52.603594 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad0720c-daf8-4ebf-8090-b3a4ad59f897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:52.604237 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0720c-daf8-4ebf-8090-b3a4ad59f897 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:52.604524 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0720c-daf8-4ebf-8090-b3a4ad59f897 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:52.604804 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0720c-daf8-4ebf-8090-b3a4ad59f897 None admin] PATH_INFO: `/v3/users/450125842ade4df78abacc89d27d87bc` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:52.606477 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad0720c-daf8-4ebf-8090-b3a4ad59f897 None admin] RBAC: Authorizing `identity:get_user(user_id=450125842ade4df78abacc89d27d87bc)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:52.607950 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad0720c-daf8-4ebf-8090-b3a4ad59f897 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:52.611863 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20957b-5557-4756-819f-9eb9407f04b9 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:52.613335 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 48/91] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:04:52 2022] GET /identity/v3/users/450125842ade4df78abacc89d27d87bc => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:52.614126 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad0720c-daf8-4ebf-8090-b3a4ad59f897 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:52.617674 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:52.680090 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61d969-b9bb-4c6f-8e51-564ad14de8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:52.680708 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61d969-b9bb-4c6f-8e51-564ad14de8aa None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:52.681021 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61d969-b9bb-4c6f-8e51-564ad14de8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:52.681298 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61d969-b9bb-4c6f-8e51-564ad14de8aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:52.682040 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61d969-b9bb-4c6f-8e51-564ad14de8aa None admin] RBAC: Adding query filter params (role.id=e513bb6d8f644c1d9156090e507a03d4, scope.project.id=265f4aa2137047adb6e3cdec9bd23b99, user.id=450125842ade4df78abacc89d27d87bc) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:52.682355 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61d969-b9bb-4c6f-8e51-564ad14de8aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:52.683843 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61d969-b9bb-4c6f-8e51-564ad14de8aa None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:52.694085 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 44/92] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:04:52 2022] GET /identity/v3/role_assignments?user.id=450125842ade4df78abacc89d27d87bc&scope.project.id=265f4aa2137047adb6e3cdec9bd23b99&role.id=e513bb6d8f644c1d9156090e507a03d4 => generated 259 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:52.694901 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61d969-b9bb-4c6f-8e51-564ad14de8aa None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:52.810592 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad0720c-daf8-4ebf-8090-b3a4ad59f897 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:52.830063 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:52.873482 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86810b8c-078b-48df-80db-eaddc4f03023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:52.874132 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86810b8c-078b-48df-80db-eaddc4f03023 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:52.874420 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86810b8c-078b-48df-80db-eaddc4f03023 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:52.874703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86810b8c-078b-48df-80db-eaddc4f03023 None admin] PATH_INFO: `/v3/projects/265f4aa2137047adb6e3cdec9bd23b99` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:52.876649 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86810b8c-078b-48df-80db-eaddc4f03023 None admin] RBAC: Authorizing `identity:get_project(project_id=265f4aa2137047adb6e3cdec9bd23b99)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:52.878127 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86810b8c-078b-48df-80db-eaddc4f03023 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:52.883444 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 49/93] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:04:52 2022] GET /identity/v3/projects/265f4aa2137047adb6e3cdec9bd23b99 => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:52.889036 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86810b8c-078b-48df-80db-eaddc4f03023 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:52.891299 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61d969-b9bb-4c6f-8e51-564ad14de8aa None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:52.961311 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619d88e-39e7-42cb-aded-01bc26a5822b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:52.961940 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619d88e-39e7-42cb-aded-01bc26a5822b None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:52.962736 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619d88e-39e7-42cb-aded-01bc26a5822b None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:52.963019 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619d88e-39e7-42cb-aded-01bc26a5822b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:53.017082 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:53.073473 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86810b8c-078b-48df-80db-eaddc4f03023 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:53.076390 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7619d88e-39e7-42cb-aded-01bc26a5822b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:53.077852 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7619d88e-39e7-42cb-aded-01bc26a5822b None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:53.147481 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7d3e3-69a4-4355-949a-697919f30ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:53.148112 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7d3e3-69a4-4355-949a-697919f30ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:53.148403 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7d3e3-69a4-4355-949a-697919f30ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:53.148684 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7d3e3-69a4-4355-949a-697919f30ce4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:53.149425 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a7d3e3-69a4-4355-949a-697919f30ce4 None admin] RBAC: Adding query filter params (role.id=84da65a75e544d1191ec53cb6b05aa73, scope.project.id=265f4aa2137047adb6e3cdec9bd23b99, user.id=b1ada570ae344936898861ab4af182fb) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:53.150274 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a7d3e3-69a4-4355-949a-697919f30ce4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:53.151771 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a7d3e3-69a4-4355-949a-697919f30ce4 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:53.156474 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:53.162000 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 50/94] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:04:52 2022] GET /identity/v3/role_assignments?user.id=b1ada570ae344936898861ab4af182fb&scope.project.id=265f4aa2137047adb6e3cdec9bd23b99&role.id=84da65a75e544d1191ec53cb6b05aa73 => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:53.205353 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 45/95] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:04:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:04:53.210938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7d3e3-69a4-4355-949a-697919f30ce4 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:53.353913 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7d3e3-69a4-4355-949a-697919f30ce4 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:53.418582 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873980d-5643-4dbf-8829-ef83079b3246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:53.419247 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873980d-5643-4dbf-8829-ef83079b3246 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:53.419569 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873980d-5643-4dbf-8829-ef83079b3246 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:53.419852 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873980d-5643-4dbf-8829-ef83079b3246 None admin] PATH_INFO: `/v3/projects/d798db4de8b94bb0ac4a1bf73772e208` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:53.424278 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4873980d-5643-4dbf-8829-ef83079b3246 None admin] RBAC: Authorizing `identity:get_project(project_id=d798db4de8b94bb0ac4a1bf73772e208)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:53.425782 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4873980d-5643-4dbf-8829-ef83079b3246 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:53.427568 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 51/96] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:04:53 2022] GET /identity/v3/projects/d798db4de8b94bb0ac4a1bf73772e208 => generated 312 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:53.434125 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619d88e-39e7-42cb-aded-01bc26a5822b None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:53.559678 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619d88e-39e7-42cb-aded-01bc26a5822b None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:53.604084 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc3d4d-8d4c-49c9-9e62-36738d3de3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:53.604926 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc3d4d-8d4c-49c9-9e62-36738d3de3b0 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:53.605342 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc3d4d-8d4c-49c9-9e62-36738d3de3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:53.605759 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc3d4d-8d4c-49c9-9e62-36738d3de3b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:53.606607 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc3d4d-8d4c-49c9-9e62-36738d3de3b0 None admin] RBAC: Adding query filter params (role.id=5691bce246d6452990f13933e19f2825, scope.project.id=d798db4de8b94bb0ac4a1bf73772e208, user.id=450125842ade4df78abacc89d27d87bc) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:53.606921 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc3d4d-8d4c-49c9-9e62-36738d3de3b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:53.608407 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc3d4d-8d4c-49c9-9e62-36738d3de3b0 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:53.619608 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 46/97] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:04:53 2022] GET /identity/v3/role_assignments?user.id=450125842ade4df78abacc89d27d87bc&scope.project.id=d798db4de8b94bb0ac4a1bf73772e208&role.id=5691bce246d6452990f13933e19f2825 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:54.778742 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842605b-f497-467d-b857-da0dccc383a7 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:54.779833 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842605b-f497-467d-b857-da0dccc383a7 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:54.780332 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842605b-f497-467d-b857-da0dccc383a7 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:54.781901 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 52/98] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:04:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:54.787566 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4aaac9-a0a1-4eb1-b4d4-7f4a945ff154 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:54.788373 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4aaac9-a0a1-4eb1-b4d4-7f4a945ff154 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:54.788845 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4aaac9-a0a1-4eb1-b4d4-7f4a945ff154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:54.808886 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-1c4aaac9-a0a1-4eb1-b4d4-7f4a945ff154 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:54.810431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-1c4aaac9-a0a1-4eb1-b4d4-7f4a945ff154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:54.835444 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:54.883435 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 47/99] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:04:54.920491 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842605b-f497-467d-b857-da0dccc383a7 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:54.923521 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:55.038841 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842605b-f497-467d-b857-da0dccc383a7 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:55.059294 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f6881-8a6f-40d9-93fd-428750999e7a None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:55.059702 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f6881-8a6f-40d9-93fd-428750999e7a None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:55.059883 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f6881-8a6f-40d9-93fd-428750999e7a None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:55.061432 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 48/100] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:04:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:04:55.066345 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1287b9-bd90-4554-9843-ec684b2f5092 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:55.066632 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1287b9-bd90-4554-9843-ec684b2f5092 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:55.066908 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1287b9-bd90-4554-9843-ec684b2f5092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:55.081688 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6dac7-43b5-4a4c-9af7-1ec39e8ef3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:55.082759 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6dac7-43b5-4a4c-9af7-1ec39e8ef3b1 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:55.083047 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6dac7-43b5-4a4c-9af7-1ec39e8ef3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:55.083321 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6dac7-43b5-4a4c-9af7-1ec39e8ef3b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:55.084471 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6dac7-43b5-4a4c-9af7-1ec39e8ef3b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:55.085902 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6dac7-43b5-4a4c-9af7-1ec39e8ef3b1 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:55.087589 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 53/101] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:55.089183 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-6d1287b9-bd90-4554-9843-ec684b2f5092 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:55.090545 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-6d1287b9-bd90-4554-9843-ec684b2f5092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:55.097006 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6dac7-43b5-4a4c-9af7-1ec39e8ef3b1 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:55.229700 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 49/102] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:04:55.231823 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:55.254373 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7da97b-7040-4d63-a9fe-0e1f4ecfee6c None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:55.255117 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7da97b-7040-4d63-a9fe-0e1f4ecfee6c None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:55.255696 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7da97b-7040-4d63-a9fe-0e1f4ecfee6c None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:55.257459 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 50/103] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:04:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:04:55.266103 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cff1b-955b-4099-8a1f-9e84ee2c1a88 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:55.266647 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cff1b-955b-4099-8a1f-9e84ee2c1a88 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:55.267131 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cff1b-955b-4099-8a1f-9e84ee2c1a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:55.293601 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-b70cff1b-955b-4099-8a1f-9e84ee2c1a88 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:55.295100 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-b70cff1b-955b-4099-8a1f-9e84ee2c1a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:55.299324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6dac7-43b5-4a4c-9af7-1ec39e8ef3b1 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:55.360470 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f69bd-a590-46b1-956d-1546f1a9c366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:55.361096 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f69bd-a590-46b1-956d-1546f1a9c366 None admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:55.361763 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f69bd-a590-46b1-956d-1546f1a9c366 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:55.362056 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f69bd-a590-46b1-956d-1546f1a9c366 None admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:55.362843 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f69bd-a590-46b1-956d-1546f1a9c366 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:55.364360 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f69bd-a590-46b1-956d-1546f1a9c366 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:55.373994 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 51/104] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:04:55.375198 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70cff1b-955b-4099-8a1f-9e84ee2c1a88 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:55.422603 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:55.514381 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70cff1b-955b-4099-8a1f-9e84ee2c1a88 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:55.541194 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 54/105] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Aug 8 02:04:55 2022] POST /identity/v3/projects => generated 302 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:04:55.542544 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f69bd-a590-46b1-956d-1546f1a9c366 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:55.563786 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3a283-42d5-4531-b37c-bf0741978a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:55.564443 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3a283-42d5-4531-b37c-bf0741978a1a None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:55.564740 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3a283-42d5-4531-b37c-bf0741978a1a None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:55.565124 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3a283-42d5-4531-b37c-bf0741978a1a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:55.582116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3a283-42d5-4531-b37c-bf0741978a1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:04:55.593431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-9ef3a283-42d5-4531-b37c-bf0741978a1a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:04:55.593431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:55.593431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:55.593431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:55.593431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:55.593431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:55.593431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:55.593431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:55.593431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:55.593431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:55.593431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:55.593431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:55.593431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:04:55.593431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:04:55.593431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:04:55.593431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:04:55.594367 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:04:55.594367 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:04:55.594367 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:04:55.594367 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:04:55.594367 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:55.594367 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:55.594367 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:55.594367 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:55.594367 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:55.594367 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:55.594367 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:55.594367 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:55.594367 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:55.594367 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:55.594367 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:55.594367 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:55.595101 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:55.595101 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:55.595101 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:55.595101 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:55.595101 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:04:55.595101 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:04:55.595101 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:04:55.595101 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:04:55.595101 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:04:55.595101 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:04:55.595101 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:04:55.595101 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:04:55.595101 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 52/106] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:04:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:55.596532 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc1ee0-86a9-498c-a20d-e9434c0ccd9a None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:55.596532 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc1ee0-86a9-498c-a20d-e9434c0ccd9a None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:55.597845 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc1ee0-86a9-498c-a20d-e9434c0ccd9a None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:55.599485 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 53/107] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:04:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:55.605806 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc1ee0-86a9-498c-a20d-e9434c0ccd9a None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:55.688035 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f69bd-a590-46b1-956d-1546f1a9c366 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:55.724021 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:55.729621 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e24e8-b8c0-4939-be0e-35e334866d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:55.730322 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e24e8-b8c0-4939-be0e-35e334866d6c None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:55.730611 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e24e8-b8c0-4939-be0e-35e334866d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:55.730887 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e24e8-b8c0-4939-be0e-35e334866d6c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:55.746565 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e24e8-b8c0-4939-be0e-35e334866d6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:04:55.753719 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-5d7e24e8-b8c0-4939-be0e-35e334866d6c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:04:55.753719 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:55.753719 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:55.753719 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:55.753719 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:55.753719 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:55.753719 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:55.753719 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:55.753719 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:55.753719 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:55.753719 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:55.753719 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:55.753719 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:04:55.753719 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:04:55.753719 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:04:55.753719 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:04:55.754570 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:04:55.754570 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:04:55.754570 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:04:55.754570 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:04:55.754570 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:55.754570 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:55.754570 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:55.754570 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:55.754570 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:55.754570 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:55.754570 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:55.754570 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:55.754570 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:55.754570 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:55.754570 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:55.754570 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:55.755340 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:55.755340 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:55.755340 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:55.755340 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:55.755340 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:04:55.755340 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:04:55.755340 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:04:55.755340 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:04:55.755340 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:04:55.755340 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:04:55.755340 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:04:55.755340 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:04:55.755945 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 55/108] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:04:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:55.760520 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988319fa-9ed8-4a46-b03c-2068182b28ef None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:55.760936 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988319fa-9ed8-4a46-b03c-2068182b28ef None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:55.761222 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988319fa-9ed8-4a46-b03c-2068182b28ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:55.769811 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:55.785048 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-988319fa-9ed8-4a46-b03c-2068182b28ef None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:55.786435 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-988319fa-9ed8-4a46-b03c-2068182b28ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:55.797874 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc1ee0-86a9-498c-a20d-e9434c0ccd9a None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:55.847727 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6f73a-390e-4999-92b8-88a5b709df52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:55.848313 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6f73a-390e-4999-92b8-88a5b709df52 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:55.848599 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6f73a-390e-4999-92b8-88a5b709df52 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:55.850161 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6f73a-390e-4999-92b8-88a5b709df52 None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:55.850842 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a6f73a-390e-4999-92b8-88a5b709df52 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:55.851147 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a6f73a-390e-4999-92b8-88a5b709df52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:55.853059 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a6f73a-390e-4999-92b8-88a5b709df52 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:55.867470 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 54/109] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 02:04:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:55.869175 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6f73a-390e-4999-92b8-88a5b709df52 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:55.892085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 56/110] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:04:55.893014 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988319fa-9ed8-4a46-b03c-2068182b28ef None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:56.031701 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988319fa-9ed8-4a46-b03c-2068182b28ef None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:56.051764 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:56.071579 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca5e71-a6f7-4488-833f-0c9378149227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:56.072797 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca5e71-a6f7-4488-833f-0c9378149227 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:56.073086 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca5e71-a6f7-4488-833f-0c9378149227 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:56.073375 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca5e71-a6f7-4488-833f-0c9378149227 None admin] PATH_INFO: `/v3/users/413af01b0c3549f1874931214ef89120` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:56.093102 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca5e71-a6f7-4488-833f-0c9378149227 None admin] RBAC: Authorizing `identity:get_user(user_id=413af01b0c3549f1874931214ef89120)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:56.094589 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca5e71-a6f7-4488-833f-0c9378149227 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:56.097400 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 57/111] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:04:55 2022] GET /identity/v3/users/413af01b0c3549f1874931214ef89120 => generated 289 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:56.098248 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca5e71-a6f7-4488-833f-0c9378149227 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:56.110152 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6f73a-390e-4999-92b8-88a5b709df52 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:56.161511 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd0dcf-37f8-45f3-9f12-386447dbf186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:56.162475 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd0dcf-37f8-45f3-9f12-386447dbf186 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:56.163483 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd0dcf-37f8-45f3-9f12-386447dbf186 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:56.163999 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd0dcf-37f8-45f3-9f12-386447dbf186 None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:56.165161 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd0dcf-37f8-45f3-9f12-386447dbf186 None admin] RBAC: Adding query filter params (name=member) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:56.165734 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd0dcf-37f8-45f3-9f12-386447dbf186 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:56.168281 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd0dcf-37f8-45f3-9f12-386447dbf186 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:56.182185 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 55/112] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 02:04:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:56.183468 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6364a9-ca0e-4c3f-a3d9-9304d456dbac None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:56.183761 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6364a9-ca0e-4c3f-a3d9-9304d456dbac None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:56.184045 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6364a9-ca0e-4c3f-a3d9-9304d456dbac None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:56.189367 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 56/113] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:56.189367 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6364a9-ca0e-4c3f-a3d9-9304d456dbac None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:56.192123 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:56.227082 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca5e71-a6f7-4488-833f-0c9378149227 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:56.267980 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be867c40-32e5-48fb-8744-344d19b8f08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:56.268788 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be867c40-32e5-48fb-8744-344d19b8f08b None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:56.269197 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be867c40-32e5-48fb-8744-344d19b8f08b None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:56.269572 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be867c40-32e5-48fb-8744-344d19b8f08b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:56.280607 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be867c40-32e5-48fb-8744-344d19b8f08b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:04:56.285476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-be867c40-32e5-48fb-8744-344d19b8f08b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:04:56.285476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:56.285476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:56.285476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:56.285476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:56.285476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:56.285476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:56.285476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:56.285476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:56.285476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:56.285476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:56.285476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:56.285476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:04:56.285476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:04:56.285476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:04:56.285476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:04:56.286510 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:04:56.286510 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:04:56.286510 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:04:56.286510 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:04:56.286510 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:56.286510 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:56.286510 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:56.286510 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:56.286510 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:56.286510 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:56.286510 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:56.286510 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:56.286510 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:56.286510 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:56.286510 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:56.286510 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:56.287501 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:56.287501 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:56.287501 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:56.287501 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:56.287501 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:04:56.287501 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:04:56.287501 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:04:56.287501 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:04:56.287501 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:04:56.287501 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:04:56.287501 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:04:56.287501 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:04:56.289173 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 58/114] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 02:04:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:56.294025 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be867c40-32e5-48fb-8744-344d19b8f08b None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:56.323616 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:56.329706 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6364a9-ca0e-4c3f-a3d9-9304d456dbac None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:56.378747 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a957740a-325e-4f49-9756-9f35dd9dd7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:56.379981 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957740a-325e-4f49-9756-9f35dd9dd7e9 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:56.380476 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957740a-325e-4f49-9756-9f35dd9dd7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:56.381151 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957740a-325e-4f49-9756-9f35dd9dd7e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:56.401887 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be867c40-32e5-48fb-8744-344d19b8f08b None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:56.440907 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1b9a8-9f35-40b8-b29a-e0704513d5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:56.442093 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1b9a8-9f35-40b8-b29a-e0704513d5fb None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:56.442657 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1b9a8-9f35-40b8-b29a-e0704513d5fb None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:56.443598 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1b9a8-9f35-40b8-b29a-e0704513d5fb None admin] PATH_INFO: `/v3/users/450125842ade4df78abacc89d27d87bc` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:56.445201 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1b9a8-9f35-40b8-b29a-e0704513d5fb None admin] RBAC: Authorizing `identity:get_user(user_id=450125842ade4df78abacc89d27d87bc)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:56.447990 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1b9a8-9f35-40b8-b29a-e0704513d5fb None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:56.449795 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 59/115] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:04:56 2022] GET /identity/v3/users/450125842ade4df78abacc89d27d87bc => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:56.452038 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969a96d-8039-437f-aa84-50ae87ef413a None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:56.452510 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969a96d-8039-437f-aa84-50ae87ef413a None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:56.453212 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969a96d-8039-437f-aa84-50ae87ef413a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:56.467483 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a957740a-325e-4f49-9756-9f35dd9dd7e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:56.469229 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a957740a-325e-4f49-9756-9f35dd9dd7e9 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:56.471553 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:56.477140 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-8969a96d-8039-437f-aa84-50ae87ef413a None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:56.478962 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-8969a96d-8039-437f-aa84-50ae87ef413a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:56.560743 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 60/116] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:04:56.567448 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969a96d-8039-437f-aa84-50ae87ef413a None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:56.595726 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:56.601515 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 57/117] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:04:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:04:56.602669 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a957740a-325e-4f49-9756-9f35dd9dd7e9 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:56.674761 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969a96d-8039-437f-aa84-50ae87ef413a None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:56.708982 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a957740a-325e-4f49-9756-9f35dd9dd7e9 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:56.710690 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:56.714395 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61a31c-1c51-4c97-8c91-eebf06da815e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:56.715240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61a31c-1c51-4c97-8c91-eebf06da815e None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:56.715692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61a31c-1c51-4c97-8c91-eebf06da815e None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:56.716151 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61a31c-1c51-4c97-8c91-eebf06da815e None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:56.716943 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61a31c-1c51-4c97-8c91-eebf06da815e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:56.717387 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61a31c-1c51-4c97-8c91-eebf06da815e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:56.719782 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61a31c-1c51-4c97-8c91-eebf06da815e None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:56.732307 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 61/118] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:04:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:56.732307 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63ecc4-8bac-4680-86bc-b2349ef7c100 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:56.732307 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63ecc4-8bac-4680-86bc-b2349ef7c100 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:56.732307 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63ecc4-8bac-4680-86bc-b2349ef7c100 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:56.732307 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 62/119] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:56.732307 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63ecc4-8bac-4680-86bc-b2349ef7c100 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:56.750871 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1d8f6-dfb1-426b-ba86-af1ff098c064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:56.751531 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1d8f6-dfb1-426b-ba86-af1ff098c064 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:56.751816 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1d8f6-dfb1-426b-ba86-af1ff098c064 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:56.752094 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1d8f6-dfb1-426b-ba86-af1ff098c064 None admin] PATH_INFO: `/v3/projects/265f4aa2137047adb6e3cdec9bd23b99` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:56.753215 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1d8f6-dfb1-426b-ba86-af1ff098c064 None admin] RBAC: Authorizing `identity:get_project(project_id=265f4aa2137047adb6e3cdec9bd23b99)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:56.754649 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1d8f6-dfb1-426b-ba86-af1ff098c064 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:56.760963 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 58/120] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:04:56 2022] GET /identity/v3/projects/265f4aa2137047adb6e3cdec9bd23b99 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:56.760963 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1d8f6-dfb1-426b-ba86-af1ff098c064 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:56.842550 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:56.854302 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63ecc4-8bac-4680-86bc-b2349ef7c100 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:56.880303 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1d8f6-dfb1-426b-ba86-af1ff098c064 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:56.894619 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c20882-e5a5-48e1-9fc7-cd2d018fa3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:56.895249 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c20882-e5a5-48e1-9fc7-cd2d018fa3b7 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:56.895558 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c20882-e5a5-48e1-9fc7-cd2d018fa3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:56.895835 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c20882-e5a5-48e1-9fc7-cd2d018fa3b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:56.907184 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c20882-e5a5-48e1-9fc7-cd2d018fa3b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:04:56.911869 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-15c20882-e5a5-48e1-9fc7-cd2d018fa3b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:04:56.911869 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:56.911869 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:56.911869 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:56.911869 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:56.911869 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:56.911869 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:56.911869 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:56.911869 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:56.911869 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:56.911869 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:56.911869 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:56.911869 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:04:56.911869 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:04:56.911869 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:04:56.911869 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:04:56.915154 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:04:56.915154 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:04:56.915154 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:04:56.915154 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:04:56.915154 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:56.915154 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:56.915154 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:56.915154 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:56.915154 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:56.915154 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:56.915154 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:56.915154 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:56.915154 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:56.915154 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:56.915154 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:56.915154 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:56.916745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:56.916745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:56.916745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:56.916745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:56.916745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:04:56.916745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:04:56.916745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:04:56.916745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:04:56.916745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:04:56.916745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:04:56.916745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:04:56.916745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:04:56.916745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 63/121] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 02:04:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:56.916745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c20882-e5a5-48e1-9fc7-cd2d018fa3b7 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:56.922164 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20026448-0bfd-4b47-8cee-ac88325c8f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:56.922859 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20026448-0bfd-4b47-8cee-ac88325c8f2d None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:56.923149 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20026448-0bfd-4b47-8cee-ac88325c8f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:56.923454 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20026448-0bfd-4b47-8cee-ac88325c8f2d None admin] PATH_INFO: `/v3/projects/265f4aa2137047adb6e3cdec9bd23b99` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:56.924598 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20026448-0bfd-4b47-8cee-ac88325c8f2d None admin] RBAC: Authorizing `identity:get_project(project_id=265f4aa2137047adb6e3cdec9bd23b99)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:56.931525 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20026448-0bfd-4b47-8cee-ac88325c8f2d None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:56.931525 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 59/122] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:04:56 2022] GET /identity/v3/projects/265f4aa2137047adb6e3cdec9bd23b99 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:56.931525 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcfed8-523d-4df2-b7f5-172cbbfc27f5 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:56.931525 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcfed8-523d-4df2-b7f5-172cbbfc27f5 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:56.931525 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcfed8-523d-4df2-b7f5-172cbbfc27f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:56.947431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-48fcfed8-523d-4df2-b7f5-172cbbfc27f5 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:56.948613 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-48fcfed8-523d-4df2-b7f5-172cbbfc27f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:56.978601 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:57.016265 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 60/123] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:04:57.017286 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fcfed8-523d-4df2-b7f5-172cbbfc27f5 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:57.041642 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c20882-e5a5-48e1-9fc7-cd2d018fa3b7 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:57.082152 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354849a4-aa7e-4ae3-802d-bbd6d993b75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:57.082848 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354849a4-aa7e-4ae3-802d-bbd6d993b75f None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:57.083118 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354849a4-aa7e-4ae3-802d-bbd6d993b75f None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:57.083443 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354849a4-aa7e-4ae3-802d-bbd6d993b75f None admin] PATH_INFO: `/v3/users/450125842ade4df78abacc89d27d87bc` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:57.084820 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354849a4-aa7e-4ae3-802d-bbd6d993b75f None admin] RBAC: Authorizing `identity:get_user(user_id=450125842ade4df78abacc89d27d87bc)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:57.086304 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354849a4-aa7e-4ae3-802d-bbd6d993b75f None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:57.088514 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 64/124] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:04:56 2022] GET /identity/v3/users/450125842ade4df78abacc89d27d87bc => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:57.093858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354849a4-aa7e-4ae3-802d-bbd6d993b75f None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:57.113396 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:57.140297 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fcfed8-523d-4df2-b7f5-172cbbfc27f5 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:57.181873 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf362b7-5e2c-4f96-9789-4ddd7760efc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:57.182790 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf362b7-5e2c-4f96-9789-4ddd7760efc6 None admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:57.183243 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf362b7-5e2c-4f96-9789-4ddd7760efc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:57.183759 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf362b7-5e2c-4f96-9789-4ddd7760efc6 None admin] PATH_INFO: `/v3/projects/265f4aa2137047adb6e3cdec9bd23b99/users/450125842ade4df78abacc89d27d87bc/roles/5691bce246d6452990f13933e19f2825` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:57.185737 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf362b7-5e2c-4f96-9789-4ddd7760efc6 None admin] RBAC: Authorizing `identity:create_grant(project_id=265f4aa2137047adb6e3cdec9bd23b99, user_id=450125842ade4df78abacc89d27d87bc, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:57.187165 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf362b7-5e2c-4f96-9789-4ddd7760efc6 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:57.196213 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354849a4-aa7e-4ae3-802d-bbd6d993b75f None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:57.230607 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af9019-97d7-447f-a3d2-29a43fef5576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:57.231218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af9019-97d7-447f-a3d2-29a43fef5576 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:57.231540 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af9019-97d7-447f-a3d2-29a43fef5576 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:57.231821 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af9019-97d7-447f-a3d2-29a43fef5576 None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:57.232488 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af9019-97d7-447f-a3d2-29a43fef5576 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:57.232823 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af9019-97d7-447f-a3d2-29a43fef5576 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:57.234213 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af9019-97d7-447f-a3d2-29a43fef5576 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:57.242214 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 65/125] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:04:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:57.242993 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af9019-97d7-447f-a3d2-29a43fef5576 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:57.255277 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 61/126] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 02:04:57 2022] PUT /identity/v3/projects/265f4aa2137047adb6e3cdec9bd23b99/users/450125842ade4df78abacc89d27d87bc/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:04:57.268453 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf362b7-5e2c-4f96-9789-4ddd7760efc6 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:57.331209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:57.349849 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:57.382175 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af9019-97d7-447f-a3d2-29a43fef5576 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:57.419505 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf362b7-5e2c-4f96-9789-4ddd7760efc6 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:57.435514 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75266257-222f-4309-972f-43ded8cbc547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:57.436477 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75266257-222f-4309-972f-43ded8cbc547 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:57.436774 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75266257-222f-4309-972f-43ded8cbc547 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:57.437056 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75266257-222f-4309-972f-43ded8cbc547 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:57.437800 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75266257-222f-4309-972f-43ded8cbc547 None admin] RBAC: Adding query filter params (role.id=961f87b1da8444afb55ea38aa7005933, scope.project.id=265f4aa2137047adb6e3cdec9bd23b99, user.id=413af01b0c3549f1874931214ef89120) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:57.438116 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75266257-222f-4309-972f-43ded8cbc547 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:57.439903 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75266257-222f-4309-972f-43ded8cbc547 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:57.447036 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 66/127] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:04:57 2022] GET /identity/v3/role_assignments?user.id=413af01b0c3549f1874931214ef89120&scope.project.id=265f4aa2137047adb6e3cdec9bd23b99&role.id=961f87b1da8444afb55ea38aa7005933 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:57.447891 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75266257-222f-4309-972f-43ded8cbc547 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:57.466641 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820fb2ad-65a8-4dd4-a1f8-f9ef4916e9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:57.467517 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820fb2ad-65a8-4dd4-a1f8-f9ef4916e9b4 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:57.467807 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820fb2ad-65a8-4dd4-a1f8-f9ef4916e9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:57.468550 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820fb2ad-65a8-4dd4-a1f8-f9ef4916e9b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:57.483732 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820fb2ad-65a8-4dd4-a1f8-f9ef4916e9b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:04:57.490048 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-820fb2ad-65a8-4dd4-a1f8-f9ef4916e9b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:04:57.490048 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:04:57.490048 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:04:57.490048 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:04:57.490048 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:04:57.490048 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:04:57.490048 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:04:57.490048 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:04:57.490048 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:04:57.490048 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:04:57.490048 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:04:57.490048 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:04:57.490048 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:04:57.490048 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:04:57.490048 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:04:57.490048 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:04:57.491161 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:04:57.491161 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:04:57.491161 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:04:57.491161 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:04:57.491161 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:04:57.491161 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:04:57.491161 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:04:57.491161 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:04:57.491161 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:04:57.491161 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:04:57.491161 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:04:57.491161 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:04:57.491161 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:04:57.491161 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:04:57.491161 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:04:57.491161 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:04:57.492129 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:04:57.492129 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:04:57.492129 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:04:57.492129 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:04:57.492129 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:04:57.492129 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:04:57.492129 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:04:57.492129 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:04:57.492129 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:04:57.492129 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:04:57.492129 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:04:57.492129 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:04:57.497216 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 62/128] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:04:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:04:57.498859 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820fb2ad-65a8-4dd4-a1f8-f9ef4916e9b4 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:57.574483 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75266257-222f-4309-972f-43ded8cbc547 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:57.612244 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254f2fd-b06d-45bf-b53c-cc5566d515b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:57.612899 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254f2fd-b06d-45bf-b53c-cc5566d515b1 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:57.613191 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254f2fd-b06d-45bf-b53c-cc5566d515b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:57.613474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254f2fd-b06d-45bf-b53c-cc5566d515b1 None admin] PATH_INFO: `/v3/projects/265f4aa2137047adb6e3cdec9bd23b99` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:57.614681 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6254f2fd-b06d-45bf-b53c-cc5566d515b1 None admin] RBAC: Authorizing `identity:get_project(project_id=265f4aa2137047adb6e3cdec9bd23b99)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:57.616292 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6254f2fd-b06d-45bf-b53c-cc5566d515b1 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:57.618290 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 67/129] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:04:57 2022] GET /identity/v3/projects/265f4aa2137047adb6e3cdec9bd23b99 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:57.619134 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254f2fd-b06d-45bf-b53c-cc5566d515b1 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:57.641001 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:57.679947 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:57.702172 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820fb2ad-65a8-4dd4-a1f8-f9ef4916e9b4 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:57.736470 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254f2fd-b06d-45bf-b53c-cc5566d515b1 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:57.753430 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845fd62-9daf-44ba-bc89-c0cf1c9356ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:57.754082 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845fd62-9daf-44ba-bc89-c0cf1c9356ed None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:57.754367 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845fd62-9daf-44ba-bc89-c0cf1c9356ed None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:57.754649 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845fd62-9daf-44ba-bc89-c0cf1c9356ed None admin] PATH_INFO: `/v3/users/b1ada570ae344936898861ab4af182fb` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:57.757325 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845fd62-9daf-44ba-bc89-c0cf1c9356ed None admin] RBAC: Authorizing `identity:get_user(user_id=b1ada570ae344936898861ab4af182fb)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:57.761094 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845fd62-9daf-44ba-bc89-c0cf1c9356ed None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:57.763621 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 63/130] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:04:57 2022] GET /identity/v3/users/b1ada570ae344936898861ab4af182fb => generated 247 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:57.764375 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845fd62-9daf-44ba-bc89-c0cf1c9356ed None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:57.793333 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342aafe1-1e07-4fe7-bec5-3b4e8e4dffdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:57.793999 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342aafe1-1e07-4fe7-bec5-3b4e8e4dffdd None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:57.794285 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342aafe1-1e07-4fe7-bec5-3b4e8e4dffdd None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:57.794559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342aafe1-1e07-4fe7-bec5-3b4e8e4dffdd None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:57.795861 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342aafe1-1e07-4fe7-bec5-3b4e8e4dffdd None admin] RBAC: Adding query filter params (name=member) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:04:57.796176 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342aafe1-1e07-4fe7-bec5-3b4e8e4dffdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:57.798085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342aafe1-1e07-4fe7-bec5-3b4e8e4dffdd None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:57.810981 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 68/131] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 02:04:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:57.812123 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631d917-c700-4c41-9b30-ae46850a9d07 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:57.812413 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631d917-c700-4c41-9b30-ae46850a9d07 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:57.812692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631d917-c700-4c41-9b30-ae46850a9d07 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:57.814212 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 69/132] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:57.814942 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631d917-c700-4c41-9b30-ae46850a9d07 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:57.894897 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845fd62-9daf-44ba-bc89-c0cf1c9356ed None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:57.928802 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:57.940208 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534b46e-2930-4830-9af5-2c7ac699de74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:57.941173 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534b46e-2930-4830-9af5-2c7ac699de74 None admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:57.941843 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534b46e-2930-4830-9af5-2c7ac699de74 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:57.942223 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534b46e-2930-4830-9af5-2c7ac699de74 None admin] PATH_INFO: `/v3/projects/265f4aa2137047adb6e3cdec9bd23b99/users/450125842ade4df78abacc89d27d87bc/roles/e513bb6d8f644c1d9156090e507a03d4` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:57.945015 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f534b46e-2930-4830-9af5-2c7ac699de74 None admin] RBAC: Authorizing `identity:create_grant(project_id=265f4aa2137047adb6e3cdec9bd23b99, user_id=450125842ade4df78abacc89d27d87bc, role_id=e513bb6d8f644c1d9156090e507a03d4)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:57.947557 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f534b46e-2930-4830-9af5-2c7ac699de74 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:57.959807 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631d917-c700-4c41-9b30-ae46850a9d07 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:57.998701 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27456532-4bd4-4184-80c5-dabc55b6ee55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:57.999494 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27456532-4bd4-4184-80c5-dabc55b6ee55 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:57.999692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27456532-4bd4-4184-80c5-dabc55b6ee55 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:57.999966 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27456532-4bd4-4184-80c5-dabc55b6ee55 None admin] PATH_INFO: `/v3/projects/265f4aa2137047adb6e3cdec9bd23b99` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:58.001090 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27456532-4bd4-4184-80c5-dabc55b6ee55 None admin] RBAC: Authorizing `identity:get_project(project_id=265f4aa2137047adb6e3cdec9bd23b99)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:58.002596 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27456532-4bd4-4184-80c5-dabc55b6ee55 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:58.004328 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 70/133] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:04:57 2022] GET /identity/v3/projects/265f4aa2137047adb6e3cdec9bd23b99 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:58.005172 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27456532-4bd4-4184-80c5-dabc55b6ee55 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:58.054051 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 64/134] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 02:04:57 2022] PUT /identity/v3/projects/265f4aa2137047adb6e3cdec9bd23b99/users/450125842ade4df78abacc89d27d87bc/roles/e513bb6d8f644c1d9156090e507a03d4 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:04:58.055455 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71dd0b-ec73-45cb-aa29-9f92d092f605 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:58.055751 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71dd0b-ec73-45cb-aa29-9f92d092f605 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:58.056093 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71dd0b-ec73-45cb-aa29-9f92d092f605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:58.080634 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-1a71dd0b-ec73-45cb-aa29-9f92d092f605 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:58.083045 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-1a71dd0b-ec73-45cb-aa29-9f92d092f605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:58.099453 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:58.175480 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 65/135] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:04:58.176809 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71dd0b-ec73-45cb-aa29-9f92d092f605 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:58.177720 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27456532-4bd4-4184-80c5-dabc55b6ee55 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:58.251890 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3805b1-b1cf-4ff6-b9d9-7f1c1c797bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:58.252532 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3805b1-b1cf-4ff6-b9d9-7f1c1c797bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:58.252807 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3805b1-b1cf-4ff6-b9d9-7f1c1c797bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:58.253098 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3805b1-b1cf-4ff6-b9d9-7f1c1c797bb4 None admin] PATH_INFO: `/v3/users/450125842ade4df78abacc89d27d87bc` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:58.256143 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3805b1-b1cf-4ff6-b9d9-7f1c1c797bb4 None admin] RBAC: Authorizing `identity:get_user(user_id=450125842ade4df78abacc89d27d87bc)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:58.257619 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3805b1-b1cf-4ff6-b9d9-7f1c1c797bb4 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:58.259303 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 71/136] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:04:58 2022] GET /identity/v3/users/450125842ade4df78abacc89d27d87bc => generated 275 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:58.261711 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3805b1-b1cf-4ff6-b9d9-7f1c1c797bb4 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:58.287563 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:58.303039 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71dd0b-ec73-45cb-aa29-9f92d092f605 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:58.346432 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b58d6-9850-4740-89b9-1c4120b2356c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:58.349234 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b58d6-9850-4740-89b9-1c4120b2356c None admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:58.349234 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b58d6-9850-4740-89b9-1c4120b2356c None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:58.349234 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b58d6-9850-4740-89b9-1c4120b2356c None admin] PATH_INFO: `/v3/projects/265f4aa2137047adb6e3cdec9bd23b99/users/b1ada570ae344936898861ab4af182fb/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:58.352146 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b58d6-9850-4740-89b9-1c4120b2356c None admin] RBAC: Authorizing `identity:create_grant(project_id=265f4aa2137047adb6e3cdec9bd23b99, user_id=b1ada570ae344936898861ab4af182fb, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:58.353998 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b58d6-9850-4740-89b9-1c4120b2356c None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:58.416108 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 66/137] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 02:04:58 2022] PUT /identity/v3/projects/265f4aa2137047adb6e3cdec9bd23b99/users/b1ada570ae344936898861ab4af182fb/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:04:58.417185 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b58d6-9850-4740-89b9-1c4120b2356c None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:58.429832 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:58.435794 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3805b1-b1cf-4ff6-b9d9-7f1c1c797bb4 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:58.491683 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545e3e4-c3cd-41a0-9ca1-d42291986500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:58.492316 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545e3e4-c3cd-41a0-9ca1-d42291986500 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:58.492595 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545e3e4-c3cd-41a0-9ca1-d42291986500 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:58.492870 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545e3e4-c3cd-41a0-9ca1-d42291986500 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:58.494578 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8545e3e4-c3cd-41a0-9ca1-d42291986500 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:58.496251 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8545e3e4-c3cd-41a0-9ca1-d42291986500 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:58.505036 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 72/138] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:04:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:58.507094 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545e3e4-c3cd-41a0-9ca1-d42291986500 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:58.622102 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b58d6-9850-4740-89b9-1c4120b2356c None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:58.629090 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:58.655171 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545e3e4-c3cd-41a0-9ca1-d42291986500 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:58.697776 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4f039-1cd1-4fd2-beae-58c27ee60eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:58.698392 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4f039-1cd1-4fd2-beae-58c27ee60eb9 None admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:58.698672 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4f039-1cd1-4fd2-beae-58c27ee60eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:58.698948 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4f039-1cd1-4fd2-beae-58c27ee60eb9 None admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:58.699975 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a4f039-1cd1-4fd2-beae-58c27ee60eb9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:58.701573 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a4f039-1cd1-4fd2-beae-58c27ee60eb9 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:58.720110 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498ef4f-c955-40ae-9536-ce89e1543b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:58.721126 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498ef4f-c955-40ae-9536-ce89e1543b8a None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:58.721638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498ef4f-c955-40ae-9536-ce89e1543b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:58.722120 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498ef4f-c955-40ae-9536-ce89e1543b8a None admin] PATH_INFO: `/v3/projects/d798db4de8b94bb0ac4a1bf73772e208` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:58.723659 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d498ef4f-c955-40ae-9536-ce89e1543b8a None admin] RBAC: Authorizing `identity:get_project(project_id=d798db4de8b94bb0ac4a1bf73772e208)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:58.725411 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d498ef4f-c955-40ae-9536-ce89e1543b8a None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:58.727312 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 67/139] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:04:58 2022] GET /identity/v3/projects/d798db4de8b94bb0ac4a1bf73772e208 => generated 312 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:04:58.734077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498ef4f-c955-40ae-9536-ce89e1543b8a None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:58.829708 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:04:58.830907 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 73/140] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 8 02:04:58 2022] POST /identity/v3/users => generated 283 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:04:58.860250 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498ef4f-c955-40ae-9536-ce89e1543b8a None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:58.906885 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52589e84-7ca5-4300-a5bf-b15a7376d288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:58.907608 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52589e84-7ca5-4300-a5bf-b15a7376d288 None admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:58.907875 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52589e84-7ca5-4300-a5bf-b15a7376d288 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:58.908155 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52589e84-7ca5-4300-a5bf-b15a7376d288 None admin] PATH_INFO: `/v3/projects/d798db4de8b94bb0ac4a1bf73772e208/users/450125842ade4df78abacc89d27d87bc/roles/5691bce246d6452990f13933e19f2825` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:58.910600 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52589e84-7ca5-4300-a5bf-b15a7376d288 None admin] RBAC: Authorizing `identity:create_grant(project_id=d798db4de8b94bb0ac4a1bf73772e208, user_id=450125842ade4df78abacc89d27d87bc, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:04:58.912194 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52589e84-7ca5-4300-a5bf-b15a7376d288 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:04:58.976370 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 68/141] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 02:04:58 2022] PUT /identity/v3/projects/d798db4de8b94bb0ac4a1bf73772e208/users/450125842ade4df78abacc89d27d87bc/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:04:59.657818 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca94d1a-b4e8-4a47-a3b6-e72fe09dac1e None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:59.658298 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca94d1a-b4e8-4a47-a3b6-e72fe09dac1e None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:59.658372 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca94d1a-b4e8-4a47-a3b6-e72fe09dac1e None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:59.659727 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 74/142] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:04:59.672552 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afe7f1-96b7-47c2-98dd-c2627ca06143 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:59.672838 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afe7f1-96b7-47c2-98dd-c2627ca06143 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:59.673117 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afe7f1-96b7-47c2-98dd-c2627ca06143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:59.698180 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-95afe7f1-96b7-47c2-98dd-c2627ca06143 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:04:59.699913 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-95afe7f1-96b7-47c2-98dd-c2627ca06143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:04:59.776674 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 69/143] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:04:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:04:59.811339 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca94d1a-b4e8-4a47-a3b6-e72fe09dac1e None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:04:59.950746 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca94d1a-b4e8-4a47-a3b6-e72fe09dac1e None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:04:59.995859 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0bf514-186e-4587-8800-1a9d98efd1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:04:59.996529 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bf514-186e-4587-8800-1a9d98efd1fd None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:04:59.996819 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bf514-186e-4587-8800-1a9d98efd1fd None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:04:59.997090 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bf514-186e-4587-8800-1a9d98efd1fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:04:59.998931 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:00.012599 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0bf514-186e-4587-8800-1a9d98efd1fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:00.021428 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-be0bf514-186e-4587-8800-1a9d98efd1fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:05:00.021428 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:00.021428 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:00.021428 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:00.021428 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:00.021428 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:00.021428 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:00.021428 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:00.021428 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:00.021428 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:00.021428 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:00.021428 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:00.021428 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:00.021428 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:00.021428 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:00.021428 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:00.022330 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:00.022330 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:00.022330 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:00.022330 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:00.022330 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:00.022330 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:00.022330 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:00.022330 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:00.022330 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:00.022330 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:00.022330 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:00.022330 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:00.022330 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:00.022330 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:00.022330 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:00.022330 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:00.023087 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:00.023087 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:00.023087 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:00.023087 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:00.023087 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:00.023087 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:00.023087 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:00.023087 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:00.023087 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:00.023087 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:00.023087 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:05:00.023087 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:00.024239 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 75/144] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:04:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:00.032469 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afe7f1-96b7-47c2-98dd-c2627ca06143 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:00.123555 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:00.166423 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afe7f1-96b7-47c2-98dd-c2627ca06143 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:00.208313 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9172c8-be32-42ba-963b-ef90b6539cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:00.208855 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9172c8-be32-42ba-963b-ef90b6539cce None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:00.209142 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9172c8-be32-42ba-963b-ef90b6539cce None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:00.209468 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9172c8-be32-42ba-963b-ef90b6539cce None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:00.210143 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9172c8-be32-42ba-963b-ef90b6539cce None admin] RBAC: Adding query filter params (name=member) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:00.210448 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9172c8-be32-42ba-963b-ef90b6539cce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:00.212032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9172c8-be32-42ba-963b-ef90b6539cce None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:00.217836 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf33e6-6d93-4b6d-92bb-593aae476a0a None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:00.218091 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf33e6-6d93-4b6d-92bb-593aae476a0a None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:00.221133 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf33e6-6d93-4b6d-92bb-593aae476a0a None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:00.222431 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 76/145] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:05:00.224962 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 70/146] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 02:05:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:00.228231 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfab41c-ea00-403d-8530-b66b2c4c0c29 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:00.228520 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfab41c-ea00-403d-8530-b66b2c4c0c29 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:00.228798 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfab41c-ea00-403d-8530-b66b2c4c0c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:00.235319 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9172c8-be32-42ba-963b-ef90b6539cce None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:00.267384 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-8cfab41c-ea00-403d-8530-b66b2c4c0c29 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:00.268637 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-8cfab41c-ea00-403d-8530-b66b2c4c0c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:00.418465 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 77/147] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:00.439131 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9172c8-be32-42ba-963b-ef90b6539cce None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:00.451192 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfab41c-ea00-403d-8530-b66b2c4c0c29 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:00.487676 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:00.513272 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba81d912-18ac-4c8a-a3cd-5c17b0a04783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:00.513914 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81d912-18ac-4c8a-a3cd-5c17b0a04783 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:00.514197 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81d912-18ac-4c8a-a3cd-5c17b0a04783 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:00.514491 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81d912-18ac-4c8a-a3cd-5c17b0a04783 None admin] PATH_INFO: `/v3/users/450125842ade4df78abacc89d27d87bc` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:00.516350 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba81d912-18ac-4c8a-a3cd-5c17b0a04783 None admin] RBAC: Authorizing `identity:get_user(user_id=450125842ade4df78abacc89d27d87bc)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:00.517803 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba81d912-18ac-4c8a-a3cd-5c17b0a04783 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:00.519444 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 71/148] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:05:00 2022] GET /identity/v3/users/450125842ade4df78abacc89d27d87bc => generated 275 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:05:00.531394 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba81d912-18ac-4c8a-a3cd-5c17b0a04783 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:00.627248 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfab41c-ea00-403d-8530-b66b2c4c0c29 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:00.667737 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:00.689216 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb24d4-6504-4fe1-b677-f3ae5d73d9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:00.690234 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb24d4-6504-4fe1-b677-f3ae5d73d9ca None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:00.690518 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb24d4-6504-4fe1-b677-f3ae5d73d9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:00.690792 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb24d4-6504-4fe1-b677-f3ae5d73d9ca None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:00.713376 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb24d4-6504-4fe1-b677-f3ae5d73d9ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:00.719710 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-03eb24d4-6504-4fe1-b677-f3ae5d73d9ca None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:05:00.719710 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:00.719710 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:00.719710 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:00.719710 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:00.719710 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:00.719710 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:00.719710 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:00.719710 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:00.719710 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:00.719710 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:00.719710 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:00.719710 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:00.719710 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:00.719710 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:00.719710 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:00.720703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:00.720703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:00.720703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:00.720703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:00.720703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:00.720703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:00.720703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:00.720703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:00.720703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:00.720703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:00.720703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:00.720703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:00.720703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:00.720703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:00.720703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:00.720703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:00.722068 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:00.722068 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:00.722068 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:00.722068 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:00.722068 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:00.722068 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:00.722068 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:00.722068 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:00.722068 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:00.722068 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:00.722068 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:05:00.722068 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:00.722068 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 78/149] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:05:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:05:00.723916 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba81d912-18ac-4c8a-a3cd-5c17b0a04783 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:00.726624 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb24d4-6504-4fe1-b677-f3ae5d73d9ca None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:00.785411 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299acc0-a5a8-45af-9321-d2441803fea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:00.786002 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299acc0-a5a8-45af-9321-d2441803fea4 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:00.786286 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299acc0-a5a8-45af-9321-d2441803fea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:00.786565 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299acc0-a5a8-45af-9321-d2441803fea4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:00.885221 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:00.902765 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299acc0-a5a8-45af-9321-d2441803fea4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:00.905070 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299acc0-a5a8-45af-9321-d2441803fea4 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:00.937321 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb24d4-6504-4fe1-b677-f3ae5d73d9ca None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:01.005009 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1a433-4241-4f6e-b507-eae2a4166677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:01.005895 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1a433-4241-4f6e-b507-eae2a4166677 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:01.006325 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1a433-4241-4f6e-b507-eae2a4166677 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:01.006730 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1a433-4241-4f6e-b507-eae2a4166677 None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:01.007575 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1a433-4241-4f6e-b507-eae2a4166677 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:01.008065 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1a433-4241-4f6e-b507-eae2a4166677 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:01.009630 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1a433-4241-4f6e-b507-eae2a4166677 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:01.027307 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 79/150] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 02:05:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:05:01.028891 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe1047-37d1-4c24-baf8-5a7d89519567 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:01.029322 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe1047-37d1-4c24-baf8-5a7d89519567 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:01.029731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe1047-37d1-4c24-baf8-5a7d89519567 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:01.031125 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 80/151] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:01.044256 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794b9c3-27f2-43c4-aa1f-b75ca1ef697d None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:01.044736 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794b9c3-27f2-43c4-aa1f-b75ca1ef697d None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:01.045162 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794b9c3-27f2-43c4-aa1f-b75ca1ef697d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:01.076431 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-4794b9c3-27f2-43c4-aa1f-b75ca1ef697d None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:01.077867 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-4794b9c3-27f2-43c4-aa1f-b75ca1ef697d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:01.087377 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 72/152] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:05:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:05:01.087377 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299acc0-a5a8-45af-9321-d2441803fea4 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:01.174585 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:01.221098 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 81/153] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 08 02:05:01.222075 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794b9c3-27f2-43c4-aa1f-b75ca1ef697d None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:01.223758 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:01.230189 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299acc0-a5a8-45af-9321-d2441803fea4 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:01.278178 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86793559-dc19-4361-add3-c1299eb162a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:01.278827 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86793559-dc19-4361-add3-c1299eb162a2 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:01.279112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86793559-dc19-4361-add3-c1299eb162a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:01.279424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86793559-dc19-4361-add3-c1299eb162a2 None admin] PATH_INFO: `/v3/users/413af01b0c3549f1874931214ef89120` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:01.283251 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86793559-dc19-4361-add3-c1299eb162a2 None admin] RBAC: Authorizing `identity:get_user(user_id=413af01b0c3549f1874931214ef89120)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:01.284744 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86793559-dc19-4361-add3-c1299eb162a2 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:01.292830 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 73/154] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:05:01 2022] GET /identity/v3/users/413af01b0c3549f1874931214ef89120 => generated 289 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:01.295286 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86793559-dc19-4361-add3-c1299eb162a2 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:01.426530 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794b9c3-27f2-43c4-aa1f-b75ca1ef697d None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:01.483866 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855672f8-53ba-4b7c-b9de-e6ec66dd32a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:01.484608 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855672f8-53ba-4b7c-b9de-e6ec66dd32a5 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:01.485051 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855672f8-53ba-4b7c-b9de-e6ec66dd32a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:01.485335 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855672f8-53ba-4b7c-b9de-e6ec66dd32a5 None admin] PATH_INFO: `/v3/projects/265f4aa2137047adb6e3cdec9bd23b99` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:01.488960 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855672f8-53ba-4b7c-b9de-e6ec66dd32a5 None admin] RBAC: Authorizing `identity:get_project(project_id=265f4aa2137047adb6e3cdec9bd23b99)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:01.490661 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855672f8-53ba-4b7c-b9de-e6ec66dd32a5 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:01.492375 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 82/155] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:05:01 2022] GET /identity/v3/projects/265f4aa2137047adb6e3cdec9bd23b99 => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:01.493154 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855672f8-53ba-4b7c-b9de-e6ec66dd32a5 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:01.506169 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86793559-dc19-4361-add3-c1299eb162a2 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:01.562275 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:01.583155 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7969a-0959-402f-ab4a-3538c3e606c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:01.583834 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7969a-0959-402f-ab4a-3538c3e606c4 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:01.584114 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7969a-0959-402f-ab4a-3538c3e606c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:01.584388 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7969a-0959-402f-ab4a-3538c3e606c4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:01.606667 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b7969a-0959-402f-ab4a-3538c3e606c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:01.612289 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-12b7969a-0959-402f-ab4a-3538c3e606c4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:05:01.612289 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:01.612289 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:01.612289 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:01.612289 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:01.612289 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:01.612289 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:01.612289 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:01.612289 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:01.612289 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:01.612289 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:01.612289 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:01.612289 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:01.612289 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:01.612289 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:01.612289 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:01.613136 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:01.613136 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:01.613136 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:01.613136 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:01.613136 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:01.613136 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:01.613136 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:01.613136 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:01.613136 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:01.613136 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:01.613136 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:01.613136 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:01.613136 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:01.613136 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:01.613136 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:01.613136 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:01.613901 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:01.613901 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:01.613901 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:01.613901 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:01.613901 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:01.613901 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:01.613901 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:01.613901 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:01.613901 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:01.613901 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:01.613901 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:05:01.613901 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:01.616840 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 74/156] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 02:05:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:01.618142 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7969a-0959-402f-ab4a-3538c3e606c4 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:01.669651 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855672f8-53ba-4b7c-b9de-e6ec66dd32a5 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:01.671213 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:01.748883 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd05152b-e8e1-4ccb-bd74-3e61cc31e5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:01.749697 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05152b-e8e1-4ccb-bd74-3e61cc31e5b6 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:01.749984 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05152b-e8e1-4ccb-bd74-3e61cc31e5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:01.750258 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05152b-e8e1-4ccb-bd74-3e61cc31e5b6 None admin] PATH_INFO: `/v3/projects/265f4aa2137047adb6e3cdec9bd23b99` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:01.752656 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd05152b-e8e1-4ccb-bd74-3e61cc31e5b6 None admin] RBAC: Authorizing `identity:get_project(project_id=265f4aa2137047adb6e3cdec9bd23b99)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:01.754371 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd05152b-e8e1-4ccb-bd74-3e61cc31e5b6 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:01.756401 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 83/157] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:05:01 2022] GET /identity/v3/projects/265f4aa2137047adb6e3cdec9bd23b99 => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:01.757543 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd05152b-e8e1-4ccb-bd74-3e61cc31e5b6 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:01.861703 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7969a-0959-402f-ab4a-3538c3e606c4 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:01.939394 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd05152b-e8e1-4ccb-bd74-3e61cc31e5b6 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:01.957520 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013d068-a3f7-4ed5-a7db-d2dec8a2d0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:01.958419 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013d068-a3f7-4ed5-a7db-d2dec8a2d0b9 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:01.958846 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013d068-a3f7-4ed5-a7db-d2dec8a2d0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:01.959314 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013d068-a3f7-4ed5-a7db-d2dec8a2d0b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:01.960221 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c013d068-a3f7-4ed5-a7db-d2dec8a2d0b9 None admin] RBAC: Adding query filter params (role.id=5691bce246d6452990f13933e19f2825, scope.project.id=265f4aa2137047adb6e3cdec9bd23b99, user.id=450125842ade4df78abacc89d27d87bc) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:01.960674 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c013d068-a3f7-4ed5-a7db-d2dec8a2d0b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:01.962813 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c013d068-a3f7-4ed5-a7db-d2dec8a2d0b9 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:01.963718 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:01.974386 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 75/158] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:05:01 2022] GET /identity/v3/role_assignments?user.id=450125842ade4df78abacc89d27d87bc&scope.project.id=265f4aa2137047adb6e3cdec9bd23b99&role.id=5691bce246d6452990f13933e19f2825 => generated 608 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:01.975447 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013d068-a3f7-4ed5-a7db-d2dec8a2d0b9 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:02.024114 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4131b3b-e43b-4301-a61b-9f667294720d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:02.025356 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4131b3b-e43b-4301-a61b-9f667294720d None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:02.025667 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4131b3b-e43b-4301-a61b-9f667294720d None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:02.025907 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4131b3b-e43b-4301-a61b-9f667294720d None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:02.026886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4131b3b-e43b-4301-a61b-9f667294720d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:02.026997 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4131b3b-e43b-4301-a61b-9f667294720d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:02.031458 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4131b3b-e43b-4301-a61b-9f667294720d None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:02.047381 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 84/159] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:05:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:02.057571 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4131b3b-e43b-4301-a61b-9f667294720d None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:02.115479 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:02.132307 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013d068-a3f7-4ed5-a7db-d2dec8a2d0b9 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:02.168346 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fab58e-04cf-4bfc-be7c-4a8afdc39985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:02.169278 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fab58e-04cf-4bfc-be7c-4a8afdc39985 None admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:02.169719 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fab58e-04cf-4bfc-be7c-4a8afdc39985 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:02.170133 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fab58e-04cf-4bfc-be7c-4a8afdc39985 None admin] PATH_INFO: `/v3/projects/265f4aa2137047adb6e3cdec9bd23b99/users/413af01b0c3549f1874931214ef89120/roles/961f87b1da8444afb55ea38aa7005933` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:02.172308 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fab58e-04cf-4bfc-be7c-4a8afdc39985 None admin] RBAC: Authorizing `identity:create_grant(project_id=265f4aa2137047adb6e3cdec9bd23b99, user_id=413af01b0c3549f1874931214ef89120, role_id=961f87b1da8444afb55ea38aa7005933)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:02.173940 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fab58e-04cf-4bfc-be7c-4a8afdc39985 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:02.226720 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 76/160] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 02:05:01 2022] PUT /identity/v3/projects/265f4aa2137047adb6e3cdec9bd23b99/users/413af01b0c3549f1874931214ef89120/roles/961f87b1da8444afb55ea38aa7005933 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:05:02.228338 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b625a3b-6833-4dae-beb6-90c68dfc1d86 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:02.228777 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b625a3b-6833-4dae-beb6-90c68dfc1d86 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:02.229197 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b625a3b-6833-4dae-beb6-90c68dfc1d86 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:02.235380 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 77/161] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:02.237799 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e294fe4-940d-48c7-be65-3258b0ce6d15 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:02.239519 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4131b3b-e43b-4301-a61b-9f667294720d None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:02.244761 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e294fe4-940d-48c7-be65-3258b0ce6d15 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:02.244761 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e294fe4-940d-48c7-be65-3258b0ce6d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:02.288145 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-2e294fe4-940d-48c7-be65-3258b0ce6d15 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:02.296422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-2e294fe4-940d-48c7-be65-3258b0ce6d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:02.337085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd334872-58a6-422c-887d-fcd82a6bdb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:02.338565 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd334872-58a6-422c-887d-fcd82a6bdb85 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:02.339748 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd334872-58a6-422c-887d-fcd82a6bdb85 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:02.341082 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd334872-58a6-422c-887d-fcd82a6bdb85 None admin] PATH_INFO: `/v3/users/450125842ade4df78abacc89d27d87bc` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:02.343341 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd334872-58a6-422c-887d-fcd82a6bdb85 None admin] RBAC: Authorizing `identity:get_user(user_id=450125842ade4df78abacc89d27d87bc)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:02.347305 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd334872-58a6-422c-887d-fcd82a6bdb85 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:02.349920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 85/162] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:05:02 2022] GET /identity/v3/users/450125842ade4df78abacc89d27d87bc => generated 275 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:02.359269 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd334872-58a6-422c-887d-fcd82a6bdb85 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:02.428981 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:02.430309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 78/163] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:02.488848 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e294fe4-940d-48c7-be65-3258b0ce6d15 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:02.509722 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd334872-58a6-422c-887d-fcd82a6bdb85 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:02.551493 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0dafe-247d-4d50-990d-b262628444cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:02.551988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0dafe-247d-4d50-990d-b262628444cc None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:02.552268 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0dafe-247d-4d50-990d-b262628444cc None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:02.552544 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0dafe-247d-4d50-990d-b262628444cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:02.626628 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:02.644408 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb0dafe-247d-4d50-990d-b262628444cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:02.645827 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb0dafe-247d-4d50-990d-b262628444cc None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:02.654491 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e294fe4-940d-48c7-be65-3258b0ce6d15 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:02.702676 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c018b78-4b67-428e-a6b3-8df57e4656ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:02.703697 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:02.704644 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c018b78-4b67-428e-a6b3-8df57e4656ef None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:02.705173 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c018b78-4b67-428e-a6b3-8df57e4656ef None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:02.705645 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c018b78-4b67-428e-a6b3-8df57e4656ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:02.723988 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c018b78-4b67-428e-a6b3-8df57e4656ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:02.729818 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-0c018b78-4b67-428e-a6b3-8df57e4656ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:05:02.729818 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:02.729818 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:02.729818 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:02.729818 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:02.729818 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:02.729818 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:02.729818 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:02.729818 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:02.729818 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:02.729818 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:02.729818 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:02.729818 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:02.729818 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:02.729818 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:02.729818 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:02.730651 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:02.730651 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:02.730651 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:02.730651 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:02.730651 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:02.730651 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:02.730651 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:02.730651 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:02.730651 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:02.730651 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:02.730651 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:02.730651 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:02.730651 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:02.730651 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:02.730651 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:02.730651 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:02.731460 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:02.731460 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:02.731460 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:02.731460 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:02.731460 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:02.731460 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:02.731460 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:02.731460 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:02.731460 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:02.731460 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:02.731460 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:05:02.731460 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:02.734247 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 79/164] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 02:05:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:05:02.739959 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c018b78-4b67-428e-a6b3-8df57e4656ef None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:02.780258 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 86/165] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:05:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:05:02.806430 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0dafe-247d-4d50-990d-b262628444cc None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:02.862186 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c018b78-4b67-428e-a6b3-8df57e4656ef None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:02.904179 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12f273-5271-4f65-b4c1-a2d019e28be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:02.905155 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12f273-5271-4f65-b4c1-a2d019e28be1 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:02.905640 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12f273-5271-4f65-b4c1-a2d019e28be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:02.906108 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12f273-5271-4f65-b4c1-a2d019e28be1 None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:02.906956 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc12f273-5271-4f65-b4c1-a2d019e28be1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:02.907453 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc12f273-5271-4f65-b4c1-a2d019e28be1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:02.909094 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc12f273-5271-4f65-b4c1-a2d019e28be1 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:02.918084 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:02.945695 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 80/166] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:05:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:05:02.947478 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958dfd5-2aca-46e8-a4fd-dea8441874e5 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:02.947985 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958dfd5-2aca-46e8-a4fd-dea8441874e5 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:02.948483 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958dfd5-2aca-46e8-a4fd-dea8441874e5 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:02.952419 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 81/167] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:02.960401 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958dfd5-2aca-46e8-a4fd-dea8441874e5 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:02.988443 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0dafe-247d-4d50-990d-b262628444cc None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:03.027476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d34fbb-0467-4546-92b0-37e1ac352aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:03.028116 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d34fbb-0467-4546-92b0-37e1ac352aaf None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:03.028392 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d34fbb-0467-4546-92b0-37e1ac352aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:03.028663 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d34fbb-0467-4546-92b0-37e1ac352aaf None admin] PATH_INFO: `/v3/projects/265f4aa2137047adb6e3cdec9bd23b99` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:03.029799 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d34fbb-0467-4546-92b0-37e1ac352aaf None admin] RBAC: Authorizing `identity:get_project(project_id=265f4aa2137047adb6e3cdec9bd23b99)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:03.033272 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d34fbb-0467-4546-92b0-37e1ac352aaf None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:03.033272 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 87/168] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:05:02 2022] GET /identity/v3/projects/265f4aa2137047adb6e3cdec9bd23b99 => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:03.034522 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db489a-108d-4f64-8984-abec269f8c25 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:03.034803 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db489a-108d-4f64-8984-abec269f8c25 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:03.035104 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db489a-108d-4f64-8984-abec269f8c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:03.053596 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-05db489a-108d-4f64-8984-abec269f8c25 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:03.055073 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-05db489a-108d-4f64-8984-abec269f8c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:03.058631 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:03.126483 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 88/169] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:03.127281 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db489a-108d-4f64-8984-abec269f8c25 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:03.248984 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958dfd5-2aca-46e8-a4fd-dea8441874e5 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:03.252184 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db489a-108d-4f64-8984-abec269f8c25 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:03.287126 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22ae53-fa47-456c-9dbf-b05a797df10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:03.287760 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22ae53-fa47-456c-9dbf-b05a797df10d None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:03.288037 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22ae53-fa47-456c-9dbf-b05a797df10d None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:03.288309 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22ae53-fa47-456c-9dbf-b05a797df10d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:03.289125 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b22ae53-fa47-456c-9dbf-b05a797df10d None admin] RBAC: Adding query filter params (role.id=e513bb6d8f644c1d9156090e507a03d4, scope.project.id=265f4aa2137047adb6e3cdec9bd23b99, user.id=450125842ade4df78abacc89d27d87bc) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:03.289433 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b22ae53-fa47-456c-9dbf-b05a797df10d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:03.291681 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b22ae53-fa47-456c-9dbf-b05a797df10d None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:03.298304 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 89/170] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:05:03 2022] GET /identity/v3/role_assignments?user.id=450125842ade4df78abacc89d27d87bc&scope.project.id=265f4aa2137047adb6e3cdec9bd23b99&role.id=e513bb6d8f644c1d9156090e507a03d4 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:03.299198 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22ae53-fa47-456c-9dbf-b05a797df10d None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:03.302634 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:03.310481 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8ca84-2bea-43a9-beef-35f4ac8a7bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:03.311626 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8ca84-2bea-43a9-beef-35f4ac8a7bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:03.312081 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8ca84-2bea-43a9-beef-35f4ac8a7bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:03.312520 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8ca84-2bea-43a9-beef-35f4ac8a7bb7 None admin] PATH_INFO: `/v3/users/b1ada570ae344936898861ab4af182fb` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:03.317648 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8ca84-2bea-43a9-beef-35f4ac8a7bb7 None admin] RBAC: Authorizing `identity:get_user(user_id=b1ada570ae344936898861ab4af182fb)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:03.319395 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8ca84-2bea-43a9-beef-35f4ac8a7bb7 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:03.332342 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 82/171] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:05:02 2022] GET /identity/v3/users/b1ada570ae344936898861ab4af182fb => generated 247 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:03.332342 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8ca84-2bea-43a9-beef-35f4ac8a7bb7 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:03.413110 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22ae53-fa47-456c-9dbf-b05a797df10d None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:03.426475 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:03.470641 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8ca84-2bea-43a9-beef-35f4ac8a7bb7 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:03.528374 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2555b5-3d85-4a82-9ff2-92ddd3bc5948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:03.529337 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2555b5-3d85-4a82-9ff2-92ddd3bc5948 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:03.529829 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2555b5-3d85-4a82-9ff2-92ddd3bc5948 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:03.530291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2555b5-3d85-4a82-9ff2-92ddd3bc5948 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:03.536116 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13044674-6ce4-43c6-89c9-ef85376706c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:03.536787 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13044674-6ce4-43c6-89c9-ef85376706c0 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:03.537071 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13044674-6ce4-43c6-89c9-ef85376706c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:03.537347 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13044674-6ce4-43c6-89c9-ef85376706c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:03.564762 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13044674-6ce4-43c6-89c9-ef85376706c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:03.570659 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-13044674-6ce4-43c6-89c9-ef85376706c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:05:03.570659 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:03.570659 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:03.570659 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:03.570659 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:03.570659 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:03.570659 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:03.570659 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:03.570659 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:03.570659 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:03.570659 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:03.570659 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:03.570659 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:03.570659 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:03.570659 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:03.570659 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:03.572513 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:03.572513 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:03.572513 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:03.572513 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:03.572513 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:03.572513 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:03.572513 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:03.572513 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:03.572513 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:03.572513 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:03.572513 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:03.572513 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:03.572513 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:03.572513 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:03.572513 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:03.572513 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:03.573283 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:03.573283 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:03.573283 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:03.573283 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:03.573283 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:03.573283 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:03.573283 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:03.573283 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:03.573283 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:03.573283 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:03.573283 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:05:03.573283 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:03.575930 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 90/172] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:05:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:03.577506 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf278b82-f611-4130-952e-51010837fac5 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:03.577981 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf278b82-f611-4130-952e-51010837fac5 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:03.578441 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf278b82-f611-4130-952e-51010837fac5 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:03.584250 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 91/173] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:03.586511 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf278b82-f611-4130-952e-51010837fac5 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:03.674378 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2555b5-3d85-4a82-9ff2-92ddd3bc5948 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:03.675992 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2555b5-3d85-4a82-9ff2-92ddd3bc5948 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:03.698978 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:03.745963 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf278b82-f611-4130-952e-51010837fac5 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:03.748700 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:03.795098 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 83/174] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:05:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:05:03.797193 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2c07a-987a-48b0-a8b0-913649cad0bb None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:03.798122 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2c07a-987a-48b0-a8b0-913649cad0bb None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:03.798912 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2c07a-987a-48b0-a8b0-913649cad0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:03.802773 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec125ec-5ff8-4e86-841b-9421b92f7a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:03.803675 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec125ec-5ff8-4e86-841b-9421b92f7a78 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:03.804148 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec125ec-5ff8-4e86-841b-9421b92f7a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:03.804884 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec125ec-5ff8-4e86-841b-9421b92f7a78 None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:03.805759 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec125ec-5ff8-4e86-841b-9421b92f7a78 None admin] RBAC: Adding query filter params (name=member) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:03.806818 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec125ec-5ff8-4e86-841b-9421b92f7a78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:03.808450 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec125ec-5ff8-4e86-841b-9421b92f7a78 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:03.829557 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 92/175] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 02:05:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:03.830745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec125ec-5ff8-4e86-841b-9421b92f7a78 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:03.841899 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-cff2c07a-987a-48b0-a8b0-913649cad0bb None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:03.847990 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-cff2c07a-987a-48b0-a8b0-913649cad0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:03.969083 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 84/176] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:03.969966 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2c07a-987a-48b0-a8b0-913649cad0bb None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:04.044480 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec125ec-5ff8-4e86-841b-9421b92f7a78 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:04.086406 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:04.087312 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:04.094411 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2c07a-987a-48b0-a8b0-913649cad0bb None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:04.102106 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e580537-51b2-42ba-a11b-c891a86ef5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:04.105220 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e580537-51b2-42ba-a11b-c891a86ef5e0 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:04.105220 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e580537-51b2-42ba-a11b-c891a86ef5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:04.105220 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e580537-51b2-42ba-a11b-c891a86ef5e0 None admin] PATH_INFO: `/v3/projects/265f4aa2137047adb6e3cdec9bd23b99` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:04.106481 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e580537-51b2-42ba-a11b-c891a86ef5e0 None admin] RBAC: Authorizing `identity:get_project(project_id=265f4aa2137047adb6e3cdec9bd23b99)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:04.108881 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e580537-51b2-42ba-a11b-c891a86ef5e0 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:04.111394 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 93/177] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:05:03 2022] GET /identity/v3/projects/265f4aa2137047adb6e3cdec9bd23b99 => generated 298 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:04.112703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e580537-51b2-42ba-a11b-c891a86ef5e0 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:04.135254 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac243ae-28e3-4b63-8542-b8342f9573a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:04.136151 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac243ae-28e3-4b63-8542-b8342f9573a4 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:04.136572 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac243ae-28e3-4b63-8542-b8342f9573a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:04.137059 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac243ae-28e3-4b63-8542-b8342f9573a4 None admin] PATH_INFO: `/v3/users/450125842ade4df78abacc89d27d87bc` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:04.138350 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac243ae-28e3-4b63-8542-b8342f9573a4 None admin] RBAC: Authorizing `identity:get_user(user_id=450125842ade4df78abacc89d27d87bc)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:04.140055 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac243ae-28e3-4b63-8542-b8342f9573a4 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:04.141851 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 85/178] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:05:03 2022] GET /identity/v3/users/450125842ade4df78abacc89d27d87bc => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:04.142845 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c32e6-b3c2-444a-abcb-be5637962d26 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:04.143135 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c32e6-b3c2-444a-abcb-be5637962d26 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:04.143428 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c32e6-b3c2-444a-abcb-be5637962d26 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:04.144691 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 86/179] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:04.145669 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c32e6-b3c2-444a-abcb-be5637962d26 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:04.248949 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e580537-51b2-42ba-a11b-c891a86ef5e0 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:04.265129 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c32e6-b3c2-444a-abcb-be5637962d26 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:04.289722 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc02e11-1530-40af-951e-116d253baa62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:04.290391 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc02e11-1530-40af-951e-116d253baa62 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:04.290724 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc02e11-1530-40af-951e-116d253baa62 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:04.290998 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc02e11-1530-40af-951e-116d253baa62 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:04.300905 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ffe48-f288-41b3-b1cf-87aa7d1e16c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:04.301039 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc02e11-1530-40af-951e-116d253baa62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:04.301504 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ffe48-f288-41b3-b1cf-87aa7d1e16c6 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:04.301784 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ffe48-f288-41b3-b1cf-87aa7d1e16c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:04.302058 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ffe48-f288-41b3-b1cf-87aa7d1e16c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:04.302781 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ffe48-f288-41b3-b1cf-87aa7d1e16c6 None admin] RBAC: Adding query filter params (role.id=84da65a75e544d1191ec53cb6b05aa73, scope.project.id=265f4aa2137047adb6e3cdec9bd23b99, user.id=b1ada570ae344936898861ab4af182fb) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:04.303088 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ffe48-f288-41b3-b1cf-87aa7d1e16c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:04.304813 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ffe48-f288-41b3-b1cf-87aa7d1e16c6 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:04.306785 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-ebc02e11-1530-40af-951e-116d253baa62 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:05:04.306785 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:04.306785 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:04.306785 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:04.306785 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:04.306785 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:04.306785 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:04.306785 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:04.306785 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:04.306785 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:04.306785 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:04.306785 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:04.306785 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:04.306785 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:04.306785 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:04.306785 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:04.307670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:04.307670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:04.307670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:04.307670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:04.307670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:04.307670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:04.307670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:04.307670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:04.307670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:04.307670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:04.307670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:04.307670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:04.307670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:04.307670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:04.307670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:04.307670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:04.308432 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:04.308432 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:04.308432 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:04.308432 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:04.308432 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:04.308432 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:04.308432 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:04.308432 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:04.308432 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:04.308432 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:04.308432 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:05:04.308432 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:04.308432 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 94/180] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 02:05:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:04.309814 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc02e11-1530-40af-951e-116d253baa62 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:04.319390 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 87/181] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:05:04 2022] GET /identity/v3/role_assignments?user.id=b1ada570ae344936898861ab4af182fb&scope.project.id=265f4aa2137047adb6e3cdec9bd23b99&role.id=84da65a75e544d1191ec53cb6b05aa73 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:04.319539 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804dc65b-226d-49b7-8995-dea9f9736145 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:04.319960 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804dc65b-226d-49b7-8995-dea9f9736145 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:04.320411 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804dc65b-226d-49b7-8995-dea9f9736145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:04.345959 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-804dc65b-226d-49b7-8995-dea9f9736145 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:04.347124 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-804dc65b-226d-49b7-8995-dea9f9736145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:04.367966 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:04.384813 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:04.432063 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc02e11-1530-40af-951e-116d253baa62 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:04.452026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 88/182] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:04.458612 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3779784-e83f-4ae5-a45a-235afbc9430d None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:04.458919 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3779784-e83f-4ae5-a45a-235afbc9430d None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:04.459173 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3779784-e83f-4ae5-a45a-235afbc9430d None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:04.460842 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 89/183] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:04.461576 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3779784-e83f-4ae5-a45a-235afbc9430d None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:04.484342 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2b824-ba4c-4d18-832e-3e906ceedb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:04.484961 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2b824-ba4c-4d18-832e-3e906ceedb9f None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:04.485245 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2b824-ba4c-4d18-832e-3e906ceedb9f None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:04.485517 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2b824-ba4c-4d18-832e-3e906ceedb9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:04.577338 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a2b824-ba4c-4d18-832e-3e906ceedb9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:04.578819 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a2b824-ba4c-4d18-832e-3e906ceedb9f None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:04.593340 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3779784-e83f-4ae5-a45a-235afbc9430d None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:04.630738 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439d8c6-da6d-4e4b-ac0d-137ced2bd889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:04.631444 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439d8c6-da6d-4e4b-ac0d-137ced2bd889 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:04.631796 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439d8c6-da6d-4e4b-ac0d-137ced2bd889 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:04.632144 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439d8c6-da6d-4e4b-ac0d-137ced2bd889 None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:04.632886 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3439d8c6-da6d-4e4b-ac0d-137ced2bd889 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:04.633261 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3439d8c6-da6d-4e4b-ac0d-137ced2bd889 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:04.635379 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3439d8c6-da6d-4e4b-ac0d-137ced2bd889 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:04.636890 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:04.643880 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 90/184] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:05:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:04.643880 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78ca37-3f9d-4339-b431-efce52ef1270 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:04.643880 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78ca37-3f9d-4339-b431-efce52ef1270 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:04.643880 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78ca37-3f9d-4339-b431-efce52ef1270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:04.662782 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-bb78ca37-3f9d-4339-b431-efce52ef1270 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:04.663971 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-bb78ca37-3f9d-4339-b431-efce52ef1270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:04.678549 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:04.688502 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 95/185] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:05:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:05:04.689699 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2b824-ba4c-4d18-832e-3e906ceedb9f None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:04.744625 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 91/186] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:04.745248 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78ca37-3f9d-4339-b431-efce52ef1270 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:04.800516 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2b824-ba4c-4d18-832e-3e906ceedb9f None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:04.837746 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037cc8f-c5a8-4720-9573-82c2cec3ddcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:04.838645 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037cc8f-c5a8-4720-9573-82c2cec3ddcb None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:04.839110 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037cc8f-c5a8-4720-9573-82c2cec3ddcb None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:04.839577 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037cc8f-c5a8-4720-9573-82c2cec3ddcb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:04.840855 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037cc8f-c5a8-4720-9573-82c2cec3ddcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:04.842444 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037cc8f-c5a8-4720-9573-82c2cec3ddcb None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:04.844189 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 96/187] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:05:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:04.845149 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037cc8f-c5a8-4720-9573-82c2cec3ddcb None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:04.869404 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78ca37-3f9d-4339-b431-efce52ef1270 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:04.874854 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:04.912741 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67b5f4-89cb-44d0-9a25-b76bf26e175c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:04.913378 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67b5f4-89cb-44d0-9a25-b76bf26e175c None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:04.913653 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67b5f4-89cb-44d0-9a25-b76bf26e175c None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:04.913940 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67b5f4-89cb-44d0-9a25-b76bf26e175c None admin] PATH_INFO: `/v3/users/3eb8526fc5db4540853adc94fa98d20d` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:04.929037 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67b5f4-89cb-44d0-9a25-b76bf26e175c None admin] RBAC: Authorizing `identity:get_user(user_id=3eb8526fc5db4540853adc94fa98d20d)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:04.931043 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67b5f4-89cb-44d0-9a25-b76bf26e175c None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:04.933290 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 92/188] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:05:04 2022] GET /identity/v3/users/3eb8526fc5db4540853adc94fa98d20d => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:04.934311 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67b5f4-89cb-44d0-9a25-b76bf26e175c None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:04.945840 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:04.960897 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037cc8f-c5a8-4720-9573-82c2cec3ddcb None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:04.997896 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef76e2c-35eb-439e-a53a-1a1b3cfbe71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:04.998521 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef76e2c-35eb-439e-a53a-1a1b3cfbe71f None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:04.998797 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef76e2c-35eb-439e-a53a-1a1b3cfbe71f None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:04.999065 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef76e2c-35eb-439e-a53a-1a1b3cfbe71f None admin] PATH_INFO: `/v3/projects/d798db4de8b94bb0ac4a1bf73772e208` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:05.000205 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef76e2c-35eb-439e-a53a-1a1b3cfbe71f None admin] RBAC: Authorizing `identity:get_project(project_id=d798db4de8b94bb0ac4a1bf73772e208)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:05.001643 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef76e2c-35eb-439e-a53a-1a1b3cfbe71f None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:05.003485 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 97/189] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:05:04 2022] GET /identity/v3/projects/d798db4de8b94bb0ac4a1bf73772e208 => generated 312 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:05.009095 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef76e2c-35eb-439e-a53a-1a1b3cfbe71f None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:05.041561 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67b5f4-89cb-44d0-9a25-b76bf26e175c None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:05.099441 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5ae8c-0542-4a75-9d4b-dc19a2d51b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:05.100192 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5ae8c-0542-4a75-9d4b-dc19a2d51b21 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:05.100478 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5ae8c-0542-4a75-9d4b-dc19a2d51b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:05.100757 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5ae8c-0542-4a75-9d4b-dc19a2d51b21 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:05.120508 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5ae8c-0542-4a75-9d4b-dc19a2d51b21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:05.121655 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:05.122126 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-48f5ae8c-0542-4a75-9d4b-dc19a2d51b21 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:05:05.122126 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:05.122126 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:05.122126 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:05.122126 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:05.122126 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:05.122126 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:05.122126 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:05.122126 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:05.122126 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:05.122126 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:05.122126 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:05.122126 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:05.122126 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:05.122126 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:05.122126 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:05.122962 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:05.122962 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:05.122962 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:05.122962 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:05.122962 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:05.122962 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:05.122962 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:05.122962 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:05.122962 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:05.122962 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:05.122962 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:05.122962 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:05.122962 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:05.122962 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:05.122962 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:05.122962 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:05.123788 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:05.123788 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:05.123788 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:05.123788 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:05.123788 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:05.123788 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:05.123788 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:05.123788 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:05.123788 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:05.123788 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:05.123788 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:05:05.123788 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:05.130766 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 93/190] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 02:05:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:05.130766 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5ae8c-0542-4a75-9d4b-dc19a2d51b21 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:05.132483 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef76e2c-35eb-439e-a53a-1a1b3cfbe71f None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:05.167336 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433dea66-6df6-4db6-9575-0d0ef91f5a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:05.167892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433dea66-6df6-4db6-9575-0d0ef91f5a02 None admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:05.168182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433dea66-6df6-4db6-9575-0d0ef91f5a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:05.168461 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433dea66-6df6-4db6-9575-0d0ef91f5a02 None admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:05.169104 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433dea66-6df6-4db6-9575-0d0ef91f5a02 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:05.170538 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433dea66-6df6-4db6-9575-0d0ef91f5a02 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:05.197325 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:05.228949 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5ae8c-0542-4a75-9d4b-dc19a2d51b21 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:05.260377 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de937de5-e3dd-4e29-9ccf-afad68789053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:05.260562 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 98/191] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 8 02:05:05 2022] POST /identity/v3/users => generated 297 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:05:05.261356 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433dea66-6df6-4db6-9575-0d0ef91f5a02 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:05.267711 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de937de5-e3dd-4e29-9ccf-afad68789053 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:05.268776 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de937de5-e3dd-4e29-9ccf-afad68789053 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:05.269644 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de937de5-e3dd-4e29-9ccf-afad68789053 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:05.351512 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de937de5-e3dd-4e29-9ccf-afad68789053 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:05.353042 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de937de5-e3dd-4e29-9ccf-afad68789053 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:05.368753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433dea66-6df6-4db6-9575-0d0ef91f5a02 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:05.420497 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ea3c0-7b9f-4865-95cc-b6142f97c145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:05.421466 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ea3c0-7b9f-4865-95cc-b6142f97c145 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:05.422516 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ea3c0-7b9f-4865-95cc-b6142f97c145 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:05.422516 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ea3c0-7b9f-4865-95cc-b6142f97c145 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:05.423176 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ea3c0-7b9f-4865-95cc-b6142f97c145 None admin] RBAC: Adding query filter params (role.id=5691bce246d6452990f13933e19f2825, scope.project.id=d798db4de8b94bb0ac4a1bf73772e208, user.id=450125842ade4df78abacc89d27d87bc) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:05.424148 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ea3c0-7b9f-4865-95cc-b6142f97c145 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:05.425122 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ea3c0-7b9f-4865-95cc-b6142f97c145 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:05.434314 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 99/192] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:05:05 2022] GET /identity/v3/role_assignments?user.id=450125842ade4df78abacc89d27d87bc&scope.project.id=d798db4de8b94bb0ac4a1bf73772e208&role.id=5691bce246d6452990f13933e19f2825 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:05.435173 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ea3c0-7b9f-4865-95cc-b6142f97c145 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:05.442673 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:05.450197 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:05.491421 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 94/193] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:05:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:05:05.491421 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba985e-33ce-4d1e-974e-71bdd05ccc9f None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:05.491421 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba985e-33ce-4d1e-974e-71bdd05ccc9f None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:05.491421 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba985e-33ce-4d1e-974e-71bdd05ccc9f None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:05.493900 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 95/194] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:05.495791 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba985e-33ce-4d1e-974e-71bdd05ccc9f None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:05.584116 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ea3c0-7b9f-4865-95cc-b6142f97c145 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:05.629903 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553614e-9f65-490e-8d4b-3fcb9b33c8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:05.630849 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553614e-9f65-490e-8d4b-3fcb9b33c8ac None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:05.631535 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553614e-9f65-490e-8d4b-3fcb9b33c8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:05.631975 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553614e-9f65-490e-8d4b-3fcb9b33c8ac None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:05.633461 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553614e-9f65-490e-8d4b-3fcb9b33c8ac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:05.634436 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553614e-9f65-490e-8d4b-3fcb9b33c8ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:05.636679 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553614e-9f65-490e-8d4b-3fcb9b33c8ac None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:05.641008 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba985e-33ce-4d1e-974e-71bdd05ccc9f None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:05.648279 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 100/195] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:05:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:05.649954 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836197be-9e99-4672-872d-9f50638903f7 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:05.649954 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836197be-9e99-4672-872d-9f50638903f7 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:05.650245 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836197be-9e99-4672-872d-9f50638903f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:05.669746 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-836197be-9e99-4672-872d-9f50638903f7 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:05.671153 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-836197be-9e99-4672-872d-9f50638903f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:05.683671 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f7adc-8fac-48b2-ab07-c31e50d53f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:05.684302 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f7adc-8fac-48b2-ab07-c31e50d53f8e None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:05.684579 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f7adc-8fac-48b2-ab07-c31e50d53f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:05.684853 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f7adc-8fac-48b2-ab07-c31e50d53f8e None admin] PATH_INFO: `/v3/projects/f15701875ea24854a2a23f51fa4c6364` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:05.686817 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f7adc-8fac-48b2-ab07-c31e50d53f8e None admin] RBAC: Authorizing `identity:get_project(project_id=f15701875ea24854a2a23f51fa4c6364)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:05.688291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f7adc-8fac-48b2-ab07-c31e50d53f8e None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:05.690082 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 96/196] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:05:05 2022] GET /identity/v3/projects/f15701875ea24854a2a23f51fa4c6364 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:05.690674 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f7adc-8fac-48b2-ab07-c31e50d53f8e None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:05.735659 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:05.783394 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 101/197] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:05.783394 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836197be-9e99-4672-872d-9f50638903f7 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:05.783691 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:05.836610 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f7adc-8fac-48b2-ab07-c31e50d53f8e None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:05.874006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1d214-14eb-4616-89bb-1838779f020e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:05.874869 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1d214-14eb-4616-89bb-1838779f020e None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:05.875311 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1d214-14eb-4616-89bb-1838779f020e None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:05.875748 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1d214-14eb-4616-89bb-1838779f020e None admin] PATH_INFO: `/v3/users/3eb8526fc5db4540853adc94fa98d20d` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:05.877531 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1d214-14eb-4616-89bb-1838779f020e None admin] RBAC: Authorizing `identity:get_user(user_id=3eb8526fc5db4540853adc94fa98d20d)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:05.879624 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1d214-14eb-4616-89bb-1838779f020e None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:05.882069 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 97/198] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:05:05 2022] GET /identity/v3/users/3eb8526fc5db4540853adc94fa98d20d => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:05.882981 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1d214-14eb-4616-89bb-1838779f020e None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:05.908313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836197be-9e99-4672-872d-9f50638903f7 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:05.945621 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e282db-247e-43db-8fbc-2589b6781396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:05.946504 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e282db-247e-43db-8fbc-2589b6781396 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:05.946922 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e282db-247e-43db-8fbc-2589b6781396 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:05.947348 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e282db-247e-43db-8fbc-2589b6781396 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:05.948295 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e282db-247e-43db-8fbc-2589b6781396 None admin] RBAC: Adding query filter params (role.id=84da65a75e544d1191ec53cb6b05aa73, scope.project.id=f15701875ea24854a2a23f51fa4c6364, user.id=3eb8526fc5db4540853adc94fa98d20d) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:05.948844 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e282db-247e-43db-8fbc-2589b6781396 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:05.950416 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e282db-247e-43db-8fbc-2589b6781396 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:05.957368 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 102/199] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:05:05 2022] GET /identity/v3/role_assignments?user.id=3eb8526fc5db4540853adc94fa98d20d&scope.project.id=f15701875ea24854a2a23f51fa4c6364&role.id=84da65a75e544d1191ec53cb6b05aa73 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:05.958429 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e282db-247e-43db-8fbc-2589b6781396 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:05.995738 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1d214-14eb-4616-89bb-1838779f020e None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:05.998731 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:06.032136 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:06.033298 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527edd8d-c6bb-45df-be1b-2b5e2fa0f41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:06.033932 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527edd8d-c6bb-45df-be1b-2b5e2fa0f41e None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:06.034208 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527edd8d-c6bb-45df-be1b-2b5e2fa0f41e None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:06.034543 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527edd8d-c6bb-45df-be1b-2b5e2fa0f41e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:06.049396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527edd8d-c6bb-45df-be1b-2b5e2fa0f41e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:06.055815 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-527edd8d-c6bb-45df-be1b-2b5e2fa0f41e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:05:06.055815 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:06.055815 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:06.055815 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:06.055815 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:06.055815 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:06.055815 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:06.055815 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:06.055815 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:06.055815 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:06.055815 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:06.055815 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:06.055815 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:06.055815 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:06.055815 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:06.055815 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:06.056766 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:06.056766 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:06.056766 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:06.056766 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:06.056766 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:06.056766 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:06.056766 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:06.056766 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:06.056766 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:06.056766 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:06.056766 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:06.056766 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:06.056766 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:06.056766 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:06.056766 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:06.056766 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:06.057539 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:06.057539 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:06.057539 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:06.057539 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:06.057539 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:06.057539 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:06.057539 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:06.057539 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:06.057539 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:06.057539 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:06.057539 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:05:06.057539 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:06.057539 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 98/200] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:05:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:06.069683 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527edd8d-c6bb-45df-be1b-2b5e2fa0f41e None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:06.092192 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e282db-247e-43db-8fbc-2589b6781396 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:06.163808 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8c741-5136-43c7-8c78-30859bd9885f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:06.164758 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8c741-5136-43c7-8c78-30859bd9885f None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:06.165743 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8c741-5136-43c7-8c78-30859bd9885f None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:06.166154 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8c741-5136-43c7-8c78-30859bd9885f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:06.261168 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527edd8d-c6bb-45df-be1b-2b5e2fa0f41e None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:06.271058 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8c741-5136-43c7-8c78-30859bd9885f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:06.272920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8c741-5136-43c7-8c78-30859bd9885f None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:06.337415 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179dde12-4d2c-4375-a7fc-af30b88ec6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:06.338118 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dde12-4d2c-4375-a7fc-af30b88ec6df None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:06.338337 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dde12-4d2c-4375-a7fc-af30b88ec6df None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:06.338612 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dde12-4d2c-4375-a7fc-af30b88ec6df None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:06.339279 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179dde12-4d2c-4375-a7fc-af30b88ec6df None admin] RBAC: Adding query filter params (name=reader) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:06.339608 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179dde12-4d2c-4375-a7fc-af30b88ec6df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:06.340981 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179dde12-4d2c-4375-a7fc-af30b88ec6df None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:06.349142 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:06.358760 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 99/201] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 02:05:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:06.367960 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179dde12-4d2c-4375-a7fc-af30b88ec6df None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:06.405428 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 103/202] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:05:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:05:06.411773 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8c741-5136-43c7-8c78-30859bd9885f None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:06.436425 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:06.528547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8c741-5136-43c7-8c78-30859bd9885f None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:06.573119 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60cc9ec-47a1-465a-9c65-a2d460f72894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:06.573758 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60cc9ec-47a1-465a-9c65-a2d460f72894 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:06.574044 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60cc9ec-47a1-465a-9c65-a2d460f72894 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:06.574321 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60cc9ec-47a1-465a-9c65-a2d460f72894 None admin] PATH_INFO: `/v3/projects/f15701875ea24854a2a23f51fa4c6364` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:06.578392 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60cc9ec-47a1-465a-9c65-a2d460f72894 None admin] RBAC: Authorizing `identity:get_project(project_id=f15701875ea24854a2a23f51fa4c6364)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:06.579895 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60cc9ec-47a1-465a-9c65-a2d460f72894 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:06.582559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 104/203] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:05:06 2022] GET /identity/v3/projects/f15701875ea24854a2a23f51fa4c6364 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:06.588041 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60cc9ec-47a1-465a-9c65-a2d460f72894 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:06.592321 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179dde12-4d2c-4375-a7fc-af30b88ec6df None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:06.627538 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1773e-b178-4220-a027-c4a8d6fb6f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:06.628174 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1773e-b178-4220-a027-c4a8d6fb6f20 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:06.628509 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1773e-b178-4220-a027-c4a8d6fb6f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:06.628899 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1773e-b178-4220-a027-c4a8d6fb6f20 None admin] PATH_INFO: `/v3/users/413af01b0c3549f1874931214ef89120` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:06.630806 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1773e-b178-4220-a027-c4a8d6fb6f20 None admin] RBAC: Authorizing `identity:get_user(user_id=413af01b0c3549f1874931214ef89120)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:06.632316 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1773e-b178-4220-a027-c4a8d6fb6f20 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:06.637809 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 100/204] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:05:06 2022] GET /identity/v3/users/413af01b0c3549f1874931214ef89120 => generated 289 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:06.644621 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1773e-b178-4220-a027-c4a8d6fb6f20 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:06.658564 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:06.746703 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:06.754869 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1773e-b178-4220-a027-c4a8d6fb6f20 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:06.771638 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60cc9ec-47a1-465a-9c65-a2d460f72894 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:06.807928 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8564eb-1950-42a4-b2ac-a14e21bf295e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:06.809623 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8564eb-1950-42a4-b2ac-a14e21bf295e None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:06.809623 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8564eb-1950-42a4-b2ac-a14e21bf295e None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:06.809623 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8564eb-1950-42a4-b2ac-a14e21bf295e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:06.819043 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967b5b8-e64a-4684-aed4-0ca287c579bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:06.819043 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967b5b8-e64a-4684-aed4-0ca287c579bb None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:06.819043 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967b5b8-e64a-4684-aed4-0ca287c579bb None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:06.819043 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967b5b8-e64a-4684-aed4-0ca287c579bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:06.819481 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967b5b8-e64a-4684-aed4-0ca287c579bb None admin] RBAC: Adding query filter params (role.id=e513bb6d8f644c1d9156090e507a03d4, scope.project.id=f15701875ea24854a2a23f51fa4c6364, user.id=3eb8526fc5db4540853adc94fa98d20d) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:06.819481 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967b5b8-e64a-4684-aed4-0ca287c579bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:06.819481 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967b5b8-e64a-4684-aed4-0ca287c579bb None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:06.830602 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 105/205] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:05:06 2022] GET /identity/v3/role_assignments?user.id=3eb8526fc5db4540853adc94fa98d20d&scope.project.id=f15701875ea24854a2a23f51fa4c6364&role.id=e513bb6d8f644c1d9156090e507a03d4 => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:05:07.053432 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8564eb-1950-42a4-b2ac-a14e21bf295e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:07.055227 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8564eb-1950-42a4-b2ac-a14e21bf295e None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:07.227786 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:07.232636 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 101/206] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:05:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:05:07.238822 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967b5b8-e64a-4684-aed4-0ca287c579bb None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:07.423963 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:07.428140 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967b5b8-e64a-4684-aed4-0ca287c579bb None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:07.480168 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9e7a0-a00e-49c4-b7c4-ef02d7b0213a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:07.480729 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9e7a0-a00e-49c4-b7c4-ef02d7b0213a None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:07.481012 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9e7a0-a00e-49c4-b7c4-ef02d7b0213a None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:07.481285 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9e7a0-a00e-49c4-b7c4-ef02d7b0213a None admin] PATH_INFO: `/v3/projects/265f4aa2137047adb6e3cdec9bd23b99` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:07.482468 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9e7a0-a00e-49c4-b7c4-ef02d7b0213a None admin] RBAC: Authorizing `identity:get_project(project_id=265f4aa2137047adb6e3cdec9bd23b99)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:07.483959 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9e7a0-a00e-49c4-b7c4-ef02d7b0213a None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:07.485901 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 106/207] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:05:07 2022] GET /identity/v3/projects/265f4aa2137047adb6e3cdec9bd23b99 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:07.491778 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8564eb-1950-42a4-b2ac-a14e21bf295e None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:07.651460 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8564eb-1950-42a4-b2ac-a14e21bf295e None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:07.700068 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc66e2c-8fc3-4c88-ad76-647432f4f949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:07.701059 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc66e2c-8fc3-4c88-ad76-647432f4f949 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:07.701556 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc66e2c-8fc3-4c88-ad76-647432f4f949 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:07.702018 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc66e2c-8fc3-4c88-ad76-647432f4f949 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:07.702946 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc66e2c-8fc3-4c88-ad76-647432f4f949 None admin] RBAC: Adding query filter params (role.id=961f87b1da8444afb55ea38aa7005933, scope.project.id=265f4aa2137047adb6e3cdec9bd23b99, user.id=413af01b0c3549f1874931214ef89120) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:07.703468 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc66e2c-8fc3-4c88-ad76-647432f4f949 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:07.705080 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc66e2c-8fc3-4c88-ad76-647432f4f949 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:07.711491 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 102/208] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:05:07 2022] GET /identity/v3/role_assignments?user.id=413af01b0c3549f1874931214ef89120&scope.project.id=265f4aa2137047adb6e3cdec9bd23b99&role.id=961f87b1da8444afb55ea38aa7005933 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:07.713727 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891b619-055f-4357-afd9-1a49d32068a4 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:07.714013 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891b619-055f-4357-afd9-1a49d32068a4 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:07.714286 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891b619-055f-4357-afd9-1a49d32068a4 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:07.715882 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 107/209] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:07.733273 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde68db-a760-439a-9b51-0f75b7d86e1c None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:07.733453 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde68db-a760-439a-9b51-0f75b7d86e1c None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:07.733735 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde68db-a760-439a-9b51-0f75b7d86e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:07.757474 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-5bde68db-a760-439a-9b51-0f75b7d86e1c None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:07.758688 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-5bde68db-a760-439a-9b51-0f75b7d86e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:07.837712 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:07.860969 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 103/210] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:07.892832 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0891b619-055f-4357-afd9-1a49d32068a4 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:08.006310 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0891b619-055f-4357-afd9-1a49d32068a4 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:08.043127 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004857bc-b29a-4028-926a-2f53d56207b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:08.043802 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004857bc-b29a-4028-926a-2f53d56207b5 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:08.044077 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004857bc-b29a-4028-926a-2f53d56207b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:08.044349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004857bc-b29a-4028-926a-2f53d56207b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:08.055012 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004857bc-b29a-4028-926a-2f53d56207b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:08.059827 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-004857bc-b29a-4028-926a-2f53d56207b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:05:08.059827 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:08.059827 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:08.059827 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:08.059827 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:08.059827 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:08.059827 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:08.059827 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:08.059827 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:08.059827 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:08.059827 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:08.059827 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:08.059827 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:08.059827 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:08.059827 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:08.059827 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:08.060703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:08.060703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:08.060703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:08.060703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:08.060703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:08.060703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:08.060703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:08.060703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:08.060703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:08.060703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:08.060703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:08.060703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:08.060703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:08.060703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:08.060703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:08.060703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:08.061476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:08.061476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:08.061476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:08.061476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:08.061476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:08.061476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:08.061476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:08.061476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:08.061476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:08.061476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:08.061476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:05:08.061476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:08.061476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 108/211] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:05:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:08.067954 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde68db-a760-439a-9b51-0f75b7d86e1c None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:08.178778 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e15f8-df55-41fe-8230-f8f44cc1bd4c None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:08.179094 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e15f8-df55-41fe-8230-f8f44cc1bd4c None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:08.179325 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e15f8-df55-41fe-8230-f8f44cc1bd4c None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:08.181475 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 109/212] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:08.181891 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde68db-a760-439a-9b51-0f75b7d86e1c None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:08.188397 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51198e87-a2eb-49c5-80bd-98356842138d None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:08.188681 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51198e87-a2eb-49c5-80bd-98356842138d None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:08.188960 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51198e87-a2eb-49c5-80bd-98356842138d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:08.210189 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-51198e87-a2eb-49c5-80bd-98356842138d None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:08.215596 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-51198e87-a2eb-49c5-80bd-98356842138d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:08.220513 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d40486-ce77-4d89-94e5-3f9be1d3991e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:08.221128 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d40486-ce77-4d89-94e5-3f9be1d3991e None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:08.221412 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d40486-ce77-4d89-94e5-3f9be1d3991e None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:08.221688 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d40486-ce77-4d89-94e5-3f9be1d3991e None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:08.222361 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d40486-ce77-4d89-94e5-3f9be1d3991e None admin] RBAC: Adding query filter params (name=member) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:08.222662 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d40486-ce77-4d89-94e5-3f9be1d3991e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:08.224057 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d40486-ce77-4d89-94e5-3f9be1d3991e None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:08.234897 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 104/213] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 02:05:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:08.239245 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:08.240657 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d40486-ce77-4d89-94e5-3f9be1d3991e None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:08.308189 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 110/214] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:08.309292 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:08.338832 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51198e87-a2eb-49c5-80bd-98356842138d None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:08.368937 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d40486-ce77-4d89-94e5-3f9be1d3991e None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:08.416617 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722b717-7778-4b78-8119-fcbeabccbb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:08.417487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722b717-7778-4b78-8119-fcbeabccbb30 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:08.417905 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722b717-7778-4b78-8119-fcbeabccbb30 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:08.418370 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722b717-7778-4b78-8119-fcbeabccbb30 None admin] PATH_INFO: `/v3/users/0bc89d2bceb84e51b33403231a84e264` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:08.432693 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722b717-7778-4b78-8119-fcbeabccbb30 None admin] RBAC: Authorizing `identity:get_user(user_id=0bc89d2bceb84e51b33403231a84e264)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:08.434347 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722b717-7778-4b78-8119-fcbeabccbb30 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:08.436178 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 105/215] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:05:08 2022] GET /identity/v3/users/0bc89d2bceb84e51b33403231a84e264 => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:08.441899 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722b717-7778-4b78-8119-fcbeabccbb30 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:08.460498 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51198e87-a2eb-49c5-80bd-98356842138d None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:08.506636 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7aaca-0d67-4eea-8f1c-668fa8120007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:08.507880 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7aaca-0d67-4eea-8f1c-668fa8120007 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:08.508369 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7aaca-0d67-4eea-8f1c-668fa8120007 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:08.509616 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7aaca-0d67-4eea-8f1c-668fa8120007 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:08.511564 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7aaca-0d67-4eea-8f1c-668fa8120007 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:08.513565 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7aaca-0d67-4eea-8f1c-668fa8120007 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:08.515663 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 111/216] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:05:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:05:08.522305 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7aaca-0d67-4eea-8f1c-668fa8120007 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:08.556283 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:08.573883 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722b717-7778-4b78-8119-fcbeabccbb30 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:08.584649 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:08.612398 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa210db-2b43-48b4-a2b8-2877bd1aa9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:08.613219 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa210db-2b43-48b4-a2b8-2877bd1aa9c7 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:08.613838 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa210db-2b43-48b4-a2b8-2877bd1aa9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:08.614547 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa210db-2b43-48b4-a2b8-2877bd1aa9c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:08.648970 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7aaca-0d67-4eea-8f1c-668fa8120007 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:08.683025 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5affc00-be8b-4e3b-b0d3-a69830a665c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:08.683660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5affc00-be8b-4e3b-b0d3-a69830a665c4 None admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:08.683938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5affc00-be8b-4e3b-b0d3-a69830a665c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:08.684216 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5affc00-be8b-4e3b-b0d3-a69830a665c4 None admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:08.684856 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5affc00-be8b-4e3b-b0d3-a69830a665c4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:08.686286 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5affc00-be8b-4e3b-b0d3-a69830a665c4 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:08.686504 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa210db-2b43-48b4-a2b8-2877bd1aa9c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:08.687980 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa210db-2b43-48b4-a2b8-2877bd1aa9c7 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:08.786385 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 106/217] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:05:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 08 02:05:08.787722 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd73bc-b331-43b0-a8c0-6e1c3a13e437 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:08.788017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd73bc-b331-43b0-a8c0-6e1c3a13e437 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:08.788301 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd73bc-b331-43b0-a8c0-6e1c3a13e437 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:08.789552 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 107/218] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:08.794495 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd73bc-b331-43b0-a8c0-6e1c3a13e437 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:08.796909 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 112/219] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 8 02:05:08 2022] POST /identity/v3/users => generated 297 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:05:08.798615 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433037d-4327-4128-b722-6e07d3378d34 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:08.799104 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433037d-4327-4128-b722-6e07d3378d34 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:08.799601 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433037d-4327-4128-b722-6e07d3378d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:08.817817 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:08.823138 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-a433037d-4327-4128-b722-6e07d3378d34 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:08.830495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-a433037d-4327-4128-b722-6e07d3378d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:08.926063 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 113/220] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:08.948941 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a433037d-4327-4128-b722-6e07d3378d34 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:08.951932 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd73bc-b331-43b0-a8c0-6e1c3a13e437 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:08.961233 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:08.996963 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5674d9-b8dd-4d3f-b405-2ec2738513f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:08.997598 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5674d9-b8dd-4d3f-b405-2ec2738513f3 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:08.997878 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5674d9-b8dd-4d3f-b405-2ec2738513f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:08.998145 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5674d9-b8dd-4d3f-b405-2ec2738513f3 None admin] PATH_INFO: `/v3/projects/f15701875ea24854a2a23f51fa4c6364` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:08.999310 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5674d9-b8dd-4d3f-b405-2ec2738513f3 None admin] RBAC: Authorizing `identity:get_project(project_id=f15701875ea24854a2a23f51fa4c6364)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:09.000794 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5674d9-b8dd-4d3f-b405-2ec2738513f3 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:09.002728 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 108/221] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:05:08 2022] GET /identity/v3/projects/f15701875ea24854a2a23f51fa4c6364 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:09.008505 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5674d9-b8dd-4d3f-b405-2ec2738513f3 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:09.067744 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a433037d-4327-4128-b722-6e07d3378d34 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:09.106663 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc04ad5-fd43-4a8d-9f6f-8cb155db6a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:09.107546 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc04ad5-fd43-4a8d-9f6f-8cb155db6a17 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:09.107982 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc04ad5-fd43-4a8d-9f6f-8cb155db6a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:09.108425 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc04ad5-fd43-4a8d-9f6f-8cb155db6a17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:09.110334 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:09.120956 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc04ad5-fd43-4a8d-9f6f-8cb155db6a17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:09.126682 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-5bc04ad5-fd43-4a8d-9f6f-8cb155db6a17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:05:09.126682 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:09.126682 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:09.126682 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:09.126682 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:09.126682 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:09.126682 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:09.126682 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:09.126682 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:09.126682 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:09.126682 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:09.126682 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:09.126682 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:09.126682 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:09.126682 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:09.126682 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:09.127786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:09.127786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:09.127786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:09.127786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:09.127786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:09.127786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:09.127786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:09.127786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:09.127786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:09.127786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:09.127786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:09.127786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:09.127786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:09.127786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:09.127786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:09.127786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:09.128843 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:09.128843 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:09.128843 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:09.128843 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:09.128843 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:09.128843 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:09.128843 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:09.128843 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:09.128843 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:09.128843 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:09.128843 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:05:09.128843 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:09.131151 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 114/222] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 02:05:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:05:09.139931 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc04ad5-fd43-4a8d-9f6f-8cb155db6a17 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:09.147696 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5674d9-b8dd-4d3f-b405-2ec2738513f3 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:09.194742 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274d74c-2891-4422-aee5-f049acb5e1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:09.195897 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274d74c-2891-4422-aee5-f049acb5e1dc None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:09.196184 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274d74c-2891-4422-aee5-f049acb5e1dc None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:09.197004 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274d74c-2891-4422-aee5-f049acb5e1dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:09.198029 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274d74c-2891-4422-aee5-f049acb5e1dc None admin] RBAC: Adding query filter params (role.id=5691bce246d6452990f13933e19f2825, scope.project.id=f15701875ea24854a2a23f51fa4c6364, user.id=0bc89d2bceb84e51b33403231a84e264) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:09.198345 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274d74c-2891-4422-aee5-f049acb5e1dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:09.201461 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274d74c-2891-4422-aee5-f049acb5e1dc None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:09.207587 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 109/223] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:05:09 2022] GET /identity/v3/role_assignments?user.id=0bc89d2bceb84e51b33403231a84e264&scope.project.id=f15701875ea24854a2a23f51fa4c6364&role.id=5691bce246d6452990f13933e19f2825 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:05:09.228798 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:09.264000 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc04ad5-fd43-4a8d-9f6f-8cb155db6a17 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:09.267617 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea49bf-2c3e-4947-9c35-4545905de12b None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:09.267903 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea49bf-2c3e-4947-9c35-4545905de12b None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:09.268179 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea49bf-2c3e-4947-9c35-4545905de12b None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:09.270955 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 110/224] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:05:09.275596 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625c170-7a92-4280-bbd6-cd9596533093 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:09.275883 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625c170-7a92-4280-bbd6-cd9596533093 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:09.276289 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625c170-7a92-4280-bbd6-cd9596533093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:09.296777 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-1625c170-7a92-4280-bbd6-cd9596533093 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:09.297998 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-1625c170-7a92-4280-bbd6-cd9596533093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:09.309332 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14252062-9970-4fbc-8738-77b50ee0c835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:09.309963 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14252062-9970-4fbc-8738-77b50ee0c835 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:09.310340 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14252062-9970-4fbc-8738-77b50ee0c835 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:09.310686 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14252062-9970-4fbc-8738-77b50ee0c835 None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:09.311390 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14252062-9970-4fbc-8738-77b50ee0c835 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:09.311704 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14252062-9970-4fbc-8738-77b50ee0c835 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:09.313193 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14252062-9970-4fbc-8738-77b50ee0c835 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:09.323720 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 115/225] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:05:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:05:09.332576 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14252062-9970-4fbc-8738-77b50ee0c835 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:09.395484 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 111/226] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:05:09.412497 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1625c170-7a92-4280-bbd6-cd9596533093 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:09.449913 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14252062-9970-4fbc-8738-77b50ee0c835 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:09.482758 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:09.492488 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd14b4c-2fe3-49b5-9069-be013318134c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:09.493134 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd14b4c-2fe3-49b5-9069-be013318134c None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:09.494097 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd14b4c-2fe3-49b5-9069-be013318134c None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:09.494382 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd14b4c-2fe3-49b5-9069-be013318134c None admin] PATH_INFO: `/v3/users/3eb8526fc5db4540853adc94fa98d20d` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:09.500030 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd14b4c-2fe3-49b5-9069-be013318134c None admin] RBAC: Authorizing `identity:get_user(user_id=3eb8526fc5db4540853adc94fa98d20d)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:09.500030 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd14b4c-2fe3-49b5-9069-be013318134c None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:09.502770 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 116/227] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:05:09 2022] GET /identity/v3/users/3eb8526fc5db4540853adc94fa98d20d => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:09.507986 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:09.509617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd14b4c-2fe3-49b5-9069-be013318134c None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:09.537828 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1625c170-7a92-4280-bbd6-cd9596533093 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:09.575011 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34691cf-ebb9-4978-a1a9-2eef847c02fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:09.575684 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34691cf-ebb9-4978-a1a9-2eef847c02fc None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:09.575952 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34691cf-ebb9-4978-a1a9-2eef847c02fc None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:09.576225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34691cf-ebb9-4978-a1a9-2eef847c02fc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:09.587663 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34691cf-ebb9-4978-a1a9-2eef847c02fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:09.592496 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-b34691cf-ebb9-4978-a1a9-2eef847c02fc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:05:09.592496 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:09.592496 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:09.592496 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:09.592496 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:09.592496 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:09.592496 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:09.592496 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:09.592496 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:09.592496 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:09.592496 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:09.592496 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:09.592496 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:09.592496 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:09.592496 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:09.592496 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:09.593365 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:09.593365 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:09.593365 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:09.593365 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:09.593365 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:09.593365 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:09.593365 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:09.593365 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:09.593365 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:09.593365 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:09.593365 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:09.593365 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:09.593365 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:09.593365 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:09.593365 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:09.593365 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:09.594125 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:09.594125 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:09.594125 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:09.594125 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:09.594125 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:09.594125 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:09.594125 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:09.594125 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:09.594125 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:09.594125 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:09.594125 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:05:09.594125 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:09.598959 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 112/228] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 02:05:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:09.599758 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34691cf-ebb9-4978-a1a9-2eef847c02fc None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:09.650234 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd14b4c-2fe3-49b5-9069-be013318134c None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:09.703709 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34691cf-ebb9-4978-a1a9-2eef847c02fc None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:09.725507 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d669b82-6f30-46dd-b843-6882cd648079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:09.726150 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d669b82-6f30-46dd-b843-6882cd648079 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:09.726533 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d669b82-6f30-46dd-b843-6882cd648079 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:09.726814 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d669b82-6f30-46dd-b843-6882cd648079 None admin] PATH_INFO: `/v3/projects/f15701875ea24854a2a23f51fa4c6364` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:09.729643 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d669b82-6f30-46dd-b843-6882cd648079 None admin] RBAC: Authorizing `identity:get_project(project_id=f15701875ea24854a2a23f51fa4c6364)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:09.731233 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d669b82-6f30-46dd-b843-6882cd648079 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:09.732392 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:09.734004 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 117/229] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:05:09 2022] GET /identity/v3/projects/f15701875ea24854a2a23f51fa4c6364 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:09.739674 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d669b82-6f30-46dd-b843-6882cd648079 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:09.741473 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c5c87-ee89-432a-87f7-d04f7720bba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:09.742085 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c5c87-ee89-432a-87f7-d04f7720bba5 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:09.742366 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c5c87-ee89-432a-87f7-d04f7720bba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:09.742641 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c5c87-ee89-432a-87f7-d04f7720bba5 None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:09.743911 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95c5c87-ee89-432a-87f7-d04f7720bba5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:09.748636 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95c5c87-ee89-432a-87f7-d04f7720bba5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:09.748636 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95c5c87-ee89-432a-87f7-d04f7720bba5 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:09.759476 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 113/230] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:05:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:05:09.760726 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c5c87-ee89-432a-87f7-d04f7720bba5 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:09.868217 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:09.872802 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c5c87-ee89-432a-87f7-d04f7720bba5 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:09.937700 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d669b82-6f30-46dd-b843-6882cd648079 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:09.948292 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab97d882-ef99-44ac-a146-8c7bbcf819e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:09.948928 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97d882-ef99-44ac-a146-8c7bbcf819e1 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:09.949210 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97d882-ef99-44ac-a146-8c7bbcf819e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:09.949566 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97d882-ef99-44ac-a146-8c7bbcf819e1 None admin] PATH_INFO: `/v3/users/3eb8526fc5db4540853adc94fa98d20d` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:09.951449 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab97d882-ef99-44ac-a146-8c7bbcf819e1 None admin] RBAC: Authorizing `identity:get_user(user_id=3eb8526fc5db4540853adc94fa98d20d)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:09.952888 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab97d882-ef99-44ac-a146-8c7bbcf819e1 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:09.954481 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 114/231] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:05:09 2022] GET /identity/v3/users/3eb8526fc5db4540853adc94fa98d20d => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:05:09.962295 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab97d882-ef99-44ac-a146-8c7bbcf819e1 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:10.011497 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718cb37-d529-493d-85bb-b2d21375c7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:10.012166 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718cb37-d529-493d-85bb-b2d21375c7ee None admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:10.012447 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718cb37-d529-493d-85bb-b2d21375c7ee None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:10.012723 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718cb37-d529-493d-85bb-b2d21375c7ee None admin] PATH_INFO: `/v3/projects/f15701875ea24854a2a23f51fa4c6364/users/3eb8526fc5db4540853adc94fa98d20d/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:10.016234 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718cb37-d529-493d-85bb-b2d21375c7ee None admin] RBAC: Authorizing `identity:create_grant(project_id=f15701875ea24854a2a23f51fa4c6364, user_id=3eb8526fc5db4540853adc94fa98d20d, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:10.017684 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718cb37-d529-493d-85bb-b2d21375c7ee None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:10.055730 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:10.095550 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 118/232] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 02:05:09 2022] PUT /identity/v3/projects/f15701875ea24854a2a23f51fa4c6364/users/3eb8526fc5db4540853adc94fa98d20d/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:05:10.100690 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab97d882-ef99-44ac-a146-8c7bbcf819e1 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:10.139704 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a30167-421a-4b04-904e-eeadd38c9f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:10.140356 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a30167-421a-4b04-904e-eeadd38c9f81 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:10.140639 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a30167-421a-4b04-904e-eeadd38c9f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:10.140918 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a30167-421a-4b04-904e-eeadd38c9f81 None admin] PATH_INFO: `/v3/projects/f15701875ea24854a2a23f51fa4c6364` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:10.142106 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a30167-421a-4b04-904e-eeadd38c9f81 None admin] RBAC: Authorizing `identity:get_project(project_id=f15701875ea24854a2a23f51fa4c6364)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:10.143684 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a30167-421a-4b04-904e-eeadd38c9f81 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:10.145361 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 115/233] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:05:09 2022] GET /identity/v3/projects/f15701875ea24854a2a23f51fa4c6364 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:05:10.151638 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718cb37-d529-493d-85bb-b2d21375c7ee None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:10.278363 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718cb37-d529-493d-85bb-b2d21375c7ee None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:10.306938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:10.320544 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162afe4c-1699-471e-a543-4456e5527e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:10.320544 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162afe4c-1699-471e-a543-4456e5527e46 None admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:10.320544 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162afe4c-1699-471e-a543-4456e5527e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:10.320544 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162afe4c-1699-471e-a543-4456e5527e46 None admin] PATH_INFO: `/v3/projects/f15701875ea24854a2a23f51fa4c6364/users/3eb8526fc5db4540853adc94fa98d20d/roles/e513bb6d8f644c1d9156090e507a03d4` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:10.323877 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162afe4c-1699-471e-a543-4456e5527e46 None admin] RBAC: Authorizing `identity:create_grant(project_id=f15701875ea24854a2a23f51fa4c6364, user_id=3eb8526fc5db4540853adc94fa98d20d, role_id=e513bb6d8f644c1d9156090e507a03d4)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:10.325445 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162afe4c-1699-471e-a543-4456e5527e46 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:10.438497 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 119/234] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 02:05:10 2022] PUT /identity/v3/projects/f15701875ea24854a2a23f51fa4c6364/users/3eb8526fc5db4540853adc94fa98d20d/roles/e513bb6d8f644c1d9156090e507a03d4 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:05:11.425714 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ae1b2-5173-452a-a0bf-c2ed9c62aa41 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:11.426222 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ae1b2-5173-452a-a0bf-c2ed9c62aa41 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:11.426294 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ae1b2-5173-452a-a0bf-c2ed9c62aa41 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:11.427885 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 116/235] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:11.433503 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5bb47-d33d-455d-9a1c-da7caf12a12e None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:11.434291 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5bb47-d33d-455d-9a1c-da7caf12a12e None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:11.434770 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5bb47-d33d-455d-9a1c-da7caf12a12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:11.460623 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-66b5bb47-d33d-455d-9a1c-da7caf12a12e None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:11.461822 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-66b5bb47-d33d-455d-9a1c-da7caf12a12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:11.552676 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 120/236] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:11.580539 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e2071-4355-414a-bdfd-77b5f803745a None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:11.580834 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e2071-4355-414a-bdfd-77b5f803745a None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:11.581104 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e2071-4355-414a-bdfd-77b5f803745a None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:11.582738 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 117/237] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:11.587930 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9d564-aebb-41b4-b4c3-5857b0575023 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:11.588445 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9d564-aebb-41b4-b4c3-5857b0575023 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:11.588910 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9d564-aebb-41b4-b4c3-5857b0575023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:11.605542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e2071-4355-414a-bdfd-77b5f803745a None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:11.609648 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-9ba9d564-aebb-41b4-b4c3-5857b0575023 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:11.611074 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-9ba9d564-aebb-41b4-b4c3-5857b0575023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:11.705609 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 121/238] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:11.746282 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf69d06-2fd0-482d-a485-3ab2b8232b4a None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:11.746567 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf69d06-2fd0-482d-a485-3ab2b8232b4a None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:11.746829 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf69d06-2fd0-482d-a485-3ab2b8232b4a None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:11.748438 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 122/239] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:11.752146 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf69d06-2fd0-482d-a485-3ab2b8232b4a None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:11.766075 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e2071-4355-414a-bdfd-77b5f803745a None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:11.798261 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:11.803951 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:11.810813 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ab5e9-2b82-4ca9-96aa-49d34d680a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:11.824811 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ab5e9-2b82-4ca9-96aa-49d34d680a00 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:11.824811 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ab5e9-2b82-4ca9-96aa-49d34d680a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:11.824811 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ab5e9-2b82-4ca9-96aa-49d34d680a00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:11.824811 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ab5e9-2b82-4ca9-96aa-49d34d680a00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:11.824811 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ab5e9-2b82-4ca9-96aa-49d34d680a00 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:11.824811 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 118/240] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:05:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:11.825211 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cbf05-db94-4a26-b93e-1e42976274bc None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:11.825211 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cbf05-db94-4a26-b93e-1e42976274bc None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:11.825211 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cbf05-db94-4a26-b93e-1e42976274bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:11.847307 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-a97cbf05-db94-4a26-b93e-1e42976274bc None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:11.848843 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-a97cbf05-db94-4a26-b93e-1e42976274bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:11.863674 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf69d06-2fd0-482d-a485-3ab2b8232b4a None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:11.902969 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1c00b-463d-4cb4-8f12-09ac5c5677f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:11.903646 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1c00b-463d-4cb4-8f12-09ac5c5677f7 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:11.903929 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1c00b-463d-4cb4-8f12-09ac5c5677f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:11.904201 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1c00b-463d-4cb4-8f12-09ac5c5677f7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:11.915705 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f1c00b-463d-4cb4-8f12-09ac5c5677f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:11.920721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-05f1c00b-463d-4cb4-8f12-09ac5c5677f7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:05:11.920721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:11.920721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:11.920721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:11.920721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:11.920721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:11.920721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:11.920721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:11.920721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:11.920721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:11.920721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:11.920721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:11.920721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:11.920721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:11.920721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:11.920721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:11.926437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:11.926437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:11.926437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:11.926437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:11.926437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:11.926437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:11.926437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:11.926437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:11.926437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:11.926437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:11.926437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:11.926437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:11.926437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:11.926437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:11.926437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:11.926437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:11.927420 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:11.927420 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:11.927420 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:11.927420 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:11.927420 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:11.927420 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:11.927420 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:11.927420 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:11.927420 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:11.927420 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:11.927420 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:05:11.927420 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:11.927420 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 123/241] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:05:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:11.927420 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1c00b-463d-4cb4-8f12-09ac5c5677f7 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:11.940972 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 119/242] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:11.948512 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97cbf05-db94-4a26-b93e-1e42976274bc None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:12.064322 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1c00b-463d-4cb4-8f12-09ac5c5677f7 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:12.074551 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:12.098645 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97cbf05-db94-4a26-b93e-1e42976274bc None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:12.099936 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86b616-3cc3-42d7-9a19-699bff87f2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:12.100705 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86b616-3cc3-42d7-9a19-699bff87f2bf None admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:12.101141 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86b616-3cc3-42d7-9a19-699bff87f2bf None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:12.101553 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86b616-3cc3-42d7-9a19-699bff87f2bf None admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:12.102410 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86b616-3cc3-42d7-9a19-699bff87f2bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:12.104572 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86b616-3cc3-42d7-9a19-699bff87f2bf None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:12.128027 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:12.136902 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4e6c7-cbba-494c-ac89-8c21c81fa2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:12.137600 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4e6c7-cbba-494c-ac89-8c21c81fa2e5 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:12.137949 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4e6c7-cbba-494c-ac89-8c21c81fa2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:12.138292 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4e6c7-cbba-494c-ac89-8c21c81fa2e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:12.139016 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4e6c7-cbba-494c-ac89-8c21c81fa2e5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:12.139409 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4e6c7-cbba-494c-ac89-8c21c81fa2e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:12.140886 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4e6c7-cbba-494c-ac89-8c21c81fa2e5 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:12.149352 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 120/243] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 02:05:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:12.150088 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4e6c7-cbba-494c-ac89-8c21c81fa2e5 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:12.183893 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 124/244] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 8 02:05:11 2022] POST /identity/v3/users => generated 293 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:05:12.185553 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86b616-3cc3-42d7-9a19-699bff87f2bf None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:12.327002 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4e6c7-cbba-494c-ac89-8c21c81fa2e5 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:12.386132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91de66-5019-4998-836e-9482662e24f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:12.386769 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91de66-5019-4998-836e-9482662e24f2 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:12.387047 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91de66-5019-4998-836e-9482662e24f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:12.389478 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91de66-5019-4998-836e-9482662e24f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:12.399092 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86b616-3cc3-42d7-9a19-699bff87f2bf None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:12.406636 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91de66-5019-4998-836e-9482662e24f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:12.415744 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-8a91de66-5019-4998-836e-9482662e24f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:05:12.415744 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:12.415744 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:12.415744 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:12.415744 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:12.415744 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:12.415744 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:12.415744 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:12.415744 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:12.415744 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:12.415744 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:12.415744 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:12.415744 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:12.415744 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:12.415744 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:12.415744 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:12.416627 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:12.416627 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:12.416627 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:12.416627 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:12.416627 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:12.416627 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:12.416627 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:12.416627 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:12.416627 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:12.416627 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:12.416627 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:12.416627 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:12.416627 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:12.416627 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:12.416627 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:12.416627 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:12.417390 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:12.417390 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:12.417390 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:12.417390 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:12.417390 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:12.417390 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:12.417390 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:12.417390 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:12.417390 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:12.417390 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:12.417390 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:05:12.417390 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:12.419809 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 121/245] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:05:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:12.425758 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91de66-5019-4998-836e-9482662e24f2 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:12.448524 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e8ba8-8575-4592-923e-e448f4407250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:12.449709 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e8ba8-8575-4592-923e-e448f4407250 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:12.450551 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e8ba8-8575-4592-923e-e448f4407250 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:12.450974 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e8ba8-8575-4592-923e-e448f4407250 None admin] PATH_INFO: `/v3/users/8bd3af0606ec4716b6d376d990797e35` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:12.469077 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6e8ba8-8575-4592-923e-e448f4407250 None admin] RBAC: Authorizing `identity:get_user(user_id=8bd3af0606ec4716b6d376d990797e35)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:12.473396 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6e8ba8-8575-4592-923e-e448f4407250 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:12.476864 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 125/246] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:05:12 2022] GET /identity/v3/users/8bd3af0606ec4716b6d376d990797e35 => generated 297 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:12.482058 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e8ba8-8575-4592-923e-e448f4407250 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:12.490009 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:12.508447 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:12.547683 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91de66-5019-4998-836e-9482662e24f2 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:12.586566 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4d635-88d3-4ffc-867e-1aa24aaf3b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:12.588467 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4d635-88d3-4ffc-867e-1aa24aaf3b38 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:12.588955 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4d635-88d3-4ffc-867e-1aa24aaf3b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:12.589427 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4d635-88d3-4ffc-867e-1aa24aaf3b38 None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:12.590462 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4d635-88d3-4ffc-867e-1aa24aaf3b38 None admin] RBAC: Adding query filter params (name=member) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:12.591483 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4d635-88d3-4ffc-867e-1aa24aaf3b38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:12.593682 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4d635-88d3-4ffc-867e-1aa24aaf3b38 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:12.605484 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 122/247] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 02:05:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:05:12.606851 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91ed2e-cf55-4e4c-a4aa-c4449c7201a3 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:12.606976 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91ed2e-cf55-4e4c-a4aa-c4449c7201a3 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:12.607187 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91ed2e-cf55-4e4c-a4aa-c4449c7201a3 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:12.608760 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 123/248] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:12.613060 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e8ba8-8575-4592-923e-e448f4407250 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:12.613897 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91ed2e-cf55-4e4c-a4aa-c4449c7201a3 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:12.661369 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff570cf-1d02-4432-af70-4da9d33e00fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:12.662147 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff570cf-1d02-4432-af70-4da9d33e00fc None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:12.662525 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff570cf-1d02-4432-af70-4da9d33e00fc None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:12.662895 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff570cf-1d02-4432-af70-4da9d33e00fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:12.741667 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91ed2e-cf55-4e4c-a4aa-c4449c7201a3 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:12.744253 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff570cf-1d02-4432-af70-4da9d33e00fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:12.745993 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff570cf-1d02-4432-af70-4da9d33e00fc None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:12.754691 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:12.771555 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:12.782943 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e53ffb5-09d9-4a44-b3da-189736b9d18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:12.783932 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53ffb5-09d9-4a44-b3da-189736b9d18e None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:12.784289 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53ffb5-09d9-4a44-b3da-189736b9d18e None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:12.784634 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53ffb5-09d9-4a44-b3da-189736b9d18e None admin] PATH_INFO: `/v3/users/0bc89d2bceb84e51b33403231a84e264` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:12.786179 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e53ffb5-09d9-4a44-b3da-189736b9d18e None admin] RBAC: Authorizing `identity:get_user(user_id=0bc89d2bceb84e51b33403231a84e264)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:12.788019 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e53ffb5-09d9-4a44-b3da-189736b9d18e None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:12.791192 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 124/249] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:05:12 2022] GET /identity/v3/users/0bc89d2bceb84e51b33403231a84e264 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:05:12.796212 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3880e05-edc3-46ed-9776-68b0db8ade58 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:12.796212 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3880e05-edc3-46ed-9776-68b0db8ade58 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:12.796212 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3880e05-edc3-46ed-9776-68b0db8ade58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:12.815057 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-a3880e05-edc3-46ed-9776-68b0db8ade58 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:12.817371 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-a3880e05-edc3-46ed-9776-68b0db8ade58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:12.858982 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 126/250] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:05:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:05:12.864636 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff570cf-1d02-4432-af70-4da9d33e00fc None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:12.903506 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 125/251] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:12.903506 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3880e05-edc3-46ed-9776-68b0db8ade58 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:12.995573 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff570cf-1d02-4432-af70-4da9d33e00fc None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:13.019529 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:13.032766 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3880e05-edc3-46ed-9776-68b0db8ade58 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:13.040102 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753da23a-1135-41ea-a95b-41e03f36de7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:13.041039 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753da23a-1135-41ea-a95b-41e03f36de7a None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:13.041515 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753da23a-1135-41ea-a95b-41e03f36de7a None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:13.041979 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753da23a-1135-41ea-a95b-41e03f36de7a None admin] PATH_INFO: `/v3/projects/f15701875ea24854a2a23f51fa4c6364` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:13.043512 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753da23a-1135-41ea-a95b-41e03f36de7a None admin] RBAC: Authorizing `identity:get_project(project_id=f15701875ea24854a2a23f51fa4c6364)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:13.044720 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:13.045416 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753da23a-1135-41ea-a95b-41e03f36de7a None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:13.047451 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 127/252] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:05:12 2022] GET /identity/v3/projects/f15701875ea24854a2a23f51fa4c6364 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:13.048893 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd9e18-d225-44cb-b775-6a93c86d293f None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:13.049237 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd9e18-d225-44cb-b775-6a93c86d293f None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:13.049582 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd9e18-d225-44cb-b775-6a93c86d293f None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:13.051073 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 128/253] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:13.056256 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd9e18-d225-44cb-b775-6a93c86d293f None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:13.076265 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24f754-d5d8-4650-ae2c-9e7e207887b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:13.077595 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24f754-d5d8-4650-ae2c-9e7e207887b0 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:13.078049 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24f754-d5d8-4650-ae2c-9e7e207887b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:13.078500 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24f754-d5d8-4650-ae2c-9e7e207887b0 None admin] PATH_INFO: `/v3/projects/f15701875ea24854a2a23f51fa4c6364` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:13.079834 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb24f754-d5d8-4650-ae2c-9e7e207887b0 None admin] RBAC: Authorizing `identity:get_project(project_id=f15701875ea24854a2a23f51fa4c6364)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:13.082335 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb24f754-d5d8-4650-ae2c-9e7e207887b0 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:13.085407 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 126/254] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:05:12 2022] GET /identity/v3/projects/f15701875ea24854a2a23f51fa4c6364 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:13.086386 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24f754-d5d8-4650-ae2c-9e7e207887b0 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:13.171998 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd9e18-d225-44cb-b775-6a93c86d293f None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:13.198979 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24f754-d5d8-4650-ae2c-9e7e207887b0 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:13.208966 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e956b-12ec-45c7-addf-89675a5d9aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:13.209597 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e956b-12ec-45c7-addf-89675a5d9aab None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:13.209876 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e956b-12ec-45c7-addf-89675a5d9aab None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:13.210144 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e956b-12ec-45c7-addf-89675a5d9aab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:13.221523 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9e956b-12ec-45c7-addf-89675a5d9aab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:13.226692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-9f9e956b-12ec-45c7-addf-89675a5d9aab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:05:13.226692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:13.226692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:13.226692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:13.226692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:13.226692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:13.226692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:13.226692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:13.226692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:13.226692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:13.226692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:13.226692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:13.226692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:13.226692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:13.226692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:13.226692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:13.227636 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:13.227636 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:13.227636 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:13.227636 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:13.227636 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:13.227636 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:13.227636 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:13.227636 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:13.227636 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:13.227636 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:13.227636 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:13.227636 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:13.227636 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:13.227636 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:13.227636 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:13.227636 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:13.228444 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:13.228444 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:13.228444 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:13.228444 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:13.228444 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:13.228444 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:13.228444 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:13.228444 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:13.228444 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:13.228444 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:13.228444 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:05:13.228444 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:13.228444 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 129/255] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 02:05:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:13.229118 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153d74c-c1c3-4541-8680-ea454271e288 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:13.229937 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153d74c-c1c3-4541-8680-ea454271e288 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:13.229937 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153d74c-c1c3-4541-8680-ea454271e288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:13.246185 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cbc580-ba68-4256-af8a-645c6e2f56a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:13.247030 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbc580-ba68-4256-af8a-645c6e2f56a4 None admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:13.247493 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbc580-ba68-4256-af8a-645c6e2f56a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:13.247775 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbc580-ba68-4256-af8a-645c6e2f56a4 None admin] PATH_INFO: `/v3/projects/f15701875ea24854a2a23f51fa4c6364/users/0bc89d2bceb84e51b33403231a84e264/roles/5691bce246d6452990f13933e19f2825` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:13.249727 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cbc580-ba68-4256-af8a-645c6e2f56a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=f15701875ea24854a2a23f51fa4c6364, user_id=0bc89d2bceb84e51b33403231a84e264, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:13.251188 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cbc580-ba68-4256-af8a-645c6e2f56a4 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:13.252020 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-c153d74c-c1c3-4541-8680-ea454271e288 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:13.253495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-c153d74c-c1c3-4541-8680-ea454271e288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:13.304478 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:13.318533 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 127/256] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 02:05:13 2022] PUT /identity/v3/projects/f15701875ea24854a2a23f51fa4c6364/users/0bc89d2bceb84e51b33403231a84e264/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:05:13.318533 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cbc580-ba68-4256-af8a-645c6e2f56a4 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:13.342909 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 130/257] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:13.351927 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c153d74c-c1c3-4541-8680-ea454271e288 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:13.404719 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:13.532600 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cbc580-ba68-4256-af8a-645c6e2f56a4 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:13.534291 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c153d74c-c1c3-4541-8680-ea454271e288 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:13.572058 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c90fc-c56f-4dca-8aaf-8c76366e4161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:13.572667 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c90fc-c56f-4dca-8aaf-8c76366e4161 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:13.572949 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c90fc-c56f-4dca-8aaf-8c76366e4161 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:13.573266 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c90fc-c56f-4dca-8aaf-8c76366e4161 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:13.574005 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c90fc-c56f-4dca-8aaf-8c76366e4161 None admin] RBAC: Adding query filter params (role.id=961f87b1da8444afb55ea38aa7005933, scope.project.id=f15701875ea24854a2a23f51fa4c6364, user.id=8bd3af0606ec4716b6d376d990797e35) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:13.574314 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c90fc-c56f-4dca-8aaf-8c76366e4161 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:13.575762 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c90fc-c56f-4dca-8aaf-8c76366e4161 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:13.577486 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28010d4e-dce6-423c-9ee0-ed62cc68fc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:13.578332 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28010d4e-dce6-423c-9ee0-ed62cc68fc1d None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:13.578869 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28010d4e-dce6-423c-9ee0-ed62cc68fc1d None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:13.579373 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28010d4e-dce6-423c-9ee0-ed62cc68fc1d None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:13.580237 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28010d4e-dce6-423c-9ee0-ed62cc68fc1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:13.580782 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28010d4e-dce6-423c-9ee0-ed62cc68fc1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:13.581511 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 128/258] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:05:13 2022] GET /identity/v3/role_assignments?user.id=8bd3af0606ec4716b6d376d990797e35&scope.project.id=f15701875ea24854a2a23f51fa4c6364&role.id=961f87b1da8444afb55ea38aa7005933 => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:13.582866 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28010d4e-dce6-423c-9ee0-ed62cc68fc1d None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:13.585269 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c90fc-c56f-4dca-8aaf-8c76366e4161 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:13.592787 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 131/259] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:05:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:13.598839 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28010d4e-dce6-423c-9ee0-ed62cc68fc1d None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:13.666264 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:13.699301 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:13.702599 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c90fc-c56f-4dca-8aaf-8c76366e4161 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:13.740831 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42960949-bead-442c-8065-744bef599f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:13.741813 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42960949-bead-442c-8065-744bef599f05 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:13.742316 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42960949-bead-442c-8065-744bef599f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:13.742924 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42960949-bead-442c-8065-744bef599f05 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:13.763839 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42960949-bead-442c-8065-744bef599f05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:13.775261 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28010d4e-dce6-423c-9ee0-ed62cc68fc1d None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:13.777477 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-42960949-bead-442c-8065-744bef599f05 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:05:13.777477 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:13.777477 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:13.777477 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:13.777477 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:13.777477 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:13.777477 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:13.777477 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:13.777477 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:13.777477 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:13.777477 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:13.777477 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:13.777477 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:13.777477 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:13.777477 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:13.777477 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:13.778394 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:13.778394 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:13.778394 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:13.778394 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:13.778394 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:13.778394 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:13.778394 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:13.778394 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:13.778394 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:13.778394 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:13.778394 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:13.778394 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:13.778394 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:13.778394 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:13.778394 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:13.778394 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:13.779247 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:13.779247 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:13.779247 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:13.779247 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:13.779247 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:13.779247 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:13.779247 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:13.779247 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:13.779247 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:13.779247 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:13.779247 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:05:13.779247 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:13.783504 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 129/260] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 02:05:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:13.791686 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42960949-bead-442c-8065-744bef599f05 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:13.876475 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab45f94-1d4a-4b4b-a2c0-2da5092ca20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:13.877134 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab45f94-1d4a-4b4b-a2c0-2da5092ca20b None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:13.877416 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab45f94-1d4a-4b4b-a2c0-2da5092ca20b None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:13.877692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab45f94-1d4a-4b4b-a2c0-2da5092ca20b None admin] PATH_INFO: `/v3/users/3eb8526fc5db4540853adc94fa98d20d` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:13.878970 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab45f94-1d4a-4b4b-a2c0-2da5092ca20b None admin] RBAC: Authorizing `identity:get_user(user_id=3eb8526fc5db4540853adc94fa98d20d)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:13.880552 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab45f94-1d4a-4b4b-a2c0-2da5092ca20b None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:13.884394 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 132/261] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:05:13 2022] GET /identity/v3/users/3eb8526fc5db4540853adc94fa98d20d => generated 283 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:13.892556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab45f94-1d4a-4b4b-a2c0-2da5092ca20b None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:13.974586 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42960949-bead-442c-8065-744bef599f05 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:14.005589 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab45f94-1d4a-4b4b-a2c0-2da5092ca20b None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:14.021925 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:14.025532 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad005c-33f8-45b1-bd22-77fa680def06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:14.026511 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad005c-33f8-45b1-bd22-77fa680def06 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:14.026994 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad005c-33f8-45b1-bd22-77fa680def06 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:14.027471 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad005c-33f8-45b1-bd22-77fa680def06 None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:14.028339 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cad005c-33f8-45b1-bd22-77fa680def06 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:14.028855 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cad005c-33f8-45b1-bd22-77fa680def06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:14.030644 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cad005c-33f8-45b1-bd22-77fa680def06 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:14.040748 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 130/262] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:05:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:14.048520 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad005c-33f8-45b1-bd22-77fa680def06 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:14.067389 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451cb48-af1c-4b73-b435-9c66803c951a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:14.067389 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451cb48-af1c-4b73-b435-9c66803c951a None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:14.067389 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451cb48-af1c-4b73-b435-9c66803c951a None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:14.067389 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451cb48-af1c-4b73-b435-9c66803c951a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:14.095383 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:14.179425 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b451cb48-af1c-4b73-b435-9c66803c951a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:14.181716 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b451cb48-af1c-4b73-b435-9c66803c951a None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:14.189028 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad005c-33f8-45b1-bd22-77fa680def06 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:14.225934 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b83c078-14b7-4057-8195-78b9842cd93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:14.227085 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83c078-14b7-4057-8195-78b9842cd93d None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:14.227653 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83c078-14b7-4057-8195-78b9842cd93d None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:14.228126 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83c078-14b7-4057-8195-78b9842cd93d None admin] PATH_INFO: `/v3/users/3eb8526fc5db4540853adc94fa98d20d` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:14.232804 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b83c078-14b7-4057-8195-78b9842cd93d None admin] RBAC: Authorizing `identity:get_user(user_id=3eb8526fc5db4540853adc94fa98d20d)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:14.234498 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b83c078-14b7-4057-8195-78b9842cd93d None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:14.239106 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 131/263] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:05:14 2022] GET /identity/v3/users/3eb8526fc5db4540853adc94fa98d20d => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:14.244374 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b83c078-14b7-4057-8195-78b9842cd93d None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:14.393743 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 133/264] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:05:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:05:14.398841 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451cb48-af1c-4b73-b435-9c66803c951a None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:14.407709 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:14.412039 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:14.431385 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b83c078-14b7-4057-8195-78b9842cd93d None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:14.500946 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c47c92-9bf9-44b4-bd99-bfa67d07ac0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:14.501957 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c47c92-9bf9-44b4-bd99-bfa67d07ac0e None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:14.502433 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c47c92-9bf9-44b4-bd99-bfa67d07ac0e None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:14.502925 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c47c92-9bf9-44b4-bd99-bfa67d07ac0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:14.547612 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451cb48-af1c-4b73-b435-9c66803c951a None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:14.583129 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c47c92-9bf9-44b4-bd99-bfa67d07ac0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:14.585315 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c47c92-9bf9-44b4-bd99-bfa67d07ac0e None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:14.606761 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12755086-0798-4947-aac7-e3b35339165a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:14.607425 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12755086-0798-4947-aac7-e3b35339165a None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:14.607711 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12755086-0798-4947-aac7-e3b35339165a None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:14.607988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12755086-0798-4947-aac7-e3b35339165a None admin] PATH_INFO: `/v3/projects/f15701875ea24854a2a23f51fa4c6364` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:14.609180 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12755086-0798-4947-aac7-e3b35339165a None admin] RBAC: Authorizing `identity:get_project(project_id=f15701875ea24854a2a23f51fa4c6364)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:14.610587 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12755086-0798-4947-aac7-e3b35339165a None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:14.612245 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 134/265] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:05:14 2022] GET /identity/v3/projects/f15701875ea24854a2a23f51fa4c6364 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:05:14.620283 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12755086-0798-4947-aac7-e3b35339165a None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:14.691730 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:14.693071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 132/266] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:05:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:05:14.697843 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c47c92-9bf9-44b4-bd99-bfa67d07ac0e None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:14.770296 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:14.795933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12755086-0798-4947-aac7-e3b35339165a None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:14.831112 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc46a52-3046-4c16-9a8b-b690e923b38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:14.831313 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c47c92-9bf9-44b4-bd99-bfa67d07ac0e None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:14.831805 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc46a52-3046-4c16-9a8b-b690e923b38f None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:14.832092 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc46a52-3046-4c16-9a8b-b690e923b38f None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:14.832371 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc46a52-3046-4c16-9a8b-b690e923b38f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:14.833106 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc46a52-3046-4c16-9a8b-b690e923b38f None admin] RBAC: Adding query filter params (role.id=84da65a75e544d1191ec53cb6b05aa73, scope.project.id=f15701875ea24854a2a23f51fa4c6364, user.id=3eb8526fc5db4540853adc94fa98d20d) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:14.833413 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc46a52-3046-4c16-9a8b-b690e923b38f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:14.834904 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc46a52-3046-4c16-9a8b-b690e923b38f None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:14.841825 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 135/267] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:05:14 2022] GET /identity/v3/role_assignments?user.id=3eb8526fc5db4540853adc94fa98d20d&scope.project.id=f15701875ea24854a2a23f51fa4c6364&role.id=84da65a75e544d1191ec53cb6b05aa73 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:14.907161 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4bba26-5ab4-4bb3-9d6d-fc424a0f0fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:14.907849 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bba26-5ab4-4bb3-9d6d-fc424a0f0fcd None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:14.908373 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bba26-5ab4-4bb3-9d6d-fc424a0f0fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:14.908661 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bba26-5ab4-4bb3-9d6d-fc424a0f0fcd None admin] PATH_INFO: `/v3/projects/f15701875ea24854a2a23f51fa4c6364` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:14.909926 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4bba26-5ab4-4bb3-9d6d-fc424a0f0fcd None admin] RBAC: Authorizing `identity:get_project(project_id=f15701875ea24854a2a23f51fa4c6364)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:14.911461 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4bba26-5ab4-4bb3-9d6d-fc424a0f0fcd None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:14.913541 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 133/268] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:05:14 2022] GET /identity/v3/projects/f15701875ea24854a2a23f51fa4c6364 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:14.919209 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc46a52-3046-4c16-9a8b-b690e923b38f None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:15.069514 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc46a52-3046-4c16-9a8b-b690e923b38f None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:15.088509 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922ca12-fbad-4834-9ef5-452f8a4a9f8b None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:15.088809 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922ca12-fbad-4834-9ef5-452f8a4a9f8b None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:15.089080 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922ca12-fbad-4834-9ef5-452f8a4a9f8b None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:15.090715 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 134/269] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:05:15.095841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e19c5-38a0-484b-8609-0ad804b36aee None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:15.096129 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e19c5-38a0-484b-8609-0ad804b36aee None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:15.096405 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e19c5-38a0-484b-8609-0ad804b36aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:15.122520 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-4d4e19c5-38a0-484b-8609-0ad804b36aee None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:15.123765 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-4d4e19c5-38a0-484b-8609-0ad804b36aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:15.132197 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d688a6-47e7-42eb-a49a-c6cf0d4d6dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:15.132711 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d688a6-47e7-42eb-a49a-c6cf0d4d6dec None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:15.132993 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d688a6-47e7-42eb-a49a-c6cf0d4d6dec None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:15.133270 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d688a6-47e7-42eb-a49a-c6cf0d4d6dec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:15.134550 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d688a6-47e7-42eb-a49a-c6cf0d4d6dec None admin] RBAC: Adding query filter params (role.id=e513bb6d8f644c1d9156090e507a03d4, scope.project.id=f15701875ea24854a2a23f51fa4c6364, user.id=3eb8526fc5db4540853adc94fa98d20d) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:15.134863 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d688a6-47e7-42eb-a49a-c6cf0d4d6dec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:15.136326 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d688a6-47e7-42eb-a49a-c6cf0d4d6dec None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:15.150729 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 136/270] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:05:14 2022] GET /identity/v3/role_assignments?user.id=3eb8526fc5db4540853adc94fa98d20d&scope.project.id=f15701875ea24854a2a23f51fa4c6364&role.id=e513bb6d8f644c1d9156090e507a03d4 => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:15.202235 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:15.218319 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 135/271] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:05:15.243477 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d688a6-47e7-42eb-a49a-c6cf0d4d6dec None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:15.253826 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:15.328530 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d32e5-3c0b-410c-bea4-b3205c271a26 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:15.328710 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d32e5-3c0b-410c-bea4-b3205c271a26 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:15.328987 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d32e5-3c0b-410c-bea4-b3205c271a26 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:15.330594 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 136/272] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:15.337406 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc24081-a9fc-409c-b836-de6abe16bae2 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:15.337687 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc24081-a9fc-409c-b836-de6abe16bae2 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:15.337968 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc24081-a9fc-409c-b836-de6abe16bae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:15.357994 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-6dc24081-a9fc-409c-b836-de6abe16bae2 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:15.359211 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-6dc24081-a9fc-409c-b836-de6abe16bae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:15.426705 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d688a6-47e7-42eb-a49a-c6cf0d4d6dec None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:15.484384 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 137/273] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:05:15.495936 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2df31e-9162-4bf0-bb51-2593bd5a34cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:15.496581 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2df31e-9162-4bf0-bb51-2593bd5a34cc None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:15.496869 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2df31e-9162-4bf0-bb51-2593bd5a34cc None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:15.497146 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2df31e-9162-4bf0-bb51-2593bd5a34cc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:15.509303 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2df31e-9162-4bf0-bb51-2593bd5a34cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:15.515628 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc24081-a9fc-409c-b836-de6abe16bae2 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:15.520548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-2e2df31e-9162-4bf0-bb51-2593bd5a34cc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:05:15.520548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:15.520548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:15.520548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:15.520548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:15.520548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:15.520548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:15.520548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:15.520548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:15.520548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:15.520548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:15.520548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:15.520548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:15.520548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:15.520548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:15.520548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:15.521430 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:15.521430 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:15.521430 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:15.521430 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:15.521430 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:15.521430 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:15.521430 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:15.521430 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:15.521430 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:15.521430 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:15.521430 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:15.521430 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:15.521430 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:15.521430 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:15.521430 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:15.521430 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:15.522191 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:15.522191 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:15.522191 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:15.522191 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:15.522191 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:15.522191 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:15.522191 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:15.522191 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:15.522191 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:15.522191 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:15.522191 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:05:15.522191 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:15.525439 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 137/274] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:05:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:15.530690 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2df31e-9162-4bf0-bb51-2593bd5a34cc None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:15.621591 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:15.641180 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc24081-a9fc-409c-b836-de6abe16bae2 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:15.662234 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:15.671450 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2df31e-9162-4bf0-bb51-2593bd5a34cc None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:15.681461 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb41f7a-1ccf-4376-9b0f-34bdd123a73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:15.682092 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb41f7a-1ccf-4376-9b0f-34bdd123a73d None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:15.682376 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb41f7a-1ccf-4376-9b0f-34bdd123a73d None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:15.682652 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb41f7a-1ccf-4376-9b0f-34bdd123a73d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:15.683929 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb41f7a-1ccf-4376-9b0f-34bdd123a73d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:15.685503 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb41f7a-1ccf-4376-9b0f-34bdd123a73d None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:15.687175 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 138/275] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:05:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:05:15.695879 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb41f7a-1ccf-4376-9b0f-34bdd123a73d None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:15.709770 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26b29f-a3a2-424d-9fe5-259623c9742c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:15.710843 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26b29f-a3a2-424d-9fe5-259623c9742c None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:15.711285 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26b29f-a3a2-424d-9fe5-259623c9742c None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:15.711720 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26b29f-a3a2-424d-9fe5-259623c9742c None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:15.713015 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d26b29f-a3a2-424d-9fe5-259623c9742c None admin] RBAC: Adding query filter params (name=member) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:15.714021 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d26b29f-a3a2-424d-9fe5-259623c9742c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:15.715553 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d26b29f-a3a2-424d-9fe5-259623c9742c None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:15.724700 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 138/276] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 02:05:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:15.730337 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26b29f-a3a2-424d-9fe5-259623c9742c None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:15.803101 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb41f7a-1ccf-4376-9b0f-34bdd123a73d None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:15.835877 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26b29f-a3a2-424d-9fe5-259623c9742c None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:15.839934 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1939c5c-c834-4b29-b72e-93381827845a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:15.840654 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1939c5c-c834-4b29-b72e-93381827845a None admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:15.841037 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1939c5c-c834-4b29-b72e-93381827845a None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:15.841411 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1939c5c-c834-4b29-b72e-93381827845a None admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:15.842180 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1939c5c-c834-4b29-b72e-93381827845a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:15.843750 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1939c5c-c834-4b29-b72e-93381827845a None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:15.866335 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:15.874339 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68efe8f-1a2f-4fdf-ac6b-9991d1dfed8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:15.874945 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68efe8f-1a2f-4fdf-ac6b-9991d1dfed8e None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:15.875223 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68efe8f-1a2f-4fdf-ac6b-9991d1dfed8e None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:15.875607 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68efe8f-1a2f-4fdf-ac6b-9991d1dfed8e None admin] PATH_INFO: `/v3/users/7428d87c8c734362b999b7aa2dc5809b` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:15.890297 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68efe8f-1a2f-4fdf-ac6b-9991d1dfed8e None admin] RBAC: Authorizing `identity:get_user(user_id=7428d87c8c734362b999b7aa2dc5809b)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:15.891794 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68efe8f-1a2f-4fdf-ac6b-9991d1dfed8e None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:15.893745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 139/277] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:05:15 2022] GET /identity/v3/users/7428d87c8c734362b999b7aa2dc5809b => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:05:15.899279 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68efe8f-1a2f-4fdf-ac6b-9991d1dfed8e None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:15.935643 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 139/278] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 8 02:05:15 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:05:16.011823 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68efe8f-1a2f-4fdf-ac6b-9991d1dfed8e None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:16.049878 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03293ef8-55a7-421f-aea5-369caee673c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:16.050500 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03293ef8-55a7-421f-aea5-369caee673c3 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:16.050775 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03293ef8-55a7-421f-aea5-369caee673c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:16.051047 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03293ef8-55a7-421f-aea5-369caee673c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:16.051813 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03293ef8-55a7-421f-aea5-369caee673c3 None admin] RBAC: Adding query filter params (role.id=5691bce246d6452990f13933e19f2825, user.id=7428d87c8c734362b999b7aa2dc5809b, scope.system=all) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:16.052120 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03293ef8-55a7-421f-aea5-369caee673c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:16.053563 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03293ef8-55a7-421f-aea5-369caee673c3 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:16.059913 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 140/279] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Aug 8 02:05:15 2022] GET /identity/v3/role_assignments?user.id=7428d87c8c734362b999b7aa2dc5809b&scope.system=all&role.id=5691bce246d6452990f13933e19f2825 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:05:16.392555 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3577f67-111c-46c3-99b8-4cac74291134 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:16.392874 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3577f67-111c-46c3-99b8-4cac74291134 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:16.393118 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3577f67-111c-46c3-99b8-4cac74291134 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:16.394613 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 140/280] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:16.403379 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63ed08-a032-4e87-aedb-19a3fd263fe9 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:16.403379 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63ed08-a032-4e87-aedb-19a3fd263fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:16.403379 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63ed08-a032-4e87-aedb-19a3fd263fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:16.420304 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-ac63ed08-a032-4e87-aedb-19a3fd263fe9 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:16.421818 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-ac63ed08-a032-4e87-aedb-19a3fd263fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:16.446607 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a541423-74b0-4179-902a-65dc29f07a26 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:16.446607 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a541423-74b0-4179-902a-65dc29f07a26 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:16.446607 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a541423-74b0-4179-902a-65dc29f07a26 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:16.447078 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 141/281] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:16.453683 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c175c-76b0-43e7-93b2-7c83b07af808 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:16.453980 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c175c-76b0-43e7-93b2-7c83b07af808 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:16.454263 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c175c-76b0-43e7-93b2-7c83b07af808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:16.473077 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:16.479450 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-d94c175c-76b0-43e7-93b2-7c83b07af808 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:16.480663 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-d94c175c-76b0-43e7-93b2-7c83b07af808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:16.498606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 141/282] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:16.522952 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63ed08-a032-4e87-aedb-19a3fd263fe9 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:16.531864 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:16.581486 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 142/283] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:16.614587 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c175c-76b0-43e7-93b2-7c83b07af808 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:16.655422 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63ed08-a032-4e87-aedb-19a3fd263fe9 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:16.691081 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9693189-4025-4338-913f-5e23e0db05fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:16.691753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9693189-4025-4338-913f-5e23e0db05fd None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:16.692039 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9693189-4025-4338-913f-5e23e0db05fd None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:16.692316 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9693189-4025-4338-913f-5e23e0db05fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:16.703755 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9693189-4025-4338-913f-5e23e0db05fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:16.708714 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-b9693189-4025-4338-913f-5e23e0db05fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:05:16.708714 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:16.708714 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:16.708714 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:16.708714 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:16.708714 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:16.708714 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:16.708714 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:16.708714 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:16.708714 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:16.708714 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:16.708714 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:16.708714 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:16.708714 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:16.708714 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:16.708714 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:16.709589 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:16.709589 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:16.709589 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:16.709589 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:16.709589 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:16.709589 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:16.709589 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:16.709589 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:16.709589 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:16.709589 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:16.709589 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:16.709589 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:16.709589 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:16.709589 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:16.709589 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:16.709589 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:16.710365 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:16.710365 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:16.710365 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:16.710365 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:16.710365 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:16.710365 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:16.710365 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:16.710365 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:16.710365 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:16.710365 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:16.710365 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:05:16.710365 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:16.710365 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 142/284] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:05:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:16.716447 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9693189-4025-4338-913f-5e23e0db05fd None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:16.760886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:16.823218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9693189-4025-4338-913f-5e23e0db05fd None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:16.847581 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c175c-76b0-43e7-93b2-7c83b07af808 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:16.859303 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044cc22-9a4d-489a-8117-a71eb851d38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:16.859956 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044cc22-9a4d-489a-8117-a71eb851d38b None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:16.860237 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044cc22-9a4d-489a-8117-a71eb851d38b None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:16.860510 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044cc22-9a4d-489a-8117-a71eb851d38b None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:16.861183 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8044cc22-9a4d-489a-8117-a71eb851d38b None admin] RBAC: Adding query filter params (name=member) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:16.861622 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8044cc22-9a4d-489a-8117-a71eb851d38b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:16.862859 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8044cc22-9a4d-489a-8117-a71eb851d38b None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:16.871990 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 143/285] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 02:05:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:05:16.877451 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044cc22-9a4d-489a-8117-a71eb851d38b None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:16.896650 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bdd8a4-44f0-4dc4-9281-06da8712e0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:16.897712 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bdd8a4-44f0-4dc4-9281-06da8712e0c4 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:16.898218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bdd8a4-44f0-4dc4-9281-06da8712e0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:16.898688 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bdd8a4-44f0-4dc4-9281-06da8712e0c4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:16.914676 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bdd8a4-44f0-4dc4-9281-06da8712e0c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:16.919719 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-42bdd8a4-44f0-4dc4-9281-06da8712e0c4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:05:16.919719 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:16.919719 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:16.919719 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:16.919719 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:16.919719 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:16.919719 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:16.919719 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:16.919719 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:16.919719 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:16.919719 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:16.919719 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:16.919719 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:16.919719 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:16.919719 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:16.919719 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:16.928460 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:16.928460 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:16.928460 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:16.928460 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:16.928460 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:16.928460 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:16.928460 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:16.928460 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:16.928460 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:16.928460 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:16.928460 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:16.928460 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:16.928460 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:16.928460 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:16.928460 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:16.928460 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:16.929223 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:16.929223 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:16.929223 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:16.929223 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:16.929223 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:16.929223 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:16.929223 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:16.929223 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:16.929223 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:16.929223 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:16.929223 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:05:16.929223 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:16.930872 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 143/286] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:05:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:05:16.933479 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bdd8a4-44f0-4dc4-9281-06da8712e0c4 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:16.990228 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044cc22-9a4d-489a-8117-a71eb851d38b None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:16.991928 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:17.026238 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:17.032414 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96eae8-44a9-49cb-b300-360609c77993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:17.033178 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96eae8-44a9-49cb-b300-360609c77993 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:17.033481 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96eae8-44a9-49cb-b300-360609c77993 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:17.033750 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96eae8-44a9-49cb-b300-360609c77993 None admin] PATH_INFO: `/v3/users/0bc89d2bceb84e51b33403231a84e264` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:17.034979 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e96eae8-44a9-49cb-b300-360609c77993 None admin] RBAC: Authorizing `identity:get_user(user_id=0bc89d2bceb84e51b33403231a84e264)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:17.036500 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e96eae8-44a9-49cb-b300-360609c77993 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:17.039385 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 144/287] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:05:16 2022] GET /identity/v3/users/0bc89d2bceb84e51b33403231a84e264 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:17.044961 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96eae8-44a9-49cb-b300-360609c77993 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:17.147954 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96eae8-44a9-49cb-b300-360609c77993 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:17.185587 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb8841-94a0-4317-8758-3b262e8f42d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:17.186259 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb8841-94a0-4317-8758-3b262e8f42d5 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:17.186543 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb8841-94a0-4317-8758-3b262e8f42d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:17.186816 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb8841-94a0-4317-8758-3b262e8f42d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:17.205444 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bdd8a4-44f0-4dc4-9281-06da8712e0c4 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:17.230822 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:17.265696 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb8841-94a0-4317-8758-3b262e8f42d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:17.267220 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb8841-94a0-4317-8758-3b262e8f42d5 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:17.304044 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb4f3e-5ed2-4404-8a84-0fe346dbfbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:17.304900 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb4f3e-5ed2-4404-8a84-0fe346dbfbde None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:17.305182 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb4f3e-5ed2-4404-8a84-0fe346dbfbde None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:17.305455 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb4f3e-5ed2-4404-8a84-0fe346dbfbde None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:17.306158 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcb4f3e-5ed2-4404-8a84-0fe346dbfbde None admin] RBAC: Adding query filter params (name=reader) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:17.306459 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcb4f3e-5ed2-4404-8a84-0fe346dbfbde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:17.307851 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcb4f3e-5ed2-4404-8a84-0fe346dbfbde None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:17.322178 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 144/288] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 02:05:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:05:17.327331 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb4f3e-5ed2-4404-8a84-0fe346dbfbde None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:17.392137 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 145/289] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:05:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:05:17.398427 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb8841-94a0-4317-8758-3b262e8f42d5 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:17.521738 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:17.528777 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb4f3e-5ed2-4404-8a84-0fe346dbfbde None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:17.539756 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:17.569007 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc0b271-b67a-450f-becd-ae8001524656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:17.569936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0b271-b67a-450f-becd-ae8001524656 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:17.571114 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0b271-b67a-450f-becd-ae8001524656 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:17.572105 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0b271-b67a-450f-becd-ae8001524656 None admin] PATH_INFO: `/v3/users/8bd3af0606ec4716b6d376d990797e35` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:17.574645 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc0b271-b67a-450f-becd-ae8001524656 None admin] RBAC: Authorizing `identity:get_user(user_id=8bd3af0606ec4716b6d376d990797e35)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:17.579714 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc0b271-b67a-450f-becd-ae8001524656 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:17.581496 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 145/290] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:05:17 2022] GET /identity/v3/users/8bd3af0606ec4716b6d376d990797e35 => generated 297 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:05:17.586725 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc0b271-b67a-450f-becd-ae8001524656 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:17.607014 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb8841-94a0-4317-8758-3b262e8f42d5 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:17.643344 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebebe0c-ce99-4871-a27c-8869b82121a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:17.644401 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebebe0c-ce99-4871-a27c-8869b82121a5 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:17.645098 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebebe0c-ce99-4871-a27c-8869b82121a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:17.645544 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebebe0c-ce99-4871-a27c-8869b82121a5 None admin] PATH_INFO: `/v3/projects/f15701875ea24854a2a23f51fa4c6364` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:17.646817 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebebe0c-ce99-4871-a27c-8869b82121a5 None admin] RBAC: Authorizing `identity:get_project(project_id=f15701875ea24854a2a23f51fa4c6364)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:17.648947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebebe0c-ce99-4871-a27c-8869b82121a5 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:17.651152 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 146/291] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:05:17 2022] GET /identity/v3/projects/f15701875ea24854a2a23f51fa4c6364 => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:17.656921 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebebe0c-ce99-4871-a27c-8869b82121a5 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:17.792896 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc0b271-b67a-450f-becd-ae8001524656 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:17.816710 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebebe0c-ce99-4871-a27c-8869b82121a5 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:17.858212 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6cfccb-b6ae-4568-9034-18cb65eb83e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:17.859538 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6cfccb-b6ae-4568-9034-18cb65eb83e8 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:17.859990 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6cfccb-b6ae-4568-9034-18cb65eb83e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:17.860427 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6cfccb-b6ae-4568-9034-18cb65eb83e8 None admin] PATH_INFO: `/v3/projects/f15701875ea24854a2a23f51fa4c6364` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:17.862368 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6cfccb-b6ae-4568-9034-18cb65eb83e8 None admin] RBAC: Authorizing `identity:get_project(project_id=f15701875ea24854a2a23f51fa4c6364)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:17.864028 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6cfccb-b6ae-4568-9034-18cb65eb83e8 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:17.866186 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 146/292] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:05:17 2022] GET /identity/v3/projects/f15701875ea24854a2a23f51fa4c6364 => generated 302 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:05:17.874399 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6cfccb-b6ae-4568-9034-18cb65eb83e8 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:17.907266 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:17.913280 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9fc66-d624-47ff-932d-5dae81da1bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:17.913280 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9fc66-d624-47ff-932d-5dae81da1bba None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:17.913534 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9fc66-d624-47ff-932d-5dae81da1bba None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:17.913787 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9fc66-d624-47ff-932d-5dae81da1bba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:17.914523 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9fc66-d624-47ff-932d-5dae81da1bba None admin] RBAC: Adding query filter params (role.id=5691bce246d6452990f13933e19f2825, scope.project.id=f15701875ea24854a2a23f51fa4c6364, user.id=0bc89d2bceb84e51b33403231a84e264) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:17.914840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9fc66-d624-47ff-932d-5dae81da1bba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:17.916342 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9fc66-d624-47ff-932d-5dae81da1bba None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:17.937741 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 147/293] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:05:17 2022] GET /identity/v3/role_assignments?user.id=0bc89d2bceb84e51b33403231a84e264&scope.project.id=f15701875ea24854a2a23f51fa4c6364&role.id=5691bce246d6452990f13933e19f2825 => generated 608 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:17.984090 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6cfccb-b6ae-4568-9034-18cb65eb83e8 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:18.025086 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187bcfe2-fd8c-4070-ad91-bb7b3a403436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:18.026349 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187bcfe2-fd8c-4070-ad91-bb7b3a403436 None admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:18.026825 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187bcfe2-fd8c-4070-ad91-bb7b3a403436 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:18.027264 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187bcfe2-fd8c-4070-ad91-bb7b3a403436 None admin] PATH_INFO: `/v3/projects/f15701875ea24854a2a23f51fa4c6364/users/8bd3af0606ec4716b6d376d990797e35/roles/961f87b1da8444afb55ea38aa7005933` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:18.029451 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187bcfe2-fd8c-4070-ad91-bb7b3a403436 None admin] RBAC: Authorizing `identity:create_grant(project_id=f15701875ea24854a2a23f51fa4c6364, user_id=8bd3af0606ec4716b6d376d990797e35, role_id=961f87b1da8444afb55ea38aa7005933)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:18.031055 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187bcfe2-fd8c-4070-ad91-bb7b3a403436 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:18.106991 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 147/294] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 02:05:17 2022] PUT /identity/v3/projects/f15701875ea24854a2a23f51fa4c6364/users/8bd3af0606ec4716b6d376d990797e35/roles/961f87b1da8444afb55ea38aa7005933 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:05:18.447849 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e52f3b-b998-4334-b8ec-5b64e06f3358 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:18.448138 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e52f3b-b998-4334-b8ec-5b64e06f3358 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:18.448420 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e52f3b-b998-4334-b8ec-5b64e06f3358 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:18.450049 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 148/295] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:18.455144 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e386d4-879f-49db-8d90-0ef808f9b2e7 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:18.455713 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e386d4-879f-49db-8d90-0ef808f9b2e7 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:18.456071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e386d4-879f-49db-8d90-0ef808f9b2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:18.475349 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-07e386d4-879f-49db-8d90-0ef808f9b2e7 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:18.476581 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-07e386d4-879f-49db-8d90-0ef808f9b2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:18.500781 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19536b-17d5-4657-a1a9-75ced864e252 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:18.501116 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19536b-17d5-4657-a1a9-75ced864e252 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:18.501331 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19536b-17d5-4657-a1a9-75ced864e252 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:18.502674 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 149/296] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:05:18.508048 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5084bc-680b-4bf9-a0be-4eee50eafc01 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:18.508336 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5084bc-680b-4bf9-a0be-4eee50eafc01 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:18.508615 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5084bc-680b-4bf9-a0be-4eee50eafc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:18.519687 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:18.534606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-8c5084bc-680b-4bf9-a0be-4eee50eafc01 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:18.536367 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-8c5084bc-680b-4bf9-a0be-4eee50eafc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:18.567389 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 148/297] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:18.590857 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e386d4-879f-49db-8d90-0ef808f9b2e7 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:18.612251 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:18.619174 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 150/298] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:18.620433 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71674549-4e89-40e5-9555-46b62ff4160b None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:18.620723 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71674549-4e89-40e5-9555-46b62ff4160b None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:18.620997 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71674549-4e89-40e5-9555-46b62ff4160b None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:18.626390 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 151/299] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:18.627484 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26647cf-87ee-4c69-8586-7963b4235f08 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:18.627838 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26647cf-87ee-4c69-8586-7963b4235f08 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:18.628200 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26647cf-87ee-4c69-8586-7963b4235f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:18.646779 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-c26647cf-87ee-4c69-8586-7963b4235f08 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:18.648157 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-c26647cf-87ee-4c69-8586-7963b4235f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:18.703147 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e386d4-879f-49db-8d90-0ef808f9b2e7 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:18.717053 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 152/300] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:18.724410 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26647cf-87ee-4c69-8586-7963b4235f08 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:18.744375 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d9c8f-23e0-407b-8390-4dca2489dcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:18.745008 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d9c8f-23e0-407b-8390-4dca2489dcb0 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:18.745296 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d9c8f-23e0-407b-8390-4dca2489dcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:18.745576 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d9c8f-23e0-407b-8390-4dca2489dcb0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:18.756103 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d9c8f-23e0-407b-8390-4dca2489dcb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:18.760831 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-eb1d9c8f-23e0-407b-8390-4dca2489dcb0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:05:18.760831 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:18.760831 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:18.760831 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:18.760831 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:18.760831 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:18.760831 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:18.760831 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:18.760831 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:18.760831 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:18.760831 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:18.760831 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:18.760831 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:18.760831 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:18.760831 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:18.760831 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:18.761680 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:18.761680 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:18.761680 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:18.761680 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:18.761680 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:18.761680 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:18.761680 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:18.761680 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:18.761680 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:18.761680 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:18.761680 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:18.761680 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:18.761680 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:18.761680 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:18.761680 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:18.761680 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:18.762448 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:18.762448 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:18.762448 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:18.762448 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:18.762448 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:18.762448 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:18.762448 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:18.762448 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:18.762448 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:18.762448 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:18.762448 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:05:18.762448 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:18.762448 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 149/301] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:05:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:05:18.767385 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d9c8f-23e0-407b-8390-4dca2489dcb0 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:18.800800 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:18.841013 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26647cf-87ee-4c69-8586-7963b4235f08 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:18.855084 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:18.874121 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d9c8f-23e0-407b-8390-4dca2489dcb0 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:18.879096 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c4a96-9be4-44ce-81a5-5511d134fb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:18.879760 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c4a96-9be4-44ce-81a5-5511d134fb3f None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:18.880041 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c4a96-9be4-44ce-81a5-5511d134fb3f None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:18.880315 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c4a96-9be4-44ce-81a5-5511d134fb3f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:18.891655 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c4a96-9be4-44ce-81a5-5511d134fb3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:18.896735 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-e39c4a96-9be4-44ce-81a5-5511d134fb3f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:05:18.896735 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:18.896735 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:18.896735 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:18.896735 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:18.896735 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:18.896735 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:18.896735 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:18.896735 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:18.896735 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:18.896735 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:18.896735 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:18.896735 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:18.896735 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:18.896735 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:18.896735 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:18.897645 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:18.897645 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:18.897645 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:18.897645 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:18.897645 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:18.897645 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:18.897645 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:18.897645 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:18.897645 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:18.897645 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:18.897645 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:18.897645 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:18.897645 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:18.897645 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:18.897645 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:18.897645 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:18.898438 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:18.898438 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:18.898438 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:18.898438 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:18.898438 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:18.898438 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:18.898438 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:18.898438 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:18.898438 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:18.898438 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:18.898438 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:05:18.898438 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:18.898438 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 153/302] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:05:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:18.899995 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c4a96-9be4-44ce-81a5-5511d134fb3f None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:18.918064 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b3ac0-efd0-4c57-aa20-88c358296ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:18.918860 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b3ac0-efd0-4c57-aa20-88c358296ceb None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:18.919144 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b3ac0-efd0-4c57-aa20-88c358296ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:18.919741 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b3ac0-efd0-4c57-aa20-88c358296ceb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:18.920858 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b3ac0-efd0-4c57-aa20-88c358296ceb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:18.922706 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b3ac0-efd0-4c57-aa20-88c358296ceb None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:18.929629 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 150/303] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:05:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:18.929629 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b3ac0-efd0-4c57-aa20-88c358296ceb None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:19.009561 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c4a96-9be4-44ce-81a5-5511d134fb3f None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:19.028128 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b3ac0-efd0-4c57-aa20-88c358296ceb None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:19.031190 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:19.044628 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0e188-5143-49ba-9670-0d8e08194bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:19.046890 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0e188-5143-49ba-9670-0d8e08194bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:19.047176 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0e188-5143-49ba-9670-0d8e08194bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:19.047494 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0e188-5143-49ba-9670-0d8e08194bb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:19.049044 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0e188-5143-49ba-9670-0d8e08194bb3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:19.050094 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0e188-5143-49ba-9670-0d8e08194bb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:19.051949 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0e188-5143-49ba-9670-0d8e08194bb3 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:19.069075 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 154/304] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 02:05:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:19.069981 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0e188-5143-49ba-9670-0d8e08194bb3 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:19.070812 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c923b7-a700-48ea-bf08-0e508c18c79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:19.071472 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c923b7-a700-48ea-bf08-0e508c18c79f None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:19.071752 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c923b7-a700-48ea-bf08-0e508c18c79f None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:19.072023 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c923b7-a700-48ea-bf08-0e508c18c79f None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:19.072677 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c923b7-a700-48ea-bf08-0e508c18c79f None admin] RBAC: Adding query filter params (name=member) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:19.072983 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c923b7-a700-48ea-bf08-0e508c18c79f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:19.074332 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c923b7-a700-48ea-bf08-0e508c18c79f None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:19.082562 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 151/305] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 02:05:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:19.083583 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c923b7-a700-48ea-bf08-0e508c18c79f None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:19.098905 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:19.175039 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0e188-5143-49ba-9670-0d8e08194bb3 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:19.187595 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c923b7-a700-48ea-bf08-0e508c18c79f None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:19.210721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc6167-0bf7-4254-9bb1-ae357c0c7545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:19.211544 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc6167-0bf7-4254-9bb1-ae357c0c7545 None admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:19.212524 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc6167-0bf7-4254-9bb1-ae357c0c7545 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:19.212810 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc6167-0bf7-4254-9bb1-ae357c0c7545 None admin] PATH_INFO: `/v3/groups` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:19.213426 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc6167-0bf7-4254-9bb1-ae357c0c7545 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:19.214989 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc6167-0bf7-4254-9bb1-ae357c0c7545 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:19.220324 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603add1-8ac0-4174-b910-9d815f4b705d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:19.220951 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603add1-8ac0-4174-b910-9d815f4b705d None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:19.221231 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603add1-8ac0-4174-b910-9d815f4b705d None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:19.221503 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603add1-8ac0-4174-b910-9d815f4b705d None admin] PATH_INFO: `/v3/users/c849296915174e978ca003ac72a59a9e` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:19.234855 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603add1-8ac0-4174-b910-9d815f4b705d None admin] RBAC: Authorizing `identity:get_user(user_id=c849296915174e978ca003ac72a59a9e)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:19.236333 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603add1-8ac0-4174-b910-9d815f4b705d None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:19.237996 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 152/306] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:05:19 2022] GET /identity/v3/users/c849296915174e978ca003ac72a59a9e => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:19.239086 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603add1-8ac0-4174-b910-9d815f4b705d None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:19.267134 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 155/307] 10.222.0.23 () {60 vars in 1134 bytes} [Mon Aug 8 02:05:19 2022] POST /identity/v3/groups => generated 229 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:05:19.268044 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc6167-0bf7-4254-9bb1-ae357c0c7545 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:19.326694 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:19.339651 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:19.367536 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603add1-8ac0-4174-b910-9d815f4b705d None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:19.419988 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55fdf0-3bb0-4808-bedc-2d208962cb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:19.421161 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55fdf0-3bb0-4808-bedc-2d208962cb1e None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:19.421724 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55fdf0-3bb0-4808-bedc-2d208962cb1e None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:19.422195 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55fdf0-3bb0-4808-bedc-2d208962cb1e None admin] PATH_INFO: `/v3/users/7428d87c8c734362b999b7aa2dc5809b` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:19.423752 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55fdf0-3bb0-4808-bedc-2d208962cb1e None admin] RBAC: Authorizing `identity:get_user(user_id=7428d87c8c734362b999b7aa2dc5809b)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:19.425723 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55fdf0-3bb0-4808-bedc-2d208962cb1e None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:19.432878 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc6167-0bf7-4254-9bb1-ae357c0c7545 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:19.433230 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 153/308] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:05:19 2022] GET /identity/v3/users/7428d87c8c734362b999b7aa2dc5809b => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:19.435486 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55fdf0-3bb0-4808-bedc-2d208962cb1e None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:19.479858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da7a02-0028-48eb-a818-294578df9bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:19.480825 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da7a02-0028-48eb-a818-294578df9bad None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:19.481304 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da7a02-0028-48eb-a818-294578df9bad None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:19.481771 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da7a02-0028-48eb-a818-294578df9bad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:19.482684 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da7a02-0028-48eb-a818-294578df9bad None admin] RBAC: Adding query filter params (role.id=961f87b1da8444afb55ea38aa7005933, user.id=c849296915174e978ca003ac72a59a9e, scope.system=all) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:19.483169 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da7a02-0028-48eb-a818-294578df9bad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:19.484796 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da7a02-0028-48eb-a818-294578df9bad None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:19.494062 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 156/309] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Aug 8 02:05:19 2022] GET /identity/v3/role_assignments?user.id=c849296915174e978ca003ac72a59a9e&scope.system=all&role.id=961f87b1da8444afb55ea38aa7005933 => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:19.560093 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55fdf0-3bb0-4808-bedc-2d208962cb1e None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:19.602087 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec32bc-d4f9-4adc-88f4-258c77bba22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:19.603644 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec32bc-d4f9-4adc-88f4-258c77bba22e None admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:19.604168 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec32bc-d4f9-4adc-88f4-258c77bba22e None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:19.604620 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec32bc-d4f9-4adc-88f4-258c77bba22e None admin] PATH_INFO: `/v3/system/users/7428d87c8c734362b999b7aa2dc5809b/roles/5691bce246d6452990f13933e19f2825` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:19.606307 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec32bc-d4f9-4adc-88f4-258c77bba22e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7428d87c8c734362b999b7aa2dc5809b, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:19.607943 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec32bc-d4f9-4adc-88f4-258c77bba22e None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:19.612122 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:19.709956 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 154/310] 10.222.0.23 () {58 vars in 1334 bytes} [Mon Aug 8 02:05:19 2022] PUT /identity/v3/system/users/7428d87c8c734362b999b7aa2dc5809b/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:05:20.205803 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f410f8-7ad6-468e-abfa-3b9a427efa09 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:20.206321 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f410f8-7ad6-468e-abfa-3b9a427efa09 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:20.206395 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f410f8-7ad6-468e-abfa-3b9a427efa09 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:20.207955 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 157/311] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:20.213813 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac18029-fe20-439c-bb21-77506013f76e None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:20.214211 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac18029-fe20-439c-bb21-77506013f76e None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:20.214377 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac18029-fe20-439c-bb21-77506013f76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:20.232592 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-eac18029-fe20-439c-bb21-77506013f76e None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:20.233791 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-eac18029-fe20-439c-bb21-77506013f76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:20.307003 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 155/312] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:20.328801 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f410f8-7ad6-468e-abfa-3b9a427efa09 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:20.439809 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f410f8-7ad6-468e-abfa-3b9a427efa09 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:20.449741 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:20.474558 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4535b7-4f6c-4a08-981a-62653d927bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:20.475112 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4535b7-4f6c-4a08-981a-62653d927bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:20.475411 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4535b7-4f6c-4a08-981a-62653d927bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:20.475739 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4535b7-4f6c-4a08-981a-62653d927bb6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:20.486659 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4535b7-4f6c-4a08-981a-62653d927bb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:20.491632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-7c4535b7-4f6c-4a08-981a-62653d927bb6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:05:20.491632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:20.491632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:20.491632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:20.491632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:20.491632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:20.491632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:20.491632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:20.491632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:20.491632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:20.491632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:20.491632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:20.491632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:20.491632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:20.491632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:20.491632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:20.492520 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:20.492520 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:20.492520 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:20.492520 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:20.492520 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:20.492520 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:20.492520 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:20.492520 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:20.492520 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:20.492520 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:20.492520 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:20.492520 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:20.492520 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:20.492520 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:20.492520 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:20.492520 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:20.493349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:20.493349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:20.493349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:20.493349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:20.493349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:20.493349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:20.493349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:20.493349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:20.493349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:20.493349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:20.493349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:05:20.493349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:20.496331 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 158/313] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:05:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:20.501583 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac18029-fe20-439c-bb21-77506013f76e None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:20.607312 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac18029-fe20-439c-bb21-77506013f76e None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:20.638957 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:20.645251 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3990e16-021f-424b-9825-22925c7c56b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:20.645858 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3990e16-021f-424b-9825-22925c7c56b0 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:20.646138 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3990e16-021f-424b-9825-22925c7c56b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:20.646414 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3990e16-021f-424b-9825-22925c7c56b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:20.647077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3990e16-021f-424b-9825-22925c7c56b0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:20.647469 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3990e16-021f-424b-9825-22925c7c56b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:20.649183 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3990e16-021f-424b-9825-22925c7c56b0 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:20.659023 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 156/314] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 02:05:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:20.664498 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4535b7-4f6c-4a08-981a-62653d927bb6 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:20.768604 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4535b7-4f6c-4a08-981a-62653d927bb6 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:20.802184 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d503b9a-b3d7-44dc-8ec3-a4bfd604892e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:20.802808 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d503b9a-b3d7-44dc-8ec3-a4bfd604892e None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:20.803134 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d503b9a-b3d7-44dc-8ec3-a4bfd604892e None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:20.803434 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d503b9a-b3d7-44dc-8ec3-a4bfd604892e None admin] PATH_INFO: `/v3/users/8bd3af0606ec4716b6d376d990797e35` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:20.804589 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d503b9a-b3d7-44dc-8ec3-a4bfd604892e None admin] RBAC: Authorizing `identity:get_user(user_id=8bd3af0606ec4716b6d376d990797e35)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:20.806788 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d503b9a-b3d7-44dc-8ec3-a4bfd604892e None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:20.808551 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 159/315] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:05:20 2022] GET /identity/v3/users/8bd3af0606ec4716b6d376d990797e35 => generated 297 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:20.815188 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3990e16-021f-424b-9825-22925c7c56b0 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:20.924303 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3990e16-021f-424b-9825-22925c7c56b0 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:20.961729 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c3003-1992-44be-9b7a-2555c132838e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:20.962959 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c3003-1992-44be-9b7a-2555c132838e None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:20.963244 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c3003-1992-44be-9b7a-2555c132838e None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:20.963546 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c3003-1992-44be-9b7a-2555c132838e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:21.036325 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:21.046606 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c3003-1992-44be-9b7a-2555c132838e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:21.048104 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c3003-1992-44be-9b7a-2555c132838e None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:21.153466 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 157/316] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:05:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:05:21.159081 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d503b9a-b3d7-44dc-8ec3-a4bfd604892e None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:21.199242 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:21.264923 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d503b9a-b3d7-44dc-8ec3-a4bfd604892e None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:21.298842 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16514b-2d41-4599-a5be-54df6a1567d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:21.299411 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16514b-2d41-4599-a5be-54df6a1567d1 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:21.299693 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16514b-2d41-4599-a5be-54df6a1567d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:21.299963 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16514b-2d41-4599-a5be-54df6a1567d1 None admin] PATH_INFO: `/v3/projects/f15701875ea24854a2a23f51fa4c6364` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:21.301070 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c16514b-2d41-4599-a5be-54df6a1567d1 None admin] RBAC: Authorizing `identity:get_project(project_id=f15701875ea24854a2a23f51fa4c6364)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:21.302502 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c16514b-2d41-4599-a5be-54df6a1567d1 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:21.304443 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 160/317] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:05:21 2022] GET /identity/v3/projects/f15701875ea24854a2a23f51fa4c6364 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:21.310880 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c3003-1992-44be-9b7a-2555c132838e None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:21.410933 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:21.421084 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c3003-1992-44be-9b7a-2555c132838e None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:21.456070 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0384c8-2f81-4f5b-95d3-a5487d049f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:21.456908 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0384c8-2f81-4f5b-95d3-a5487d049f59 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:21.457327 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0384c8-2f81-4f5b-95d3-a5487d049f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:21.457739 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0384c8-2f81-4f5b-95d3-a5487d049f59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:21.458626 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0384c8-2f81-4f5b-95d3-a5487d049f59 None admin] RBAC: Adding query filter params (role.id=961f87b1da8444afb55ea38aa7005933, scope.project.id=f15701875ea24854a2a23f51fa4c6364, user.id=8bd3af0606ec4716b6d376d990797e35) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:21.459126 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0384c8-2f81-4f5b-95d3-a5487d049f59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:21.460749 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0384c8-2f81-4f5b-95d3-a5487d049f59 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:21.467821 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 158/318] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:05:21 2022] GET /identity/v3/role_assignments?user.id=8bd3af0606ec4716b6d376d990797e35&scope.project.id=f15701875ea24854a2a23f51fa4c6364&role.id=961f87b1da8444afb55ea38aa7005933 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:21.492456 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50825ee-1c76-4705-a3a7-edcc284f5127 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:21.493039 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50825ee-1c76-4705-a3a7-edcc284f5127 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:21.493453 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50825ee-1c76-4705-a3a7-edcc284f5127 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:21.495066 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 161/319] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:21.501101 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb7eb9-06c0-4b39-b383-c36b0722f41e None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:21.501611 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb7eb9-06c0-4b39-b383-c36b0722f41e None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:21.502052 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb7eb9-06c0-4b39-b383-c36b0722f41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:21.521507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-44fb7eb9-06c0-4b39-b383-c36b0722f41e None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:21.523019 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-44fb7eb9-06c0-4b39-b383-c36b0722f41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:21.565002 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695a8be-3323-463d-9666-ec60fed8d5bc None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:21.565002 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695a8be-3323-463d-9666-ec60fed8d5bc None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:21.565002 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695a8be-3323-463d-9666-ec60fed8d5bc None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:21.566483 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 162/320] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:05:21.572208 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e217b4-247e-4f24-a843-23bf407f2541 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:21.572491 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e217b4-247e-4f24-a843-23bf407f2541 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:21.572767 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e217b4-247e-4f24-a843-23bf407f2541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:21.592731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-11e217b4-247e-4f24-a843-23bf407f2541 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:21.593965 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-11e217b4-247e-4f24-a843-23bf407f2541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:21.605453 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 159/321] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:21.627871 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb7eb9-06c0-4b39-b383-c36b0722f41e None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:21.691828 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 163/322] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:05:21.716530 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e217b4-247e-4f24-a843-23bf407f2541 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:21.746061 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:21.758436 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:21.762803 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb7eb9-06c0-4b39-b383-c36b0722f41e None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:21.797564 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d91b81-455a-4fc1-8dfa-b05af3cad10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:21.798188 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d91b81-455a-4fc1-8dfa-b05af3cad10d None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:21.798464 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d91b81-455a-4fc1-8dfa-b05af3cad10d None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:21.798736 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d91b81-455a-4fc1-8dfa-b05af3cad10d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:21.799856 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d91b81-455a-4fc1-8dfa-b05af3cad10d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:21.801289 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d91b81-455a-4fc1-8dfa-b05af3cad10d None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:21.803005 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 160/323] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:05:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:05:21.809485 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d91b81-455a-4fc1-8dfa-b05af3cad10d None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:21.832707 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e217b4-247e-4f24-a843-23bf407f2541 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:21.871965 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2543f38-0a8b-4c45-9bae-a963a614b5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:21.872924 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2543f38-0a8b-4c45-9bae-a963a614b5f0 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:21.873207 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2543f38-0a8b-4c45-9bae-a963a614b5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:21.873485 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2543f38-0a8b-4c45-9bae-a963a614b5f0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:21.883425 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2543f38-0a8b-4c45-9bae-a963a614b5f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:21.888556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-e2543f38-0a8b-4c45-9bae-a963a614b5f0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:05:21.888556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:21.888556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:21.888556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:21.888556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:21.888556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:21.888556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:21.888556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:21.888556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:21.888556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:21.888556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:21.888556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:21.888556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:21.888556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:21.888556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:21.888556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:21.889410 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:21.889410 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:21.889410 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:21.889410 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:21.889410 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:21.889410 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:21.889410 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:21.889410 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:21.889410 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:21.889410 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:21.889410 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:21.889410 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:21.889410 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:21.889410 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:21.889410 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:21.889410 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:21.895559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:21.895559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:21.895559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:21.895559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:21.895559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:21.895559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:21.895559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:21.895559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:21.895559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:21.895559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:21.895559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:05:21.895559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:21.895559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 164/324] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:05:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:05:21.895559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ece623-7ac0-466c-8a28-17d7c391bad5 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:21.896636 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ece623-7ac0-466c-8a28-17d7c391bad5 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:21.896636 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ece623-7ac0-466c-8a28-17d7c391bad5 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:21.896636 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 165/325] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:21.896636 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ece623-7ac0-466c-8a28-17d7c391bad5 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:21.913308 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d91b81-455a-4fc1-8dfa-b05af3cad10d None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:21.946791 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcaa389-c7fe-4496-a29b-c944b128e9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:21.947168 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcaa389-c7fe-4496-a29b-c944b128e9f8 None admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:21.947479 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcaa389-c7fe-4496-a29b-c944b128e9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:21.947757 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcaa389-c7fe-4496-a29b-c944b128e9f8 None admin] PATH_INFO: `/v3/groups` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:21.948374 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcaa389-c7fe-4496-a29b-c944b128e9f8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:21.949784 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcaa389-c7fe-4496-a29b-c944b128e9f8 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:21.989606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:21.996650 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ece623-7ac0-466c-8a28-17d7c391bad5 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:22.009613 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 161/326] 10.222.0.23 () {60 vars in 1134 bytes} [Mon Aug 8 02:05:21 2022] POST /identity/v3/groups => generated 226 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:05:22.010834 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb703100-a7ec-4a52-8056-e6299603d0f4 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:22.011125 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb703100-a7ec-4a52-8056-e6299603d0f4 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:22.011459 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb703100-a7ec-4a52-8056-e6299603d0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:22.030326 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-cb703100-a7ec-4a52-8056-e6299603d0f4 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:22.031597 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-cb703100-a7ec-4a52-8056-e6299603d0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:22.038419 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f6d37-790a-46c8-a18c-b45550f6a493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:22.039053 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f6d37-790a-46c8-a18c-b45550f6a493 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:22.039371 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f6d37-790a-46c8-a18c-b45550f6a493 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:22.039642 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f6d37-790a-46c8-a18c-b45550f6a493 None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:22.040346 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f6d37-790a-46c8-a18c-b45550f6a493 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:22.041367 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f6d37-790a-46c8-a18c-b45550f6a493 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:22.042124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f6d37-790a-46c8-a18c-b45550f6a493 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:22.044140 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:22.057490 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 166/327] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 02:05:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:22.058709 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f6d37-790a-46c8-a18c-b45550f6a493 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:22.115162 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 162/328] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:22.139119 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb703100-a7ec-4a52-8056-e6299603d0f4 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:22.176642 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f6d37-790a-46c8-a18c-b45550f6a493 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:22.215827 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40346d04-e7ed-4ff2-87da-617ec186616a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:22.216909 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40346d04-e7ed-4ff2-87da-617ec186616a None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:22.217199 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40346d04-e7ed-4ff2-87da-617ec186616a None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:22.217474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40346d04-e7ed-4ff2-87da-617ec186616a None admin] PATH_INFO: `/v3/users/c849296915174e978ca003ac72a59a9e` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:22.218630 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40346d04-e7ed-4ff2-87da-617ec186616a None admin] RBAC: Authorizing `identity:get_user(user_id=c849296915174e978ca003ac72a59a9e)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:22.220154 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40346d04-e7ed-4ff2-87da-617ec186616a None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:22.221741 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 167/329] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:05:22 2022] GET /identity/v3/users/c849296915174e978ca003ac72a59a9e => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:05:22.227784 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40346d04-e7ed-4ff2-87da-617ec186616a None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:22.251558 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb703100-a7ec-4a52-8056-e6299603d0f4 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:22.258250 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:22.293885 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee1011-895f-410d-82b1-eea6d4f849f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:22.294579 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee1011-895f-410d-82b1-eea6d4f849f7 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:22.294869 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee1011-895f-410d-82b1-eea6d4f849f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:22.295185 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee1011-895f-410d-82b1-eea6d4f849f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:22.307389 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee1011-895f-410d-82b1-eea6d4f849f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:22.311757 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-1bee1011-895f-410d-82b1-eea6d4f849f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:05:22.311757 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:22.311757 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:22.311757 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:22.311757 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:22.311757 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:22.311757 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:22.311757 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:22.311757 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:22.311757 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:22.311757 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:22.311757 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:22.311757 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:22.311757 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:22.311757 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:22.311757 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:22.313032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:22.313032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:22.313032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:22.313032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:22.313032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:22.313032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:22.313032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:22.313032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:22.313032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:22.313032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:22.313032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:22.313032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:22.313032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:22.313032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:22.313032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:22.313032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:22.314388 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:22.314388 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:22.314388 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:22.314388 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:22.314388 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:22.314388 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:22.314388 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:22.314388 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:22.314388 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:22.314388 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:22.314388 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:05:22.314388 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:22.314388 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 163/330] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:05:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:05:22.319163 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee1011-895f-410d-82b1-eea6d4f849f7 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:22.324115 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:22.359485 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40346d04-e7ed-4ff2-87da-617ec186616a None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:22.402903 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886cf569-0d05-4308-bc6b-b4170cf0f6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:22.403779 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cf569-0d05-4308-bc6b-b4170cf0f6e3 None admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:22.404219 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cf569-0d05-4308-bc6b-b4170cf0f6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:22.404323 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cf569-0d05-4308-bc6b-b4170cf0f6e3 None admin] PATH_INFO: `/v3/system/users/c849296915174e978ca003ac72a59a9e/roles/961f87b1da8444afb55ea38aa7005933` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:22.405738 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886cf569-0d05-4308-bc6b-b4170cf0f6e3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c849296915174e978ca003ac72a59a9e, role_id=961f87b1da8444afb55ea38aa7005933)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:22.407129 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886cf569-0d05-4308-bc6b-b4170cf0f6e3 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:22.441649 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee1011-895f-410d-82b1-eea6d4f849f7 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:22.479698 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf69ed8-9805-4d9d-9ce7-0c776e9b63e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:22.480654 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf69ed8-9805-4d9d-9ce7-0c776e9b63e2 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:22.480936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf69ed8-9805-4d9d-9ce7-0c776e9b63e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:22.481207 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf69ed8-9805-4d9d-9ce7-0c776e9b63e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:22.481874 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf69ed8-9805-4d9d-9ce7-0c776e9b63e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:22.482229 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf69ed8-9805-4d9d-9ce7-0c776e9b63e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:22.483605 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf69ed8-9805-4d9d-9ce7-0c776e9b63e2 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:22.485300 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 168/331] 10.222.0.23 () {58 vars in 1334 bytes} [Mon Aug 8 02:05:22 2022] PUT /identity/v3/system/users/c849296915174e978ca003ac72a59a9e/roles/961f87b1da8444afb55ea38aa7005933 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:05:22.496978 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 164/332] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 02:05:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:05:22.503603 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886cf569-0d05-4308-bc6b-b4170cf0f6e3 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:22.610504 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:22.623843 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886cf569-0d05-4308-bc6b-b4170cf0f6e3 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:22.662813 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4cbbc-988a-4fc8-ab53-a6859860a24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:22.663511 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4cbbc-988a-4fc8-ab53-a6859860a24c None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:22.663798 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4cbbc-988a-4fc8-ab53-a6859860a24c None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:22.664079 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4cbbc-988a-4fc8-ab53-a6859860a24c None admin] PATH_INFO: `/v3/users/7428d87c8c734362b999b7aa2dc5809b` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:22.665837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c4cbbc-988a-4fc8-ab53-a6859860a24c None admin] RBAC: Authorizing `identity:get_user(user_id=7428d87c8c734362b999b7aa2dc5809b)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:22.667296 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c4cbbc-988a-4fc8-ab53-a6859860a24c None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:22.669227 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 169/333] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:05:22 2022] GET /identity/v3/users/7428d87c8c734362b999b7aa2dc5809b => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:22.675139 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf69ed8-9805-4d9d-9ce7-0c776e9b63e2 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:22.746397 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:22.785070 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf69ed8-9805-4d9d-9ce7-0c776e9b63e2 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:22.827860 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8867b-d6bc-4d44-85b3-f72c3df0f9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:22.828495 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8867b-d6bc-4d44-85b3-f72c3df0f9ca None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:22.828821 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8867b-d6bc-4d44-85b3-f72c3df0f9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:22.829100 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8867b-d6bc-4d44-85b3-f72c3df0f9ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:22.829844 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8867b-d6bc-4d44-85b3-f72c3df0f9ca None admin] RBAC: Adding query filter params (role.id=5691bce246d6452990f13933e19f2825, user.id=7428d87c8c734362b999b7aa2dc5809b, scope.system=all) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:22.830163 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8867b-d6bc-4d44-85b3-f72c3df0f9ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:22.831632 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8867b-d6bc-4d44-85b3-f72c3df0f9ca None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:22.845365 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 165/334] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Aug 8 02:05:22 2022] GET /identity/v3/role_assignments?user.id=7428d87c8c734362b999b7aa2dc5809b&scope.system=all&role.id=5691bce246d6452990f13933e19f2825 => generated 510 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:24.315505 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b81f2-5b25-4a6b-b9f0-d6996c70315f None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:24.316017 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b81f2-5b25-4a6b-b9f0-d6996c70315f None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:24.316091 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b81f2-5b25-4a6b-b9f0-d6996c70315f None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:24.317855 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 170/335] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:24.324189 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813b9e4-c8d1-42a2-8366-6c3a6bc6fbe3 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:24.324653 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813b9e4-c8d1-42a2-8366-6c3a6bc6fbe3 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:24.324727 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813b9e4-c8d1-42a2-8366-6c3a6bc6fbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:24.344847 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-0813b9e4-c8d1-42a2-8366-6c3a6bc6fbe3 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:24.346044 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-0813b9e4-c8d1-42a2-8366-6c3a6bc6fbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:24.431509 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 166/336] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:24.475807 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b81f2-5b25-4a6b-b9f0-d6996c70315f None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:24.600112 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b81f2-5b25-4a6b-b9f0-d6996c70315f None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:24.645820 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887fc2f5-2743-42db-9ebc-65fb35b09851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:24.646511 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fc2f5-2743-42db-9ebc-65fb35b09851 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:24.646800 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fc2f5-2743-42db-9ebc-65fb35b09851 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:24.647080 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fc2f5-2743-42db-9ebc-65fb35b09851 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:24.662815 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887fc2f5-2743-42db-9ebc-65fb35b09851 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:24.667988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-887fc2f5-2743-42db-9ebc-65fb35b09851 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:05:24.667988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:24.667988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:24.667988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:24.667988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:24.667988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:24.667988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:24.667988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:24.667988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:24.667988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:24.667988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:24.667988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:24.667988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:24.667988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:24.667988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:24.667988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:24.668837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:24.668837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:24.668837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:24.668837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:24.668837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:24.668837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:24.668837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:24.668837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:24.668837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:24.668837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:24.668837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:24.668837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:24.668837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:24.668837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:24.668837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:24.668837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:24.669598 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:24.669598 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:24.669598 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:24.669598 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:24.669598 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:24.669598 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:24.669598 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:24.669598 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:24.669598 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:24.669598 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:24.669598 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:05:24.669598 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:24.669598 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 171/337] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:05:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:24.676660 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813b9e4-c8d1-42a2-8366-6c3a6bc6fbe3 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:24.750460 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:24.802692 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813b9e4-c8d1-42a2-8366-6c3a6bc6fbe3 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:24.831536 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ed6f4-bc37-47a0-88a5-7ab6c34b155c None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:24.831851 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ed6f4-bc37-47a0-88a5-7ab6c34b155c None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:24.832105 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ed6f4-bc37-47a0-88a5-7ab6c34b155c None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:24.833801 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 172/338] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:24.838650 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1be36-de1b-4ce0-9de0-d9426533a8a1 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:24.838935 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1be36-de1b-4ce0-9de0-d9426533a8a1 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:24.839215 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1be36-de1b-4ce0-9de0-d9426533a8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:24.848109 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3a311-380c-4cba-a80a-87b3eb0d201d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:24.848707 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3a311-380c-4cba-a80a-87b3eb0d201d None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:24.848991 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3a311-380c-4cba-a80a-87b3eb0d201d None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:24.849268 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3a311-380c-4cba-a80a-87b3eb0d201d None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:24.849934 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3a311-380c-4cba-a80a-87b3eb0d201d None admin] RBAC: Adding query filter params (name=member) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:24.850289 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3a311-380c-4cba-a80a-87b3eb0d201d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:24.851625 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3a311-380c-4cba-a80a-87b3eb0d201d None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:24.864679 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 167/339] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 02:05:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:24.870247 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3a311-380c-4cba-a80a-87b3eb0d201d None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:24.872442 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-42a1be36-de1b-4ce0-9de0-d9426533a8a1 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:24.873986 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-42a1be36-de1b-4ce0-9de0-d9426533a8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:24.899728 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:24.992190 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 173/340] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:24.993237 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3a311-380c-4cba-a80a-87b3eb0d201d None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:24.993556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345960d-b8bd-488f-93e5-cc6adbb78189 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:24.993848 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345960d-b8bd-488f-93e5-cc6adbb78189 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:24.994149 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345960d-b8bd-488f-93e5-cc6adbb78189 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:24.995633 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 174/341] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:25.004034 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33c42f-2d9c-4f70-b99a-d5f0eea983fd None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:25.004354 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33c42f-2d9c-4f70-b99a-d5f0eea983fd None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:25.004715 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33c42f-2d9c-4f70-b99a-d5f0eea983fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:25.010913 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:25.032012 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d6b72-1b63-4190-802c-e8583264615f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:25.032631 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d6b72-1b63-4190-802c-e8583264615f None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:25.032917 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d6b72-1b63-4190-802c-e8583264615f None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:25.033244 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d6b72-1b63-4190-802c-e8583264615f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:25.037756 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-5d33c42f-2d9c-4f70-b99a-d5f0eea983fd None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:25.038990 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-5d33c42f-2d9c-4f70-b99a-d5f0eea983fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:25.124637 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d6b72-1b63-4190-802c-e8583264615f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:25.126029 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d6b72-1b63-4190-802c-e8583264615f None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:25.163564 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 175/342] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:05:25.166047 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d33c42f-2d9c-4f70-b99a-d5f0eea983fd None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:25.250601 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 168/343] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:05:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:05:25.251853 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d6b72-1b63-4190-802c-e8583264615f None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:25.270657 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:25.279594 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:25.296842 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d33c42f-2d9c-4f70-b99a-d5f0eea983fd None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:25.337723 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd264d3-455a-4fa5-9e7a-9f9fd7fd052d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:25.338524 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd264d3-455a-4fa5-9e7a-9f9fd7fd052d None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:25.338971 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd264d3-455a-4fa5-9e7a-9f9fd7fd052d None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:25.339840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd264d3-455a-4fa5-9e7a-9f9fd7fd052d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:25.351420 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd264d3-455a-4fa5-9e7a-9f9fd7fd052d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:25.356721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-2cd264d3-455a-4fa5-9e7a-9f9fd7fd052d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:05:25.356721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:25.356721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:25.356721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:25.356721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:25.356721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:25.356721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:25.356721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:25.356721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:25.356721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:25.356721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:25.356721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:25.356721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:25.356721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:25.356721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:25.356721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:25.357600 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:25.357600 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:25.357600 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:25.357600 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:25.357600 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:25.357600 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:25.357600 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:25.357600 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:25.357600 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:25.357600 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:25.357600 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:25.357600 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:25.357600 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:25.357600 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:25.357600 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:25.357600 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:25.358623 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:25.358623 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:25.358623 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:25.358623 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:25.358623 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:25.358623 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:25.358623 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:25.358623 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:25.358623 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:25.358623 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:25.358623 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 02:05:25.358623 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:25.358623 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 176/344] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:05:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:25.360184 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd264d3-455a-4fa5-9e7a-9f9fd7fd052d None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:25.391702 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d6b72-1b63-4190-802c-e8583264615f None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:25.440853 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c7e284-9afd-4e31-92a6-cb5cfb6afd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:25.441738 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7e284-9afd-4e31-92a6-cb5cfb6afd2b None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:25.442286 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7e284-9afd-4e31-92a6-cb5cfb6afd2b None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:25.442705 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7e284-9afd-4e31-92a6-cb5cfb6afd2b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:25.457106 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c7e284-9afd-4e31-92a6-cb5cfb6afd2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:25.464255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-55c7e284-9afd-4e31-92a6-cb5cfb6afd2b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:05:25.464255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:25.464255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:25.464255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:25.464255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:25.464255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:25.464255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:25.464255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:25.464255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:25.464255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:25.464255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:25.464255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:25.464255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:25.464255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:25.464255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:25.464255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:25.465380 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:25.465380 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:25.465380 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:25.465380 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:25.465380 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:25.465380 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:25.465380 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:25.465380 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:25.465380 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:25.465380 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:25.465380 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:25.465380 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:25.465380 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:25.465380 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:25.465380 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:25.465380 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:25.466433 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:25.466433 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:25.466433 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:25.466433 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:25.466433 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:25.466433 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:25.466433 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:25.466433 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:25.466433 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:25.466433 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:25.466433 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:05:25.466433 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:25.469313 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 169/345] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 02:05:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:25.470333 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c7e284-9afd-4e31-92a6-cb5cfb6afd2b None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:25.485615 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd264d3-455a-4fa5-9e7a-9f9fd7fd052d None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:25.529971 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2152e-612a-4843-900b-8e44ecd29e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:25.530826 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2152e-612a-4843-900b-8e44ecd29e65 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:25.531214 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2152e-612a-4843-900b-8e44ecd29e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:25.531783 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2152e-612a-4843-900b-8e44ecd29e65 None admin] PATH_INFO: `/v3/projects/265f4aa2137047adb6e3cdec9bd23b99` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:25.533161 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2152e-612a-4843-900b-8e44ecd29e65 None admin] RBAC: Authorizing `identity:get_project(project_id=265f4aa2137047adb6e3cdec9bd23b99)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:25.534573 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2152e-612a-4843-900b-8e44ecd29e65 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:25.536638 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 177/346] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:05:25 2022] GET /identity/v3/projects/265f4aa2137047adb6e3cdec9bd23b99 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:25.537375 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2152e-612a-4843-900b-8e44ecd29e65 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:25.545369 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:25.570858 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:25.599462 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c7e284-9afd-4e31-92a6-cb5cfb6afd2b None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:25.644329 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28b96d-ccb8-4953-833a-cbe9d3258410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:25.645389 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28b96d-ccb8-4953-833a-cbe9d3258410 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:25.645833 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28b96d-ccb8-4953-833a-cbe9d3258410 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:25.646374 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28b96d-ccb8-4953-833a-cbe9d3258410 None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:25.647181 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28b96d-ccb8-4953-833a-cbe9d3258410 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:25.647657 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28b96d-ccb8-4953-833a-cbe9d3258410 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:25.649804 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28b96d-ccb8-4953-833a-cbe9d3258410 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:25.654022 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2152e-612a-4843-900b-8e44ecd29e65 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:25.660919 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 170/347] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 02:05:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:25.662394 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28b96d-ccb8-4953-833a-cbe9d3258410 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:25.692323 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97545fbd-45d8-4466-be25-bee9888153eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:25.693113 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97545fbd-45d8-4466-be25-bee9888153eb None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:25.693478 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97545fbd-45d8-4466-be25-bee9888153eb None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:25.693883 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97545fbd-45d8-4466-be25-bee9888153eb None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:25.694680 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97545fbd-45d8-4466-be25-bee9888153eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:25.697667 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97545fbd-45d8-4466-be25-bee9888153eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:25.699183 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97545fbd-45d8-4466-be25-bee9888153eb None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:25.709364 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 178/348] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:05:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:25.710295 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97545fbd-45d8-4466-be25-bee9888153eb None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:25.789276 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:25.803770 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28b96d-ccb8-4953-833a-cbe9d3258410 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:25.828382 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97545fbd-45d8-4466-be25-bee9888153eb None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:25.853562 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a176a8d-db0f-4b17-969a-440a17f687fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:25.854666 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a176a8d-db0f-4b17-969a-440a17f687fe None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:25.855547 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a176a8d-db0f-4b17-969a-440a17f687fe None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:25.856499 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a176a8d-db0f-4b17-969a-440a17f687fe None admin] PATH_INFO: `/v3/groups/b5fe56a427fe4c98b5db69e35f77285f` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:25.864582 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a176a8d-db0f-4b17-969a-440a17f687fe None admin] RBAC: Authorizing `identity:get_group(group_id=b5fe56a427fe4c98b5db69e35f77285f)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:25.866432 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a176a8d-db0f-4b17-969a-440a17f687fe None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:25.866874 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab823a3-b4ab-4200-9cc6-f62ae82b9bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:25.867615 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab823a3-b4ab-4200-9cc6-f62ae82b9bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:25.868130 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab823a3-b4ab-4200-9cc6-f62ae82b9bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:25.868487 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab823a3-b4ab-4200-9cc6-f62ae82b9bb4 None admin] PATH_INFO: `/v3/users/c849296915174e978ca003ac72a59a9e` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:25.869733 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab823a3-b4ab-4200-9cc6-f62ae82b9bb4 None admin] RBAC: Authorizing `identity:get_user(user_id=c849296915174e978ca003ac72a59a9e)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:25.870009 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 171/349] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 8 02:05:25 2022] GET /identity/v3/groups/b5fe56a427fe4c98b5db69e35f77285f => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:25.871315 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab823a3-b4ab-4200-9cc6-f62ae82b9bb4 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:25.871582 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d11fe-fd51-4458-b245-578f2d284a3a None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:25.872029 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d11fe-fd51-4458-b245-578f2d284a3a None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:25.872533 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d11fe-fd51-4458-b245-578f2d284a3a None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:25.873888 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 172/350] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:25.874773 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d11fe-fd51-4458-b245-578f2d284a3a None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:25.877504 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 179/351] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:05:25 2022] GET /identity/v3/users/c849296915174e978ca003ac72a59a9e => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:25.877953 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:25.883316 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab17744-676c-42c4-82a5-7fbc15a8d1a5 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:25.884155 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab17744-676c-42c4-82a5-7fbc15a8d1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:25.884438 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab17744-676c-42c4-82a5-7fbc15a8d1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:25.903840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-dab17744-676c-42c4-82a5-7fbc15a8d1a5 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:25.904995 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-dab17744-676c-42c4-82a5-7fbc15a8d1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:25.995437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 180/352] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:25.996881 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab17744-676c-42c4-82a5-7fbc15a8d1a5 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:25.998231 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d11fe-fd51-4458-b245-578f2d284a3a None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:26.042304 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c6610-fb51-47d1-a769-d33c027a0284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:26.042937 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c6610-fb51-47d1-a769-d33c027a0284 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:26.043307 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c6610-fb51-47d1-a769-d33c027a0284 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:26.043704 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c6610-fb51-47d1-a769-d33c027a0284 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:26.076806 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:26.126314 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab17744-676c-42c4-82a5-7fbc15a8d1a5 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:26.131274 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c6610-fb51-47d1-a769-d33c027a0284 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:26.132967 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c6610-fb51-47d1-a769-d33c027a0284 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:26.143925 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:26.169584 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828a22d-3c03-45df-b8c4-ea84a03469d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:26.170554 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828a22d-3c03-45df-b8c4-ea84a03469d5 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:26.171349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828a22d-3c03-45df-b8c4-ea84a03469d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:26.171849 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828a22d-3c03-45df-b8c4-ea84a03469d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:26.173067 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828a22d-3c03-45df-b8c4-ea84a03469d5 None admin] RBAC: Adding query filter params (group.id=b5fe56a427fe4c98b5db69e35f77285f, role.id=5691bce246d6452990f13933e19f2825, scope.project.id=265f4aa2137047adb6e3cdec9bd23b99) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:26.173594 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828a22d-3c03-45df-b8c4-ea84a03469d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:26.175896 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828a22d-3c03-45df-b8c4-ea84a03469d5 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:26.183754 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 181/353] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Aug 8 02:05:25 2022] GET /identity/v3/role_assignments?group.id=b5fe56a427fe4c98b5db69e35f77285f&scope.project.id=265f4aa2137047adb6e3cdec9bd23b99&role.id=5691bce246d6452990f13933e19f2825 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:26.188928 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828a22d-3c03-45df-b8c4-ea84a03469d5 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:26.303579 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 173/354] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:05:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:05:26.304221 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c6610-fb51-47d1-a769-d33c027a0284 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:26.410976 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828a22d-3c03-45df-b8c4-ea84a03469d5 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:26.461335 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:26.473601 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca2ae4-cd58-46f1-9f97-dc069ccec8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:26.474928 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca2ae4-cd58-46f1-9f97-dc069ccec8ea None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:26.474928 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca2ae4-cd58-46f1-9f97-dc069ccec8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:26.474928 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca2ae4-cd58-46f1-9f97-dc069ccec8ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:26.475731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dca2ae4-cd58-46f1-9f97-dc069ccec8ea None admin] RBAC: Adding query filter params (role.id=961f87b1da8444afb55ea38aa7005933, user.id=c849296915174e978ca003ac72a59a9e, scope.system=all) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:26.476024 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dca2ae4-cd58-46f1-9f97-dc069ccec8ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:26.479178 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dca2ae4-cd58-46f1-9f97-dc069ccec8ea None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:26.493162 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c6610-fb51-47d1-a769-d33c027a0284 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:26.497346 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:26.503326 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 182/355] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Aug 8 02:05:26 2022] GET /identity/v3/role_assignments?user.id=c849296915174e978ca003ac72a59a9e&scope.system=all&role.id=961f87b1da8444afb55ea38aa7005933 => generated 510 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:26.504281 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca2ae4-cd58-46f1-9f97-dc069ccec8ea None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:26.588105 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a02bc9-30d4-44cd-b6bf-7ce6753cf4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:26.588764 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a02bc9-30d4-44cd-b6bf-7ce6753cf4da None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:26.589049 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a02bc9-30d4-44cd-b6bf-7ce6753cf4da None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:26.589346 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a02bc9-30d4-44cd-b6bf-7ce6753cf4da None admin] PATH_INFO: `/v3/roles/member` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:26.621262 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a02bc9-30d4-44cd-b6bf-7ce6753cf4da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:26.626130 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-18a02bc9-30d4-44cd-b6bf-7ce6753cf4da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:05:26.626130 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:26.626130 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:26.626130 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:26.626130 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:26.626130 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:26.626130 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:26.626130 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:26.626130 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:26.626130 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:26.626130 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:26.626130 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:26.626130 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:26.626130 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:26.626130 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:26.626130 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:26.627052 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:26.627052 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:26.627052 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:26.627052 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:26.627052 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:26.627052 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:26.627052 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:26.627052 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:26.627052 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:26.627052 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:26.627052 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:26.627052 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:26.627052 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:26.627052 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:26.627052 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:26.627052 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:26.628277 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:26.628277 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:26.628277 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:26.628277 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:26.628277 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:26.628277 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:26.628277 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:26.628277 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:26.628277 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:26.628277 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:26.628277 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:05:26.628277 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:26.628277 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 174/356] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:05:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:26.628929 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6299a7-f5b7-4674-8e83-d47fdce2b0fd None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:26.628929 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6299a7-f5b7-4674-8e83-d47fdce2b0fd None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:26.629066 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6299a7-f5b7-4674-8e83-d47fdce2b0fd None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:26.630376 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 175/357] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:26.636818 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87e765-9655-4b73-8654-3a088ab74cfe None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:26.637113 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87e765-9655-4b73-8654-3a088ab74cfe None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:26.637390 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87e765-9655-4b73-8654-3a088ab74cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:26.666382 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca2ae4-cd58-46f1-9f97-dc069ccec8ea None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:26.680793 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-8c87e765-9655-4b73-8654-3a088ab74cfe None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:26.682026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-8c87e765-9655-4b73-8654-3a088ab74cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:26.705799 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3106c56-2ee6-4d76-99e1-f4930e40fd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:26.706500 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3106c56-2ee6-4d76-99e1-f4930e40fd84 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:26.706765 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3106c56-2ee6-4d76-99e1-f4930e40fd84 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:26.707039 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3106c56-2ee6-4d76-99e1-f4930e40fd84 None admin] PATH_INFO: `/v3/projects/265f4aa2137047adb6e3cdec9bd23b99` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:26.708561 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3106c56-2ee6-4d76-99e1-f4930e40fd84 None admin] RBAC: Authorizing `identity:get_project(project_id=265f4aa2137047adb6e3cdec9bd23b99)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:26.710028 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3106c56-2ee6-4d76-99e1-f4930e40fd84 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:26.711955 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 183/358] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:05:26 2022] GET /identity/v3/projects/265f4aa2137047adb6e3cdec9bd23b99 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:26.712693 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3106c56-2ee6-4d76-99e1-f4930e40fd84 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:26.772358 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:26.782116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 176/359] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:26.783024 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87e765-9655-4b73-8654-3a088ab74cfe None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:26.818882 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3106c56-2ee6-4d76-99e1-f4930e40fd84 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:26.859557 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745cd9b-ccb7-40c6-80be-fb792022e42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:26.860184 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745cd9b-ccb7-40c6-80be-fb792022e42b None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:26.860464 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745cd9b-ccb7-40c6-80be-fb792022e42b None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:26.860738 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745cd9b-ccb7-40c6-80be-fb792022e42b None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:26.861473 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3745cd9b-ccb7-40c6-80be-fb792022e42b None admin] RBAC: Adding query filter params (name=member) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:26.861717 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3745cd9b-ccb7-40c6-80be-fb792022e42b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:26.863098 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3745cd9b-ccb7-40c6-80be-fb792022e42b None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:26.879900 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 184/360] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 02:05:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:26.880740 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745cd9b-ccb7-40c6-80be-fb792022e42b None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:26.916408 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:26.926826 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87e765-9655-4b73-8654-3a088ab74cfe None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:26.968769 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5cd63-5126-41eb-8d65-d987242456a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:26.969327 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5cd63-5126-41eb-8d65-d987242456a8 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:26.969607 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5cd63-5126-41eb-8d65-d987242456a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:26.969980 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5cd63-5126-41eb-8d65-d987242456a8 None admin] PATH_INFO: `/v3/groups/b5fe56a427fe4c98b5db69e35f77285f` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:26.971197 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5cd63-5126-41eb-8d65-d987242456a8 None admin] RBAC: Authorizing `identity:get_group(group_id=b5fe56a427fe4c98b5db69e35f77285f)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:26.972735 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5cd63-5126-41eb-8d65-d987242456a8 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:26.974660 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 177/361] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 8 02:05:26 2022] GET /identity/v3/groups/b5fe56a427fe4c98b5db69e35f77285f => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:26.975309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5cd63-5126-41eb-8d65-d987242456a8 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:26.986047 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745cd9b-ccb7-40c6-80be-fb792022e42b None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:27.003690 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:27.022529 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10370687-268a-46d0-9119-b10b430ea466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:27.023163 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10370687-268a-46d0-9119-b10b430ea466 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:27.023469 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10370687-268a-46d0-9119-b10b430ea466 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:27.023746 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10370687-268a-46d0-9119-b10b430ea466 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:27.036482 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10370687-268a-46d0-9119-b10b430ea466 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:27.041666 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-10370687-268a-46d0-9119-b10b430ea466 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:05:27.041666 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:27.041666 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:27.041666 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:27.041666 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:27.041666 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:27.041666 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:27.041666 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:27.041666 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:27.041666 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:27.041666 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:27.041666 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:27.041666 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:27.041666 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:27.041666 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:27.041666 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:27.043606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:27.043606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:27.043606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:27.043606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:27.043606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:27.043606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:27.043606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:27.043606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:27.043606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:27.043606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:27.043606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:27.043606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:27.043606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:27.043606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:27.043606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:27.043606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:27.044522 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:27.044522 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:27.044522 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:27.044522 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:27.044522 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:27.044522 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:27.044522 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:27.044522 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:27.044522 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:27.044522 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:27.044522 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:05:27.044522 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:27.047904 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 185/362] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 02:05:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:27.048636 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10370687-268a-46d0-9119-b10b430ea466 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:27.095845 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5cd63-5126-41eb-8d65-d987242456a8 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:27.139651 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a01bb-d9db-4eaa-822d-bdfb665b1409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:27.140267 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a01bb-d9db-4eaa-822d-bdfb665b1409 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:27.140549 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a01bb-d9db-4eaa-822d-bdfb665b1409 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:27.140822 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a01bb-d9db-4eaa-822d-bdfb665b1409 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:27.162421 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10370687-268a-46d0-9119-b10b430ea466 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:27.171825 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:27.199001 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719f549-a9c8-4e4f-9203-51548c542973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:27.199649 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719f549-a9c8-4e4f-9203-51548c542973 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:27.199973 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719f549-a9c8-4e4f-9203-51548c542973 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:27.200244 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719f549-a9c8-4e4f-9203-51548c542973 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:27.200969 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719f549-a9c8-4e4f-9203-51548c542973 None admin] RBAC: Adding query filter params (group.id=b5fe56a427fe4c98b5db69e35f77285f, role.id=e513bb6d8f644c1d9156090e507a03d4, scope.project.id=265f4aa2137047adb6e3cdec9bd23b99) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:27.201277 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719f549-a9c8-4e4f-9203-51548c542973 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:27.203252 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719f549-a9c8-4e4f-9203-51548c542973 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:27.210318 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 186/363] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Aug 8 02:05:27 2022] GET /identity/v3/role_assignments?group.id=b5fe56a427fe4c98b5db69e35f77285f&scope.project.id=265f4aa2137047adb6e3cdec9bd23b99&role.id=e513bb6d8f644c1d9156090e507a03d4 => generated 260 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:27.211388 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719f549-a9c8-4e4f-9203-51548c542973 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:27.221202 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a01bb-d9db-4eaa-822d-bdfb665b1409 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:27.223129 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a01bb-d9db-4eaa-822d-bdfb665b1409 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:27.266578 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:27.350543 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719f549-a9c8-4e4f-9203-51548c542973 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:27.356900 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 178/364] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:05:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:05:27.358760 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4a518-c609-48a0-bc58-e20b5fbd31d3 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:27.358760 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4a518-c609-48a0-bc58-e20b5fbd31d3 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:27.358760 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4a518-c609-48a0-bc58-e20b5fbd31d3 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:27.360131 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 179/365] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:27.365525 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3523c-7fa2-4b5e-8356-de0e9fc1920c None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:27.366157 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3523c-7fa2-4b5e-8356-de0e9fc1920c None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:27.366627 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3523c-7fa2-4b5e-8356-de0e9fc1920c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:27.390516 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-19e3523c-7fa2-4b5e-8356-de0e9fc1920c None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:27.392032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-19e3523c-7fa2-4b5e-8356-de0e9fc1920c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:27.420718 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436028c6-3c05-4e0d-8b7b-d3eedba1c5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:27.421589 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436028c6-3c05-4e0d-8b7b-d3eedba1c5c2 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:27.422035 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436028c6-3c05-4e0d-8b7b-d3eedba1c5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:27.422382 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436028c6-3c05-4e0d-8b7b-d3eedba1c5c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:27.423118 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436028c6-3c05-4e0d-8b7b-d3eedba1c5c2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:27.423584 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436028c6-3c05-4e0d-8b7b-d3eedba1c5c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:27.425268 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436028c6-3c05-4e0d-8b7b-d3eedba1c5c2 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:27.437575 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 187/366] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:05:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:27.438424 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436028c6-3c05-4e0d-8b7b-d3eedba1c5c2 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:27.466436 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:27.480098 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 180/367] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:05:27.480906 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3523c-7fa2-4b5e-8356-de0e9fc1920c None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:27.578566 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436028c6-3c05-4e0d-8b7b-d3eedba1c5c2 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:27.580387 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:27.612500 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3523c-7fa2-4b5e-8356-de0e9fc1920c None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:27.620246 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd070f6-b913-4d71-a446-a45406f0480f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:27.621267 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd070f6-b913-4d71-a446-a45406f0480f None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:27.621751 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd070f6-b913-4d71-a446-a45406f0480f None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:27.622296 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd070f6-b913-4d71-a446-a45406f0480f None admin] PATH_INFO: `/v3/projects/f15701875ea24854a2a23f51fa4c6364` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:27.624513 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd070f6-b913-4d71-a446-a45406f0480f None admin] RBAC: Authorizing `identity:get_project(project_id=f15701875ea24854a2a23f51fa4c6364)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:27.626169 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd070f6-b913-4d71-a446-a45406f0480f None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:27.628434 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 188/368] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:05:27 2022] GET /identity/v3/projects/f15701875ea24854a2a23f51fa4c6364 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:27.629546 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd070f6-b913-4d71-a446-a45406f0480f None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:27.654033 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323652e4-1bb7-4ca2-9139-9be4f989ac2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:27.654648 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323652e4-1bb7-4ca2-9139-9be4f989ac2d None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:27.655005 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323652e4-1bb7-4ca2-9139-9be4f989ac2d None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:27.655280 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323652e4-1bb7-4ca2-9139-9be4f989ac2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:27.733135 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:27.747817 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323652e4-1bb7-4ca2-9139-9be4f989ac2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:27.750352 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323652e4-1bb7-4ca2-9139-9be4f989ac2d None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:27.767513 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd070f6-b913-4d71-a446-a45406f0480f None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:27.820938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d9c5c-b4bd-464c-b1e4-e8d478d14b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:27.821642 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d9c5c-b4bd-464c-b1e4-e8d478d14b57 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:27.821920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d9c5c-b4bd-464c-b1e4-e8d478d14b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:27.822189 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d9c5c-b4bd-464c-b1e4-e8d478d14b57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:27.837648 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2d9c5c-b4bd-464c-b1e4-e8d478d14b57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:27.842358 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-1b2d9c5c-b4bd-464c-b1e4-e8d478d14b57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:05:27.842358 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:27.842358 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:27.842358 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:27.842358 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:27.842358 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:27.842358 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:27.842358 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:27.842358 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:27.842358 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:27.842358 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:27.842358 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:27.842358 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:27.842358 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:27.842358 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:27.842358 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:27.843199 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:27.843199 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:27.843199 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:27.843199 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:27.843199 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:27.843199 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:27.843199 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:27.843199 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:27.843199 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:27.843199 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:27.843199 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:27.843199 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:27.843199 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:27.843199 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:27.843199 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:27.843199 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:27.844028 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:27.844028 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:27.844028 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:27.844028 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:27.844028 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:27.844028 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:27.844028 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:27.844028 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:27.844028 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:27.844028 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:27.844028 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:05:27.844028 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:27.845375 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 189/369] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 02:05:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:27.846253 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d9c5c-b4bd-464c-b1e4-e8d478d14b57 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:27.878217 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 181/370] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:05:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:05:27.879076 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323652e4-1bb7-4ca2-9139-9be4f989ac2d None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:27.885794 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:27.958499 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d9c5c-b4bd-464c-b1e4-e8d478d14b57 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:27.976565 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:27.988370 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323652e4-1bb7-4ca2-9139-9be4f989ac2d None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:27.993137 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cccff85-99e3-4e69-a360-1aa527487db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:27.993773 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccff85-99e3-4e69-a360-1aa527487db7 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:27.999564 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccff85-99e3-4e69-a360-1aa527487db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:27.999564 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccff85-99e3-4e69-a360-1aa527487db7 None admin] PATH_INFO: `/v3/groups/b5fe56a427fe4c98b5db69e35f77285f` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:27.999564 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cccff85-99e3-4e69-a360-1aa527487db7 None admin] RBAC: Authorizing `identity:get_group(group_id=b5fe56a427fe4c98b5db69e35f77285f)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:27.999564 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cccff85-99e3-4e69-a360-1aa527487db7 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:27.999564 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 190/371] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 8 02:05:27 2022] GET /identity/v3/groups/b5fe56a427fe4c98b5db69e35f77285f => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:27.999872 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cccff85-99e3-4e69-a360-1aa527487db7 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:28.025181 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06afb9-f176-43d4-af60-eef5cc4f779a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:28.025819 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06afb9-f176-43d4-af60-eef5cc4f779a None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:28.026105 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06afb9-f176-43d4-af60-eef5cc4f779a None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:28.026480 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06afb9-f176-43d4-af60-eef5cc4f779a None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:28.027158 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06afb9-f176-43d4-af60-eef5cc4f779a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:28.027498 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06afb9-f176-43d4-af60-eef5cc4f779a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:28.029311 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06afb9-f176-43d4-af60-eef5cc4f779a None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:28.041908 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 182/372] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:05:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:28.042754 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06afb9-f176-43d4-af60-eef5cc4f779a None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:28.121854 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:28.126456 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cccff85-99e3-4e69-a360-1aa527487db7 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:28.176724 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187ca21-5128-4a26-85f6-6dca5d234ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:28.177363 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187ca21-5128-4a26-85f6-6dca5d234ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:28.177651 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187ca21-5128-4a26-85f6-6dca5d234ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:28.177928 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187ca21-5128-4a26-85f6-6dca5d234ab4 None admin] PATH_INFO: `/v3/projects/f15701875ea24854a2a23f51fa4c6364` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:28.180531 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06afb9-f176-43d4-af60-eef5cc4f779a None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:28.182185 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0187ca21-5128-4a26-85f6-6dca5d234ab4 None admin] RBAC: Authorizing `identity:get_project(project_id=f15701875ea24854a2a23f51fa4c6364)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:28.184334 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0187ca21-5128-4a26-85f6-6dca5d234ab4 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:28.186096 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 191/373] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:05:27 2022] GET /identity/v3/projects/f15701875ea24854a2a23f51fa4c6364 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:28.186465 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187ca21-5128-4a26-85f6-6dca5d234ab4 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:28.233778 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6101c7-505e-4119-8df7-ddf44197c525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:28.235123 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6101c7-505e-4119-8df7-ddf44197c525 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:28.236021 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6101c7-505e-4119-8df7-ddf44197c525 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:28.236479 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6101c7-505e-4119-8df7-ddf44197c525 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:28.237665 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6101c7-505e-4119-8df7-ddf44197c525 None admin] RBAC: Adding query filter params (group.id=b5fe56a427fe4c98b5db69e35f77285f, role.id=5691bce246d6452990f13933e19f2825, scope.project.id=f15701875ea24854a2a23f51fa4c6364) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:28.238432 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6101c7-505e-4119-8df7-ddf44197c525 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:28.240596 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6101c7-505e-4119-8df7-ddf44197c525 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:28.249351 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 183/374] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Aug 8 02:05:28 2022] GET /identity/v3/role_assignments?group.id=b5fe56a427fe4c98b5db69e35f77285f&scope.project.id=f15701875ea24854a2a23f51fa4c6364&role.id=5691bce246d6452990f13933e19f2825 => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:28.250581 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6101c7-505e-4119-8df7-ddf44197c525 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:28.273639 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:28.361045 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187ca21-5128-4a26-85f6-6dca5d234ab4 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:28.379177 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6101c7-505e-4119-8df7-ddf44197c525 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:28.431403 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c1367-e5d9-4858-b674-50af71bd96c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:28.432935 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c1367-e5d9-4858-b674-50af71bd96c9 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:28.433775 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c1367-e5d9-4858-b674-50af71bd96c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:28.434723 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c1367-e5d9-4858-b674-50af71bd96c9 None admin] PATH_INFO: `/v3/groups/b5fe56a427fe4c98b5db69e35f77285f` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:28.436676 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c1367-e5d9-4858-b674-50af71bd96c9 None admin] RBAC: Authorizing `identity:get_group(group_id=b5fe56a427fe4c98b5db69e35f77285f)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:28.438802 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c1367-e5d9-4858-b674-50af71bd96c9 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:28.441053 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 184/375] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 8 02:05:28 2022] GET /identity/v3/groups/b5fe56a427fe4c98b5db69e35f77285f => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:28.442607 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5c578-54b3-4a7e-ba5a-0e2a8e6fc36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:28.443871 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5c578-54b3-4a7e-ba5a-0e2a8e6fc36e None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:28.444431 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5c578-54b3-4a7e-ba5a-0e2a8e6fc36e None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:28.444900 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5c578-54b3-4a7e-ba5a-0e2a8e6fc36e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:28.448256 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c1367-e5d9-4858-b674-50af71bd96c9 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:28.498160 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:28.537646 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c5c578-54b3-4a7e-ba5a-0e2a8e6fc36e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:28.539479 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c5c578-54b3-4a7e-ba5a-0e2a8e6fc36e None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:28.574364 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:28.593172 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c1367-e5d9-4858-b674-50af71bd96c9 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:28.634785 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75950f-d161-4d49-8229-651cf7f6732d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:28.636218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75950f-d161-4d49-8229-651cf7f6732d None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:28.636697 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75950f-d161-4d49-8229-651cf7f6732d None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:28.637164 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75950f-d161-4d49-8229-651cf7f6732d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:28.638087 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff75950f-d161-4d49-8229-651cf7f6732d None admin] RBAC: Adding query filter params (group.id=b5fe56a427fe4c98b5db69e35f77285f, role.id=e513bb6d8f644c1d9156090e507a03d4, scope.project.id=f15701875ea24854a2a23f51fa4c6364) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:28.638612 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff75950f-d161-4d49-8229-651cf7f6732d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:28.640266 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff75950f-d161-4d49-8229-651cf7f6732d None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:28.646370 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 185/376] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Aug 8 02:05:28 2022] GET /identity/v3/role_assignments?group.id=b5fe56a427fe4c98b5db69e35f77285f&scope.project.id=f15701875ea24854a2a23f51fa4c6364&role.id=e513bb6d8f644c1d9156090e507a03d4 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:28.668614 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 192/377] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:05:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:05:28.674542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75950f-d161-4d49-8229-651cf7f6732d None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:28.795104 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75950f-d161-4d49-8229-651cf7f6732d None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:28.809296 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6e9c7-9cf4-4704-9b7f-7f73f3f29476 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:28.809633 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6e9c7-9cf4-4704-9b7f-7f73f3f29476 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:28.809847 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6e9c7-9cf4-4704-9b7f-7f73f3f29476 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:28.811265 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 193/378] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:05:28.817070 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a6cb8-b59d-4fc2-8dfe-5c6d8db1e33c None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:28.817364 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a6cb8-b59d-4fc2-8dfe-5c6d8db1e33c None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:28.817639 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a6cb8-b59d-4fc2-8dfe-5c6d8db1e33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:28.845345 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-1b6a6cb8-b59d-4fc2-8dfe-5c6d8db1e33c None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:28.847463 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-1b6a6cb8-b59d-4fc2-8dfe-5c6d8db1e33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:28.877594 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57eaa0f-ceae-472c-a8d9-953e95c3f255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:28.878243 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57eaa0f-ceae-472c-a8d9-953e95c3f255 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:28.878522 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57eaa0f-ceae-472c-a8d9-953e95c3f255 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:28.878796 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57eaa0f-ceae-472c-a8d9-953e95c3f255 None admin] PATH_INFO: `/v3/projects/4b600a834cd24825ac13e271234139ce` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:28.884664 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57eaa0f-ceae-472c-a8d9-953e95c3f255 None admin] RBAC: Authorizing `identity:get_project(project_id=4b600a834cd24825ac13e271234139ce)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:28.886118 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57eaa0f-ceae-472c-a8d9-953e95c3f255 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:28.888118 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 186/379] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:05:28 2022] GET /identity/v3/projects/4b600a834cd24825ac13e271234139ce => generated 344 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:28.893902 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57eaa0f-ceae-472c-a8d9-953e95c3f255 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:28.925426 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:28.925962 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:28.939384 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 194/380] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:28.974773 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a6cb8-b59d-4fc2-8dfe-5c6d8db1e33c None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:29.089609 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a6cb8-b59d-4fc2-8dfe-5c6d8db1e33c None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:29.091926 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57eaa0f-ceae-472c-a8d9-953e95c3f255 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:29.128091 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bce44-ef39-4ad3-9829-da0035b134aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:29.128801 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bce44-ef39-4ad3-9829-da0035b134aa None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:29.129087 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bce44-ef39-4ad3-9829-da0035b134aa None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:29.129367 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bce44-ef39-4ad3-9829-da0035b134aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:29.142456 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418bce44-ef39-4ad3-9829-da0035b134aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:29.147767 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-418bce44-ef39-4ad3-9829-da0035b134aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:05:29.147767 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:29.147767 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:29.147767 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:29.147767 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:29.147767 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:29.147767 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:29.147767 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:29.147767 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:29.147767 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:29.147767 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:29.147767 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:29.147767 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:29.147767 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:29.147767 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:29.147767 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:29.148650 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:29.148650 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:29.148650 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:29.148650 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:29.148650 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:29.148650 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:29.148650 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:29.148650 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:29.148650 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:29.148650 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:29.148650 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:29.148650 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:29.148650 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:29.148650 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:29.148650 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:29.148650 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:29.149942 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:29.149942 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:29.149942 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:29.149942 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:29.149942 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:29.149942 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:29.149942 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:29.149942 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:29.149942 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:29.149942 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:29.149942 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:05:29.149942 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:29.149942 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 195/381] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:05:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:05:29.160087 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bce44-ef39-4ad3-9829-da0035b134aa None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:29.188987 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f7dd09-e844-4735-8442-a3ee84e87471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:29.189864 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7dd09-e844-4735-8442-a3ee84e87471 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:29.190282 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7dd09-e844-4735-8442-a3ee84e87471 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:29.190690 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7dd09-e844-4735-8442-a3ee84e87471 None admin] PATH_INFO: `/v3/groups/9645eabf030c4251a844be514b656c8f` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:29.203979 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f7dd09-e844-4735-8442-a3ee84e87471 None admin] RBAC: Authorizing `identity:get_group(group_id=9645eabf030c4251a844be514b656c8f)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:29.205647 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f7dd09-e844-4735-8442-a3ee84e87471 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:29.207808 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 187/382] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 8 02:05:28 2022] GET /identity/v3/groups/9645eabf030c4251a844be514b656c8f => generated 229 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:05:29.232399 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f7dd09-e844-4735-8442-a3ee84e87471 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:29.232945 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:29.278902 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bce44-ef39-4ad3-9829-da0035b134aa None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:29.320201 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958526ff-0cbb-4f8a-94ff-e97237e06caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:29.320941 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958526ff-0cbb-4f8a-94ff-e97237e06caf None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:29.321287 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958526ff-0cbb-4f8a-94ff-e97237e06caf None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:29.321754 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958526ff-0cbb-4f8a-94ff-e97237e06caf None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:29.322427 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958526ff-0cbb-4f8a-94ff-e97237e06caf None admin] RBAC: Adding query filter params (name=member) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:29.322732 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958526ff-0cbb-4f8a-94ff-e97237e06caf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:29.324139 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958526ff-0cbb-4f8a-94ff-e97237e06caf None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:29.342837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 196/383] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 02:05:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:29.350565 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958526ff-0cbb-4f8a-94ff-e97237e06caf None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:29.389396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:29.415907 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f7dd09-e844-4735-8442-a3ee84e87471 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:29.472719 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f435f7-7966-4918-a59b-21496bd1cc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:29.473343 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f435f7-7966-4918-a59b-21496bd1cc01 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:29.473621 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f435f7-7966-4918-a59b-21496bd1cc01 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:29.473892 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f435f7-7966-4918-a59b-21496bd1cc01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:29.474636 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f435f7-7966-4918-a59b-21496bd1cc01 None admin] RBAC: Adding query filter params (group.id=9645eabf030c4251a844be514b656c8f, role.id=84da65a75e544d1191ec53cb6b05aa73, scope.project.id=4b600a834cd24825ac13e271234139ce) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:29.474935 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f435f7-7966-4918-a59b-21496bd1cc01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:29.476384 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f435f7-7966-4918-a59b-21496bd1cc01 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:29.478387 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958526ff-0cbb-4f8a-94ff-e97237e06caf None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:29.483177 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 188/384] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Aug 8 02:05:29 2022] GET /identity/v3/role_assignments?group.id=9645eabf030c4251a844be514b656c8f&scope.project.id=4b600a834cd24825ac13e271234139ce&role.id=84da65a75e544d1191ec53cb6b05aa73 => generated 260 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:29.526642 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:29.533905 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b76fb12-e6fb-44e3-b3d0-9067c08adeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:29.534610 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b76fb12-e6fb-44e3-b3d0-9067c08adeb5 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:29.534897 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b76fb12-e6fb-44e3-b3d0-9067c08adeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:29.541138 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b76fb12-e6fb-44e3-b3d0-9067c08adeb5 None admin] PATH_INFO: `/v3/groups/b5fe56a427fe4c98b5db69e35f77285f` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:29.541138 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b76fb12-e6fb-44e3-b3d0-9067c08adeb5 None admin] RBAC: Authorizing `identity:get_group(group_id=b5fe56a427fe4c98b5db69e35f77285f)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:29.541563 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b76fb12-e6fb-44e3-b3d0-9067c08adeb5 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:29.543801 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 197/385] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 8 02:05:29 2022] GET /identity/v3/groups/b5fe56a427fe4c98b5db69e35f77285f => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:05:29.549282 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f435f7-7966-4918-a59b-21496bd1cc01 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:29.693050 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f435f7-7966-4918-a59b-21496bd1cc01 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:29.734203 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716990c3-5a13-4ab2-8696-a7f184cda056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:29.734833 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716990c3-5a13-4ab2-8696-a7f184cda056 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:29.735112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716990c3-5a13-4ab2-8696-a7f184cda056 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:29.735417 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716990c3-5a13-4ab2-8696-a7f184cda056 None admin] PATH_INFO: `/v3/projects/265f4aa2137047adb6e3cdec9bd23b99` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:29.736543 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716990c3-5a13-4ab2-8696-a7f184cda056 None admin] RBAC: Authorizing `identity:get_project(project_id=265f4aa2137047adb6e3cdec9bd23b99)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:29.738034 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716990c3-5a13-4ab2-8696-a7f184cda056 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:29.739979 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 189/386] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:05:29 2022] GET /identity/v3/projects/265f4aa2137047adb6e3cdec9bd23b99 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:29.746352 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b76fb12-e6fb-44e3-b3d0-9067c08adeb5 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:29.842628 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f93af-be8f-487d-813a-db53221611fd None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:29.842970 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f93af-be8f-487d-813a-db53221611fd None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:29.843184 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f93af-be8f-487d-813a-db53221611fd None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:29.847448 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 190/387] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:05:29.852037 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca63b2-31f0-4303-8f92-65c7940bd466 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:29.852398 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca63b2-31f0-4303-8f92-65c7940bd466 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:29.852708 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca63b2-31f0-4303-8f92-65c7940bd466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:29.856543 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b76fb12-e6fb-44e3-b3d0-9067c08adeb5 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:29.882929 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-03ca63b2-31f0-4303-8f92-65c7940bd466 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:29.887210 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-03ca63b2-31f0-4303-8f92-65c7940bd466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:29.897297 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:29.914904 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5319480-cbfb-480a-a4a7-f8b6e4f6a965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:29.915897 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5319480-cbfb-480a-a4a7-f8b6e4f6a965 None admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:29.916347 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5319480-cbfb-480a-a4a7-f8b6e4f6a965 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:29.916861 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5319480-cbfb-480a-a4a7-f8b6e4f6a965 None admin] PATH_INFO: `/v3/projects/265f4aa2137047adb6e3cdec9bd23b99/groups/b5fe56a427fe4c98b5db69e35f77285f/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:29.920850 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5319480-cbfb-480a-a4a7-f8b6e4f6a965 None admin] RBAC: Authorizing `identity:create_grant(project_id=265f4aa2137047adb6e3cdec9bd23b99, group_id=b5fe56a427fe4c98b5db69e35f77285f, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:29.922535 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5319480-cbfb-480a-a4a7-f8b6e4f6a965 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:29.980158 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 191/388] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:30.008525 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca63b2-31f0-4303-8f92-65c7940bd466 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:30.026346 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 198/389] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Aug 8 02:05:29 2022] PUT /identity/v3/projects/265f4aa2137047adb6e3cdec9bd23b99/groups/b5fe56a427fe4c98b5db69e35f77285f/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:05:30.147608 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca63b2-31f0-4303-8f92-65c7940bd466 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:30.190861 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b04547-e3e2-4d70-bbfb-3dc49fb214d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:30.191526 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b04547-e3e2-4d70-bbfb-3dc49fb214d0 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:30.191809 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b04547-e3e2-4d70-bbfb-3dc49fb214d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:30.192083 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b04547-e3e2-4d70-bbfb-3dc49fb214d0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:30.208776 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b04547-e3e2-4d70-bbfb-3dc49fb214d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:30.213587 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-b3b04547-e3e2-4d70-bbfb-3dc49fb214d0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:05:30.213587 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:30.213587 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:30.213587 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:30.213587 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:30.213587 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:30.213587 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:30.213587 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:30.213587 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:30.213587 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:30.213587 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:30.213587 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:30.213587 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:30.213587 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:30.213587 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:30.213587 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:30.214435 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:30.214435 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:30.214435 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:30.214435 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:30.214435 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:30.214435 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:30.214435 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:30.214435 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:30.214435 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:30.214435 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:30.214435 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:30.214435 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:30.214435 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:30.214435 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:30.214435 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:30.214435 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:30.215225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:30.215225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:30.215225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:30.215225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:30.215225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:30.215225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:30.215225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:30.215225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:30.215225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:30.215225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:30.215225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:05:30.215225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:30.215225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 192/390] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 02:05:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:05:30.222203 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5319480-cbfb-480a-a4a7-f8b6e4f6a965 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:30.305934 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:30.374634 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5319480-cbfb-480a-a4a7-f8b6e4f6a965 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:30.421985 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b7be5b-9610-417b-a010-7b6fe8289c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:30.422958 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7be5b-9610-417b-a010-7b6fe8289c8e None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:30.423466 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7be5b-9610-417b-a010-7b6fe8289c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:30.423938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7be5b-9610-417b-a010-7b6fe8289c8e None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:30.424830 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b7be5b-9610-417b-a010-7b6fe8289c8e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:30.425332 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b7be5b-9610-417b-a010-7b6fe8289c8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:30.426896 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b7be5b-9610-417b-a010-7b6fe8289c8e None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:30.438009 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 199/391] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:05:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:30.443285 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b04547-e3e2-4d70-bbfb-3dc49fb214d0 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:30.449783 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:30.564526 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b04547-e3e2-4d70-bbfb-3dc49fb214d0 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:30.600322 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6b860-826f-4713-9ddb-317acbafd1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:30.600958 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6b860-826f-4713-9ddb-317acbafd1f8 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:30.601239 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6b860-826f-4713-9ddb-317acbafd1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:30.601572 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6b860-826f-4713-9ddb-317acbafd1f8 None admin] PATH_INFO: `/v3/groups/b5fe56a427fe4c98b5db69e35f77285f` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:30.602754 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6b860-826f-4713-9ddb-317acbafd1f8 None admin] RBAC: Authorizing `identity:get_group(group_id=b5fe56a427fe4c98b5db69e35f77285f)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:30.604207 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6b860-826f-4713-9ddb-317acbafd1f8 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:30.606078 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 193/392] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 8 02:05:30 2022] GET /identity/v3/groups/b5fe56a427fe4c98b5db69e35f77285f => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:30.611374 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b7be5b-9610-417b-a010-7b6fe8289c8e None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:30.688919 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8980d6-082f-4eae-a8a0-81d1feff2bfb None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:30.689202 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8980d6-082f-4eae-a8a0-81d1feff2bfb None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:30.690308 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8980d6-082f-4eae-a8a0-81d1feff2bfb None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:30.691974 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 194/393] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:05:30.698139 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244304d1-c55f-4146-be87-beea5764136b None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:30.698882 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244304d1-c55f-4146-be87-beea5764136b None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:30.699172 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244304d1-c55f-4146-be87-beea5764136b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:30.722160 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-244304d1-c55f-4146-be87-beea5764136b None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:30.724028 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-244304d1-c55f-4146-be87-beea5764136b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:30.726267 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b7be5b-9610-417b-a010-7b6fe8289c8e None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:30.738211 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:30.777352 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1a412-a5a9-4c03-8009-d67e8ee6fd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:30.778345 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1a412-a5a9-4c03-8009-d67e8ee6fd67 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:30.778770 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1a412-a5a9-4c03-8009-d67e8ee6fd67 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:30.779185 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1a412-a5a9-4c03-8009-d67e8ee6fd67 None admin] PATH_INFO: `/v3/projects/265f4aa2137047adb6e3cdec9bd23b99` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:30.784173 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e1a412-a5a9-4c03-8009-d67e8ee6fd67 None admin] RBAC: Authorizing `identity:get_project(project_id=265f4aa2137047adb6e3cdec9bd23b99)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:30.785933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e1a412-a5a9-4c03-8009-d67e8ee6fd67 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:30.788186 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 200/394] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:05:30 2022] GET /identity/v3/projects/265f4aa2137047adb6e3cdec9bd23b99 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:30.796814 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1a412-a5a9-4c03-8009-d67e8ee6fd67 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:30.827943 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:30.835243 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 195/395] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:05:30.872643 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244304d1-c55f-4146-be87-beea5764136b None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:30.983137 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1a412-a5a9-4c03-8009-d67e8ee6fd67 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:31.019224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244304d1-c55f-4146-be87-beea5764136b None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:31.061976 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7421d2a-6898-4e65-b845-b8bc796b1cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:31.063032 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7421d2a-6898-4e65-b845-b8bc796b1cca None admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:31.064092 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7421d2a-6898-4e65-b845-b8bc796b1cca None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:31.064788 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7421d2a-6898-4e65-b845-b8bc796b1cca None admin] PATH_INFO: `/v3/projects/265f4aa2137047adb6e3cdec9bd23b99/groups/b5fe56a427fe4c98b5db69e35f77285f/roles/e513bb6d8f644c1d9156090e507a03d4` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:31.069162 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7421d2a-6898-4e65-b845-b8bc796b1cca None admin] RBAC: Authorizing `identity:create_grant(project_id=265f4aa2137047adb6e3cdec9bd23b99, group_id=b5fe56a427fe4c98b5db69e35f77285f, role_id=e513bb6d8f644c1d9156090e507a03d4)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:31.072337 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7421d2a-6898-4e65-b845-b8bc796b1cca None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:31.077743 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4eed1-e04d-43cf-bc44-665fb5f4693f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:31.077743 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4eed1-e04d-43cf-bc44-665fb5f4693f None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:31.078101 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4eed1-e04d-43cf-bc44-665fb5f4693f None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:31.078355 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4eed1-e04d-43cf-bc44-665fb5f4693f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:31.095544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea4eed1-e04d-43cf-bc44-665fb5f4693f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:31.101191 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-5ea4eed1-e04d-43cf-bc44-665fb5f4693f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:05:31.101191 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:31.101191 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:31.101191 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:31.101191 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:31.101191 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:31.101191 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:31.101191 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:31.101191 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:31.101191 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:31.101191 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:31.101191 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:31.101191 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:31.101191 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:31.101191 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:31.101191 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:31.102185 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:31.102185 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:31.102185 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:31.102185 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:31.102185 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:31.102185 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:31.102185 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:31.102185 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:31.102185 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:31.102185 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:31.102185 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:31.102185 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:31.102185 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:31.102185 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:31.102185 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:31.102185 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:31.103569 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:31.103569 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:31.103569 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:31.103569 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:31.103569 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:31.103569 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:31.103569 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:31.103569 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:31.103569 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:31.103569 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:31.103569 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:05:31.103569 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:31.103569 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 196/396] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:05:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:05:31.108883 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4eed1-e04d-43cf-bc44-665fb5f4693f None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:31.168536 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 201/397] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Aug 8 02:05:30 2022] PUT /identity/v3/projects/265f4aa2137047adb6e3cdec9bd23b99/groups/b5fe56a427fe4c98b5db69e35f77285f/roles/e513bb6d8f644c1d9156090e507a03d4 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:05:31.183204 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:31.230157 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4eed1-e04d-43cf-bc44-665fb5f4693f None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:31.267998 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac3c8b-132d-4882-a0d0-daabcf5789be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:31.268606 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac3c8b-132d-4882-a0d0-daabcf5789be None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:31.268886 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac3c8b-132d-4882-a0d0-daabcf5789be None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:31.269155 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac3c8b-132d-4882-a0d0-daabcf5789be None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:31.269837 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac3c8b-132d-4882-a0d0-daabcf5789be None admin] RBAC: Adding query filter params (name=member) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:31.270143 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac3c8b-132d-4882-a0d0-daabcf5789be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:31.271572 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac3c8b-132d-4882-a0d0-daabcf5789be None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:31.280981 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 197/398] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 02:05:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:31.286834 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7421d2a-6898-4e65-b845-b8bc796b1cca None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:31.329758 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:31.413829 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7421d2a-6898-4e65-b845-b8bc796b1cca None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:31.452047 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b3a4e-12ff-4aba-ab9d-721c2dc2e81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:31.453071 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b3a4e-12ff-4aba-ab9d-721c2dc2e81d None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:31.453539 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b3a4e-12ff-4aba-ab9d-721c2dc2e81d None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:31.454005 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b3a4e-12ff-4aba-ab9d-721c2dc2e81d None admin] PATH_INFO: `/v3/groups/b5fe56a427fe4c98b5db69e35f77285f` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:31.455552 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b3a4e-12ff-4aba-ab9d-721c2dc2e81d None admin] RBAC: Authorizing `identity:get_group(group_id=b5fe56a427fe4c98b5db69e35f77285f)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:31.457222 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b3a4e-12ff-4aba-ab9d-721c2dc2e81d None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:31.459461 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 202/399] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 8 02:05:31 2022] GET /identity/v3/groups/b5fe56a427fe4c98b5db69e35f77285f => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:31.465856 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac3c8b-132d-4882-a0d0-daabcf5789be None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:31.572321 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac3c8b-132d-4882-a0d0-daabcf5789be None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:31.596481 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:31.607848 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec6f7a-384d-47c6-9ac6-15c9b999c1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:31.623061 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac24b9-bf50-42b8-8b61-68498081552d None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:31.623061 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac24b9-bf50-42b8-8b61-68498081552d None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:31.623631 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec6f7a-384d-47c6-9ac6-15c9b999c1d3 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:31.623712 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac24b9-bf50-42b8-8b61-68498081552d None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:31.623790 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec6f7a-384d-47c6-9ac6-15c9b999c1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:31.623790 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec6f7a-384d-47c6-9ac6-15c9b999c1d3 None admin] PATH_INFO: `/v3/projects/f15701875ea24854a2a23f51fa4c6364` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:31.623790 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec6f7a-384d-47c6-9ac6-15c9b999c1d3 None admin] RBAC: Authorizing `identity:get_project(project_id=f15701875ea24854a2a23f51fa4c6364)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:31.623983 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 203/400] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:31.624054 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec6f7a-384d-47c6-9ac6-15c9b999c1d3 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:31.624054 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 198/401] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:05:31 2022] GET /identity/v3/projects/f15701875ea24854a2a23f51fa4c6364 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:31.624194 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa422be-4c40-4bc3-aada-1ac6a3708a36 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:31.624194 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa422be-4c40-4bc3-aada-1ac6a3708a36 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:31.624194 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa422be-4c40-4bc3-aada-1ac6a3708a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:31.630016 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec6f7a-384d-47c6-9ac6-15c9b999c1d3 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:31.645090 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-4fa422be-4c40-4bc3-aada-1ac6a3708a36 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:31.646612 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-4fa422be-4c40-4bc3-aada-1ac6a3708a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:31.731312 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 204/402] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:31.761782 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa422be-4c40-4bc3-aada-1ac6a3708a36 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:31.783176 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec6f7a-384d-47c6-9ac6-15c9b999c1d3 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:31.802837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:31.847171 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38c38a-0f17-4e81-9157-dcf1311eceed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:31.847849 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38c38a-0f17-4e81-9157-dcf1311eceed None admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:31.848140 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38c38a-0f17-4e81-9157-dcf1311eceed None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:31.848422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38c38a-0f17-4e81-9157-dcf1311eceed None admin] PATH_INFO: `/v3/projects/f15701875ea24854a2a23f51fa4c6364/groups/b5fe56a427fe4c98b5db69e35f77285f/roles/5691bce246d6452990f13933e19f2825` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:31.853948 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38c38a-0f17-4e81-9157-dcf1311eceed None admin] RBAC: Authorizing `identity:create_grant(project_id=f15701875ea24854a2a23f51fa4c6364, group_id=b5fe56a427fe4c98b5db69e35f77285f, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:31.855564 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38c38a-0f17-4e81-9157-dcf1311eceed None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:31.880475 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa422be-4c40-4bc3-aada-1ac6a3708a36 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:31.917315 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd7ec0-d4e1-43a1-b333-e4f4aaefd3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:31.918295 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd7ec0-d4e1-43a1-b333-e4f4aaefd3b6 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:31.918839 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd7ec0-d4e1-43a1-b333-e4f4aaefd3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:31.919315 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd7ec0-d4e1-43a1-b333-e4f4aaefd3b6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:31.930687 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd7ec0-d4e1-43a1-b333-e4f4aaefd3b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:31.935831 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-a5cd7ec0-d4e1-43a1-b333-e4f4aaefd3b6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:05:31.935831 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:31.935831 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:31.935831 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:31.935831 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:31.935831 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:31.935831 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:31.935831 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:31.935831 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:31.935831 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:31.935831 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:31.935831 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:31.935831 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:31.935831 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:31.935831 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:31.935831 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:31.936678 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:31.936678 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:31.936678 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:31.936678 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:31.936678 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:31.936678 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:31.936678 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:31.936678 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:31.936678 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:31.936678 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:31.936678 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:31.936678 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:31.936678 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:31.936678 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:31.936678 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:31.936678 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:31.937491 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:31.937491 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:31.937491 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:31.937491 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:31.937491 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:31.937491 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:31.937491 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:31.937491 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:31.937491 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:31.937491 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:31.937491 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:05:31.937491 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:31.945850 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 205/403] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 02:05:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:05:31.947488 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd7ec0-d4e1-43a1-b333-e4f4aaefd3b6 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:31.964607 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 199/404] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Aug 8 02:05:31 2022] PUT /identity/v3/projects/f15701875ea24854a2a23f51fa4c6364/groups/b5fe56a427fe4c98b5db69e35f77285f/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:05:32.059948 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:32.063667 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd7ec0-d4e1-43a1-b333-e4f4aaefd3b6 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:32.100061 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd54f9-3925-4b09-b0ff-51bd4c7555c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:32.100605 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd54f9-3925-4b09-b0ff-51bd4c7555c1 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:32.100887 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd54f9-3925-4b09-b0ff-51bd4c7555c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:32.101167 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd54f9-3925-4b09-b0ff-51bd4c7555c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:32.101850 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd54f9-3925-4b09-b0ff-51bd4c7555c1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:32.102157 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd54f9-3925-4b09-b0ff-51bd4c7555c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:32.103649 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd54f9-3925-4b09-b0ff-51bd4c7555c1 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:32.113157 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 206/405] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:05:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:32.119480 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38c38a-0f17-4e81-9157-dcf1311eceed None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:32.206973 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:32.264985 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38c38a-0f17-4e81-9157-dcf1311eceed None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:32.270245 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4e26b-0372-4c65-81bd-14790fb26a08 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:32.270554 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4e26b-0372-4c65-81bd-14790fb26a08 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:32.270807 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4e26b-0372-4c65-81bd-14790fb26a08 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:32.272400 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 207/406] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:32.279517 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c62cc8-7aee-42fe-828f-a33660e277a5 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:32.279903 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c62cc8-7aee-42fe-828f-a33660e277a5 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:32.280116 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c62cc8-7aee-42fe-828f-a33660e277a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:32.302095 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-c1c62cc8-7aee-42fe-828f-a33660e277a5 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:32.303305 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-c1c62cc8-7aee-42fe-828f-a33660e277a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:32.310523 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857fca8-bff4-4917-872f-6e842bcc6ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:32.311647 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857fca8-bff4-4917-872f-6e842bcc6ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:32.312134 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857fca8-bff4-4917-872f-6e842bcc6ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:32.312676 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857fca8-bff4-4917-872f-6e842bcc6ab4 None admin] PATH_INFO: `/v3/groups/b5fe56a427fe4c98b5db69e35f77285f` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:32.314016 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857fca8-bff4-4917-872f-6e842bcc6ab4 None admin] RBAC: Authorizing `identity:get_group(group_id=b5fe56a427fe4c98b5db69e35f77285f)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:32.316040 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857fca8-bff4-4917-872f-6e842bcc6ab4 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:32.318022 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 200/407] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 8 02:05:32 2022] GET /identity/v3/groups/b5fe56a427fe4c98b5db69e35f77285f => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:32.324354 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857fca8-bff4-4917-872f-6e842bcc6ab4 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:32.382038 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 208/408] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:32.407544 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c62cc8-7aee-42fe-828f-a33660e277a5 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:32.444478 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857fca8-bff4-4917-872f-6e842bcc6ab4 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:32.463529 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:32.481700 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312ff56-3c18-4ddb-a3d1-92fa08fc661f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:32.482589 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312ff56-3c18-4ddb-a3d1-92fa08fc661f None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:32.483079 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312ff56-3c18-4ddb-a3d1-92fa08fc661f None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:32.483522 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312ff56-3c18-4ddb-a3d1-92fa08fc661f None admin] PATH_INFO: `/v3/projects/f15701875ea24854a2a23f51fa4c6364` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:32.484871 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7312ff56-3c18-4ddb-a3d1-92fa08fc661f None admin] RBAC: Authorizing `identity:get_project(project_id=f15701875ea24854a2a23f51fa4c6364)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:32.486475 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7312ff56-3c18-4ddb-a3d1-92fa08fc661f None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:32.488589 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 201/409] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:05:32 2022] GET /identity/v3/projects/f15701875ea24854a2a23f51fa4c6364 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:32.494622 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312ff56-3c18-4ddb-a3d1-92fa08fc661f None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:32.506305 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:32.523916 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c62cc8-7aee-42fe-828f-a33660e277a5 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:32.563110 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d27c42-0aae-4588-8745-4384e818f5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:32.564027 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d27c42-0aae-4588-8745-4384e818f5b6 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:32.564410 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d27c42-0aae-4588-8745-4384e818f5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:32.564808 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d27c42-0aae-4588-8745-4384e818f5b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:32.576304 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d27c42-0aae-4588-8745-4384e818f5b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:32.581382 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-86d27c42-0aae-4588-8745-4384e818f5b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:05:32.581382 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:32.581382 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:32.581382 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:32.581382 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:32.581382 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:32.581382 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:32.581382 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:32.581382 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:32.581382 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:32.581382 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:32.581382 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:32.581382 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:32.581382 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:32.581382 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:32.581382 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:32.582349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:32.582349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:32.582349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:32.582349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:32.582349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:32.582349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:32.582349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:32.582349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:32.582349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:32.582349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:32.582349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:32.582349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:32.582349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:32.582349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:32.582349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:32.582349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:32.583113 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:32.583113 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:32.583113 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:32.583113 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:32.583113 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:32.583113 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:32.583113 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:32.583113 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:32.583113 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:32.583113 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:32.583113 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:05:32.583113 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:32.583113 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 209/410] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 02:05:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:05:32.590687 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d27c42-0aae-4588-8745-4384e818f5b6 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:32.616628 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312ff56-3c18-4ddb-a3d1-92fa08fc661f None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:32.654558 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877564aa-3c01-48d6-826b-dba1a791ecb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:32.655729 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877564aa-3c01-48d6-826b-dba1a791ecb8 None admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:32.656260 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877564aa-3c01-48d6-826b-dba1a791ecb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:32.656727 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877564aa-3c01-48d6-826b-dba1a791ecb8 None admin] PATH_INFO: `/v3/projects/f15701875ea24854a2a23f51fa4c6364/groups/b5fe56a427fe4c98b5db69e35f77285f/roles/e513bb6d8f644c1d9156090e507a03d4` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:32.659305 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877564aa-3c01-48d6-826b-dba1a791ecb8 None admin] RBAC: Authorizing `identity:create_grant(project_id=f15701875ea24854a2a23f51fa4c6364, group_id=b5fe56a427fe4c98b5db69e35f77285f, role_id=e513bb6d8f644c1d9156090e507a03d4)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:32.661015 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877564aa-3c01-48d6-826b-dba1a791ecb8 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:32.699692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d27c42-0aae-4588-8745-4384e818f5b6 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:32.736862 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81db13-92f0-4d11-811b-6eae87d8d7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:32.737530 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81db13-92f0-4d11-811b-6eae87d8d7dc None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:32.737809 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81db13-92f0-4d11-811b-6eae87d8d7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:32.738209 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81db13-92f0-4d11-811b-6eae87d8d7dc None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:32.738928 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81db13-92f0-4d11-811b-6eae87d8d7dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:32.739229 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81db13-92f0-4d11-811b-6eae87d8d7dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:32.740730 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81db13-92f0-4d11-811b-6eae87d8d7dc None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:32.750064 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 210/411] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:05:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:05:32.755692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81db13-92f0-4d11-811b-6eae87d8d7dc None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:32.767872 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:32.781700 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 202/412] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Aug 8 02:05:32 2022] PUT /identity/v3/projects/f15701875ea24854a2a23f51fa4c6364/groups/b5fe56a427fe4c98b5db69e35f77285f/roles/e513bb6d8f644c1d9156090e507a03d4 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:05:32.867249 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81db13-92f0-4d11-811b-6eae87d8d7dc None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:32.907433 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31e9e2-a05e-40a8-9398-b47b17ef1824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:32.908090 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31e9e2-a05e-40a8-9398-b47b17ef1824 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:32.908371 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31e9e2-a05e-40a8-9398-b47b17ef1824 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:32.908650 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31e9e2-a05e-40a8-9398-b47b17ef1824 None admin] PATH_INFO: `/v3/groups/9645eabf030c4251a844be514b656c8f` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:32.910230 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf31e9e2-a05e-40a8-9398-b47b17ef1824 None admin] RBAC: Authorizing `identity:get_group(group_id=9645eabf030c4251a844be514b656c8f)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:32.911761 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf31e9e2-a05e-40a8-9398-b47b17ef1824 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:32.913805 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 211/413] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 8 02:05:32 2022] GET /identity/v3/groups/9645eabf030c4251a844be514b656c8f => generated 229 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:05:32.919613 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877564aa-3c01-48d6-826b-dba1a791ecb8 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:32.977042 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:33.034441 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877564aa-3c01-48d6-826b-dba1a791ecb8 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:33.075261 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690ac1a-4450-40f1-879f-b15ebee663ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:33.076245 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690ac1a-4450-40f1-879f-b15ebee663ef None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:33.076705 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690ac1a-4450-40f1-879f-b15ebee663ef None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:33.077163 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690ac1a-4450-40f1-879f-b15ebee663ef None admin] PATH_INFO: `/v3/projects/4b600a834cd24825ac13e271234139ce` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:33.078585 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690ac1a-4450-40f1-879f-b15ebee663ef None admin] RBAC: Authorizing `identity:get_project(project_id=4b600a834cd24825ac13e271234139ce)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:33.079579 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82f82c-3412-4166-9fe9-6b6cba5fbfd0 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:33.079937 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82f82c-3412-4166-9fe9-6b6cba5fbfd0 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:33.080291 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82f82c-3412-4166-9fe9-6b6cba5fbfd0 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:33.080905 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690ac1a-4450-40f1-879f-b15ebee663ef None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:33.082222 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 212/414] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:33.083307 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 203/415] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:05:32 2022] GET /identity/v3/projects/4b600a834cd24825ac13e271234139ce => generated 344 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:33.089042 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902d398-7360-4743-bb7d-350abe32507c None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:33.089401 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902d398-7360-4743-bb7d-350abe32507c None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:33.089653 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690ac1a-4450-40f1-879f-b15ebee663ef None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:33.089819 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902d398-7360-4743-bb7d-350abe32507c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:33.121813 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-a902d398-7360-4743-bb7d-350abe32507c None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:33.123385 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-a902d398-7360-4743-bb7d-350abe32507c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:33.207998 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690ac1a-4450-40f1-879f-b15ebee663ef None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:33.223817 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:33.243304 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 213/416] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:33.245334 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4ae77-bd79-4836-9a16-359fdfb490d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:33.246095 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4ae77-bd79-4836-9a16-359fdfb490d6 None admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:33.246475 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4ae77-bd79-4836-9a16-359fdfb490d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:33.246839 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4ae77-bd79-4836-9a16-359fdfb490d6 None admin] PATH_INFO: `/v3/projects/4b600a834cd24825ac13e271234139ce/groups/9645eabf030c4251a844be514b656c8f/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:33.249091 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4ae77-bd79-4836-9a16-359fdfb490d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=4b600a834cd24825ac13e271234139ce, group_id=9645eabf030c4251a844be514b656c8f, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:33.251581 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4ae77-bd79-4836-9a16-359fdfb490d6 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:33.276777 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902d398-7360-4743-bb7d-350abe32507c None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:33.285782 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:33.324166 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 204/417] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Aug 8 02:05:33 2022] PUT /identity/v3/projects/4b600a834cd24825ac13e271234139ce/groups/9645eabf030c4251a844be514b656c8f/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:05:33.420261 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902d398-7360-4743-bb7d-350abe32507c None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:33.467990 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d117d77-a97a-4df8-aa79-332671f36971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:33.468543 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d117d77-a97a-4df8-aa79-332671f36971 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:33.468868 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d117d77-a97a-4df8-aa79-332671f36971 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:33.469146 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d117d77-a97a-4df8-aa79-332671f36971 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:33.487707 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d117d77-a97a-4df8-aa79-332671f36971 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:33.492626 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-0d117d77-a97a-4df8-aa79-332671f36971 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:05:33.492626 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:33.492626 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:33.492626 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:33.492626 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:33.492626 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:33.492626 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:33.492626 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:33.492626 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:33.492626 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:33.492626 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:33.492626 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:33.492626 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:33.492626 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:33.492626 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:33.492626 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:33.493532 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:33.493532 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:33.493532 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:33.493532 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:33.493532 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:33.493532 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:33.493532 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:33.493532 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:33.493532 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:33.493532 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:33.493532 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:33.493532 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:33.493532 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:33.493532 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:33.493532 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:33.493532 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:33.494324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:33.494324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:33.494324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:33.494324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:33.494324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:33.494324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:33.494324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:33.494324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:33.494324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:33.494324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:33.494324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:05:33.494324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:33.494324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 214/418] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:05:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:05:33.500160 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4ae77-bd79-4836-9a16-359fdfb490d6 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:33.639195 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4ae77-bd79-4836-9a16-359fdfb490d6 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:33.682216 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffd697-dee1-41b5-a4bb-a2a06419d24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:33.682839 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffd697-dee1-41b5-a4bb-a2a06419d24a None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:33.683119 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffd697-dee1-41b5-a4bb-a2a06419d24a None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:33.683414 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffd697-dee1-41b5-a4bb-a2a06419d24a None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:33.684085 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ffd697-dee1-41b5-a4bb-a2a06419d24a None admin] RBAC: Adding query filter params (name=member) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:33.684388 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ffd697-dee1-41b5-a4bb-a2a06419d24a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:33.685772 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ffd697-dee1-41b5-a4bb-a2a06419d24a None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:33.699184 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 205/419] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 02:05:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:05:33.705018 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d117d77-a97a-4df8-aa79-332671f36971 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:33.777928 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:33.815813 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d117d77-a97a-4df8-aa79-332671f36971 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:33.859730 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0154f77-a4ff-4ab0-802e-521d76fc34f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:33.860333 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0154f77-a4ff-4ab0-802e-521d76fc34f4 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:33.860616 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0154f77-a4ff-4ab0-802e-521d76fc34f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:33.860888 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0154f77-a4ff-4ab0-802e-521d76fc34f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:33.953810 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0154f77-a4ff-4ab0-802e-521d76fc34f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:33.955247 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0154f77-a4ff-4ab0-802e-521d76fc34f4 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:34.034347 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:34.078838 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1c671-445f-4d90-9c2c-f613e0bcd209 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:34.079340 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1c671-445f-4d90-9c2c-f613e0bcd209 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:34.079459 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1c671-445f-4d90-9c2c-f613e0bcd209 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:34.081085 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 206/420] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:05:34.084482 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 215/421] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:05:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:05:34.089898 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1c671-445f-4d90-9c2c-f613e0bcd209 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:34.094711 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd49c56-0e61-45a7-a8fc-c39b4a3b9190 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:34.095000 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd49c56-0e61-45a7-a8fc-c39b4a3b9190 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:34.095277 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd49c56-0e61-45a7-a8fc-c39b4a3b9190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:34.119026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-dbd49c56-0e61-45a7-a8fc-c39b4a3b9190 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:34.120800 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-dbd49c56-0e61-45a7-a8fc-c39b4a3b9190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:34.153603 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:34.230482 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 216/422] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:05:34.239542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1c671-445f-4d90-9c2c-f613e0bcd209 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:34.265069 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd49c56-0e61-45a7-a8fc-c39b4a3b9190 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:34.275206 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa39ee-c59b-4e7e-aa35-8f8c8f0fe290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:34.275868 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa39ee-c59b-4e7e-aa35-8f8c8f0fe290 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:34.276150 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa39ee-c59b-4e7e-aa35-8f8c8f0fe290 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:34.276425 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa39ee-c59b-4e7e-aa35-8f8c8f0fe290 None admin] PATH_INFO: `/v3/projects/265f4aa2137047adb6e3cdec9bd23b99` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:34.277574 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa39ee-c59b-4e7e-aa35-8f8c8f0fe290 None admin] RBAC: Authorizing `identity:get_project(project_id=265f4aa2137047adb6e3cdec9bd23b99)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:34.283405 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa39ee-c59b-4e7e-aa35-8f8c8f0fe290 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:34.283405 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 207/423] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:05:34 2022] GET /identity/v3/projects/265f4aa2137047adb6e3cdec9bd23b99 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:05:34.286096 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa39ee-c59b-4e7e-aa35-8f8c8f0fe290 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:34.415850 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:34.419887 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd49c56-0e61-45a7-a8fc-c39b4a3b9190 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:34.457845 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8d525-4f48-4848-8aa2-d93f433b7b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:34.458954 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8d525-4f48-4848-8aa2-d93f433b7b87 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:34.459448 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8d525-4f48-4848-8aa2-d93f433b7b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:34.459920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8d525-4f48-4848-8aa2-d93f433b7b87 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:34.471948 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8d525-4f48-4848-8aa2-d93f433b7b87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:34.478702 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-bbf8d525-4f48-4848-8aa2-d93f433b7b87 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:05:34.478702 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:34.478702 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:34.478702 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:34.478702 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:34.478702 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:34.478702 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:34.478702 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:34.478702 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:34.478702 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:34.478702 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:34.478702 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:34.478702 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:34.478702 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:34.478702 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:34.478702 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:34.479611 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:34.479611 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:34.479611 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:34.479611 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:34.479611 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:34.479611 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:34.479611 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:34.479611 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:34.479611 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:34.479611 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:34.479611 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:34.479611 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:34.479611 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:34.479611 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:34.479611 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:34.479611 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:34.480390 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:34.480390 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:34.480390 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:34.480390 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:34.480390 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:34.480390 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:34.480390 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:34.480390 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:34.480390 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:34.480390 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:34.480390 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:05:34.480390 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:34.483402 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 217/424] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 02:05:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:05:34.489976 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8d525-4f48-4848-8aa2-d93f433b7b87 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:34.573413 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa39ee-c59b-4e7e-aa35-8f8c8f0fe290 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:34.583658 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:34.614674 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8d525-4f48-4848-8aa2-d93f433b7b87 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:34.651005 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc0e50-0efc-4ac8-af7f-32de25942ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:34.651635 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc0e50-0efc-4ac8-af7f-32de25942ddd None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:34.651922 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc0e50-0efc-4ac8-af7f-32de25942ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:34.652203 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc0e50-0efc-4ac8-af7f-32de25942ddd None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:34.653034 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc0e50-0efc-4ac8-af7f-32de25942ddd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:34.653345 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc0e50-0efc-4ac8-af7f-32de25942ddd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:34.654722 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc0e50-0efc-4ac8-af7f-32de25942ddd None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:34.663740 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 218/425] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:05:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:34.677141 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc0e50-0efc-4ac8-af7f-32de25942ddd None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:34.689132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936194b9-5d5c-43f4-afd7-5db36fb1f267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:34.689768 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936194b9-5d5c-43f4-afd7-5db36fb1f267 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:34.690050 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936194b9-5d5c-43f4-afd7-5db36fb1f267 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:34.690328 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936194b9-5d5c-43f4-afd7-5db36fb1f267 None admin] PATH_INFO: `/v3/groups/b5fe56a427fe4c98b5db69e35f77285f` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:34.691481 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936194b9-5d5c-43f4-afd7-5db36fb1f267 None admin] RBAC: Authorizing `identity:get_group(group_id=b5fe56a427fe4c98b5db69e35f77285f)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:34.692920 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936194b9-5d5c-43f4-afd7-5db36fb1f267 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:34.694503 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 208/426] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 8 02:05:34 2022] GET /identity/v3/groups/b5fe56a427fe4c98b5db69e35f77285f => generated 226 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:34.704361 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936194b9-5d5c-43f4-afd7-5db36fb1f267 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:34.707814 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:34.811738 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936194b9-5d5c-43f4-afd7-5db36fb1f267 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:34.857506 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd795dcd-afcf-46e0-bad5-f70da9c396d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:34.858039 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd795dcd-afcf-46e0-bad5-f70da9c396d2 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:34.858322 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd795dcd-afcf-46e0-bad5-f70da9c396d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:34.858600 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd795dcd-afcf-46e0-bad5-f70da9c396d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:34.859329 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd795dcd-afcf-46e0-bad5-f70da9c396d2 None admin] RBAC: Adding query filter params (group.id=b5fe56a427fe4c98b5db69e35f77285f, role.id=5691bce246d6452990f13933e19f2825, scope.project.id=265f4aa2137047adb6e3cdec9bd23b99) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:34.859669 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd795dcd-afcf-46e0-bad5-f70da9c396d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:34.861075 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd795dcd-afcf-46e0-bad5-f70da9c396d2 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:34.870661 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc0e50-0efc-4ac8-af7f-32de25942ddd None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:34.876423 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 209/427] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Aug 8 02:05:34 2022] GET /identity/v3/role_assignments?group.id=b5fe56a427fe4c98b5db69e35f77285f&scope.project.id=265f4aa2137047adb6e3cdec9bd23b99&role.id=5691bce246d6452990f13933e19f2825 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:34.877642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70579fe7-b953-4bd5-9926-f2ea51deecbf None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:34.877928 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70579fe7-b953-4bd5-9926-f2ea51deecbf None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:34.884256 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70579fe7-b953-4bd5-9926-f2ea51deecbf None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:34.884256 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 210/428] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:34.889731 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8392f-7de6-4eb5-bdd0-9a8d81a2980b None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:34.890013 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8392f-7de6-4eb5-bdd0-9a8d81a2980b None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:34.890295 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8392f-7de6-4eb5-bdd0-9a8d81a2980b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:34.920304 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-74d8392f-7de6-4eb5-bdd0-9a8d81a2980b None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:34.921537 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-74d8392f-7de6-4eb5-bdd0-9a8d81a2980b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:34.954312 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf2a4b-27e2-4493-8b37-0213d514a209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:34.954952 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf2a4b-27e2-4493-8b37-0213d514a209 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:34.955234 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf2a4b-27e2-4493-8b37-0213d514a209 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:34.955603 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf2a4b-27e2-4493-8b37-0213d514a209 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:34.987753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:35.061613 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 211/429] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:05:35.078107 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf2a4b-27e2-4493-8b37-0213d514a209 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:35.080039 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf2a4b-27e2-4493-8b37-0213d514a209 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:35.093269 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8392f-7de6-4eb5-bdd0-9a8d81a2980b None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:35.101352 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:35.210553 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 219/430] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:05:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:05:35.216630 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf2a4b-27e2-4493-8b37-0213d514a209 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:35.230789 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8392f-7de6-4eb5-bdd0-9a8d81a2980b None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:35.270478 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d4267-092b-4753-9083-42878e696a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:35.271107 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d4267-092b-4753-9083-42878e696a85 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:35.271547 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d4267-092b-4753-9083-42878e696a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:35.271659 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d4267-092b-4753-9083-42878e696a85 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:35.284108 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d4267-092b-4753-9083-42878e696a85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:35.289224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-f67d4267-092b-4753-9083-42878e696a85 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:05:35.289224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:35.289224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:35.289224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:35.289224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:35.289224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:35.289224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:35.289224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:35.289224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:35.289224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:35.289224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:35.289224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:35.289224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:35.289224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:35.289224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:35.289224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:35.290253 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:35.290253 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:35.290253 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:35.290253 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:35.290253 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:35.290253 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:35.290253 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:35.290253 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:35.290253 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:35.290253 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:35.290253 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:35.290253 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:35.290253 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:35.290253 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:35.290253 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:35.290253 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:35.291015 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:35.291015 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:35.291015 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:35.291015 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:35.291015 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:35.291015 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:35.291015 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:35.291015 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:35.291015 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:35.291015 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:35.291015 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 02:05:35.291015 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:35.291015 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 212/431] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:05:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:35.297099 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d4267-092b-4753-9083-42878e696a85 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:35.328241 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:35.361577 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf2a4b-27e2-4493-8b37-0213d514a209 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:35.390146 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:35.412801 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8bdc4d-0c0f-418b-bf2c-7cf9015662b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:35.413442 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8bdc4d-0c0f-418b-bf2c-7cf9015662b2 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:35.413732 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8bdc4d-0c0f-418b-bf2c-7cf9015662b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:35.414009 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8bdc4d-0c0f-418b-bf2c-7cf9015662b2 None admin] PATH_INFO: `/v3/projects/265f4aa2137047adb6e3cdec9bd23b99` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:35.416366 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8bdc4d-0c0f-418b-bf2c-7cf9015662b2 None admin] RBAC: Authorizing `identity:get_project(project_id=265f4aa2137047adb6e3cdec9bd23b99)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:35.418516 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8bdc4d-0c0f-418b-bf2c-7cf9015662b2 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:35.420929 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 220/432] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:05:35 2022] GET /identity/v3/projects/265f4aa2137047adb6e3cdec9bd23b99 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:05:35.422559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bba57-bb04-4f22-b828-05accbadac2e None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:35.423684 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bba57-bb04-4f22-b828-05accbadac2e None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:35.423968 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bba57-bb04-4f22-b828-05accbadac2e None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:35.426407 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 221/433] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:35.427594 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143bba57-bb04-4f22-b828-05accbadac2e None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:35.430513 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d4267-092b-4753-9083-42878e696a85 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:35.478275 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5735b3-aa2c-4262-a0f9-10997b8f260b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:35.479137 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5735b3-aa2c-4262-a0f9-10997b8f260b None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:35.479631 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5735b3-aa2c-4262-a0f9-10997b8f260b None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:35.480113 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5735b3-aa2c-4262-a0f9-10997b8f260b None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:35.481102 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5735b3-aa2c-4262-a0f9-10997b8f260b None admin] RBAC: Adding query filter params (name=member) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:35.481734 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5735b3-aa2c-4262-a0f9-10997b8f260b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:35.483439 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5735b3-aa2c-4262-a0f9-10997b8f260b None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:35.493814 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 213/434] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 02:05:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:35.500688 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fbd45-0539-4f7f-9b91-0b2c09e35cce None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:35.500688 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fbd45-0539-4f7f-9b91-0b2c09e35cce None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:35.500688 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fbd45-0539-4f7f-9b91-0b2c09e35cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:35.524278 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-2e7fbd45-0539-4f7f-9b91-0b2c09e35cce None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:35.525474 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-2e7fbd45-0539-4f7f-9b91-0b2c09e35cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:35.558036 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143bba57-bb04-4f22-b828-05accbadac2e None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:35.607651 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d8a966-e5a4-4e1f-a955-675d9ec136a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:35.608812 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8a966-e5a4-4e1f-a955-675d9ec136a1 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:35.609310 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8a966-e5a4-4e1f-a955-675d9ec136a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:35.609783 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8a966-e5a4-4e1f-a955-675d9ec136a1 None admin] PATH_INFO: `/v3/groups/b5fe56a427fe4c98b5db69e35f77285f` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:35.611058 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d8a966-e5a4-4e1f-a955-675d9ec136a1 None admin] RBAC: Authorizing `identity:get_group(group_id=b5fe56a427fe4c98b5db69e35f77285f)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:35.611531 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 214/435] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:35.612362 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fbd45-0539-4f7f-9b91-0b2c09e35cce None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:35.613292 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d8a966-e5a4-4e1f-a955-675d9ec136a1 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:35.616286 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 222/436] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 8 02:05:35 2022] GET /identity/v3/groups/b5fe56a427fe4c98b5db69e35f77285f => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:35.624259 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d8a966-e5a4-4e1f-a955-675d9ec136a1 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:35.634629 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:35.682368 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:35.718008 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fbd45-0539-4f7f-9b91-0b2c09e35cce None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:35.729844 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d8a966-e5a4-4e1f-a955-675d9ec136a1 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:35.750782 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7fa20-83b6-4414-8419-99f8c469f7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:35.751412 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7fa20-83b6-4414-8419-99f8c469f7f4 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:35.751696 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7fa20-83b6-4414-8419-99f8c469f7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:35.751969 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7fa20-83b6-4414-8419-99f8c469f7f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:35.767739 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50384837-6d48-4f12-958d-1d20c83ef5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:35.768331 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50384837-6d48-4f12-958d-1d20c83ef5ec None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:35.768618 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50384837-6d48-4f12-958d-1d20c83ef5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:35.768884 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50384837-6d48-4f12-958d-1d20c83ef5ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:35.769602 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50384837-6d48-4f12-958d-1d20c83ef5ec None admin] RBAC: Adding query filter params (group.id=b5fe56a427fe4c98b5db69e35f77285f, role.id=e513bb6d8f644c1d9156090e507a03d4, scope.project.id=265f4aa2137047adb6e3cdec9bd23b99) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:35.769905 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50384837-6d48-4f12-958d-1d20c83ef5ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:35.771333 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50384837-6d48-4f12-958d-1d20c83ef5ec None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:35.777747 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 223/437] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Aug 8 02:05:35 2022] GET /identity/v3/role_assignments?group.id=b5fe56a427fe4c98b5db69e35f77285f&scope.project.id=265f4aa2137047adb6e3cdec9bd23b99&role.id=e513bb6d8f644c1d9156090e507a03d4 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:35.778344 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50384837-6d48-4f12-958d-1d20c83ef5ec None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:35.846427 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7fa20-83b6-4414-8419-99f8c469f7f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:35.849184 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7fa20-83b6-4414-8419-99f8c469f7f4 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:35.876709 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:35.917208 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50384837-6d48-4f12-958d-1d20c83ef5ec None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:35.936363 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:35.953704 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765cb00b-670a-409f-b16a-8aaa823424c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:35.954344 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765cb00b-670a-409f-b16a-8aaa823424c8 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:35.954630 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765cb00b-670a-409f-b16a-8aaa823424c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:35.954909 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765cb00b-670a-409f-b16a-8aaa823424c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:35.966210 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765cb00b-670a-409f-b16a-8aaa823424c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:35.970872 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-765cb00b-670a-409f-b16a-8aaa823424c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:05:35.970872 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:35.970872 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:35.970872 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:35.970872 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:35.970872 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:35.970872 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:35.970872 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:35.970872 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:35.970872 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:35.970872 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:35.970872 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:35.970872 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:35.970872 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:35.970872 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:35.970872 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:35.971892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:35.971892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:35.971892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:35.971892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:35.971892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:35.971892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:35.971892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:35.971892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:35.971892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:35.971892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:35.971892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:35.971892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:35.971892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:35.971892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:35.971892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:35.971892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:35.972664 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:35.972664 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:35.972664 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:35.972664 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:35.972664 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:35.972664 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:35.972664 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:35.972664 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:35.972664 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:35.972664 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:35.972664 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:05:35.972664 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:35.972664 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 224/438] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 02:05:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:35.973914 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c038296-16e5-4ec5-ae54-4f78501da77f None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:35.973914 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c038296-16e5-4ec5-ae54-4f78501da77f None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:35.973914 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c038296-16e5-4ec5-ae54-4f78501da77f None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:35.975393 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 225/439] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:35.979107 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 215/440] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:05:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:05:35.980727 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c038296-16e5-4ec5-ae54-4f78501da77f None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:35.981211 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5f7fe-a427-4d20-b432-c34b9939d1cc None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:35.981594 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5f7fe-a427-4d20-b432-c34b9939d1cc None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:35.982021 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5f7fe-a427-4d20-b432-c34b9939d1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:36.005840 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-62e5f7fe-a427-4d20-b432-c34b9939d1cc None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:36.007032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-62e5f7fe-a427-4d20-b432-c34b9939d1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:36.088832 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 216/441] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 08 02:05:36.089692 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5f7fe-a427-4d20-b432-c34b9939d1cc None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:36.102111 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c038296-16e5-4ec5-ae54-4f78501da77f None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:36.144439 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2951e-0f66-4027-b2ee-5adb237bddcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:36.145369 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2951e-0f66-4027-b2ee-5adb237bddcc None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:36.145673 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2951e-0f66-4027-b2ee-5adb237bddcc None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:36.145946 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2951e-0f66-4027-b2ee-5adb237bddcc None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:36.146839 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2951e-0f66-4027-b2ee-5adb237bddcc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:36.146961 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2951e-0f66-4027-b2ee-5adb237bddcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:36.148299 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2951e-0f66-4027-b2ee-5adb237bddcc None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:36.153378 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:36.158101 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 226/442] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:05:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:36.158867 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2951e-0f66-4027-b2ee-5adb237bddcc None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:36.204088 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:36.212920 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5f7fe-a427-4d20-b432-c34b9939d1cc None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:36.247887 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b14aa-f0a1-4b0d-9db3-f53434b90a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:36.248431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b14aa-f0a1-4b0d-9db3-f53434b90a5e None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:36.248714 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b14aa-f0a1-4b0d-9db3-f53434b90a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:36.248990 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b14aa-f0a1-4b0d-9db3-f53434b90a5e None admin] PATH_INFO: `/v3/projects/f15701875ea24854a2a23f51fa4c6364` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:36.250122 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b14aa-f0a1-4b0d-9db3-f53434b90a5e None admin] RBAC: Authorizing `identity:get_project(project_id=f15701875ea24854a2a23f51fa4c6364)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:36.251577 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b14aa-f0a1-4b0d-9db3-f53434b90a5e None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:36.253201 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 217/443] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:05:36 2022] GET /identity/v3/projects/f15701875ea24854a2a23f51fa4c6364 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:36.253952 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b14aa-f0a1-4b0d-9db3-f53434b90a5e None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:36.261411 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2951e-0f66-4027-b2ee-5adb237bddcc None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:36.293386 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95e63b-e370-47ff-ae6e-af79658c3d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:36.294000 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95e63b-e370-47ff-ae6e-af79658c3d81 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:36.294277 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95e63b-e370-47ff-ae6e-af79658c3d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:36.294546 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95e63b-e370-47ff-ae6e-af79658c3d81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:36.304521 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e95e63b-e370-47ff-ae6e-af79658c3d81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:36.310400 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-2e95e63b-e370-47ff-ae6e-af79658c3d81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:05:36.310400 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:36.310400 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:36.310400 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:36.310400 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:36.310400 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:36.310400 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:36.310400 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:36.310400 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:36.310400 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:36.310400 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:36.310400 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:36.310400 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:36.310400 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:36.310400 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:36.310400 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:36.311267 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:36.311267 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:36.311267 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:36.311267 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:36.311267 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:36.311267 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:36.311267 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:36.311267 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:36.311267 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:36.311267 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:36.311267 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:36.311267 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:36.311267 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:36.311267 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:36.311267 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:36.311267 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:36.312081 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:36.312081 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:36.312081 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:36.312081 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:36.312081 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:36.312081 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:36.312081 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:36.312081 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:36.312081 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:36.312081 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:36.312081 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:05:36.312081 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:36.312081 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 227/444] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 02:05:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:36.312719 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95e63b-e370-47ff-ae6e-af79658c3d81 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:36.358271 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b14aa-f0a1-4b0d-9db3-f53434b90a5e None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:36.374802 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:36.393783 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727d27a-7cee-4474-a7d3-ae2fa558599e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:36.394385 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727d27a-7cee-4474-a7d3-ae2fa558599e None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:36.394661 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727d27a-7cee-4474-a7d3-ae2fa558599e None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:36.394935 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727d27a-7cee-4474-a7d3-ae2fa558599e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:36.408537 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:36.411424 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95e63b-e370-47ff-ae6e-af79658c3d81 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:36.445731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff0ee2-12db-4938-af75-5caaa6028aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:36.446879 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff0ee2-12db-4938-af75-5caaa6028aae None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:36.447162 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff0ee2-12db-4938-af75-5caaa6028aae None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:36.447474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff0ee2-12db-4938-af75-5caaa6028aae None admin] PATH_INFO: `/v3/groups/b5fe56a427fe4c98b5db69e35f77285f` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:36.448600 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff0ee2-12db-4938-af75-5caaa6028aae None admin] RBAC: Authorizing `identity:get_group(group_id=b5fe56a427fe4c98b5db69e35f77285f)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:36.450062 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff0ee2-12db-4938-af75-5caaa6028aae None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:36.456338 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 228/445] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 8 02:05:36 2022] GET /identity/v3/groups/b5fe56a427fe4c98b5db69e35f77285f => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:36.456338 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff0ee2-12db-4938-af75-5caaa6028aae None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:36.469967 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b727d27a-7cee-4474-a7d3-ae2fa558599e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:36.471506 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b727d27a-7cee-4474-a7d3-ae2fa558599e None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:36.561551 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff0ee2-12db-4938-af75-5caaa6028aae None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:36.568293 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 218/446] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:05:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:05:36.569193 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727d27a-7cee-4474-a7d3-ae2fa558599e None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:36.587948 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:36.596575 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027677f-9e37-4069-b908-d4ff30464fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:36.599951 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027677f-9e37-4069-b908-d4ff30464fdf None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:36.599951 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027677f-9e37-4069-b908-d4ff30464fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:36.599951 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027677f-9e37-4069-b908-d4ff30464fdf None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:36.599951 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5027677f-9e37-4069-b908-d4ff30464fdf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:36.599951 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5027677f-9e37-4069-b908-d4ff30464fdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:36.600376 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5027677f-9e37-4069-b908-d4ff30464fdf None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:36.608668 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 229/447] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:05:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:36.609439 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027677f-9e37-4069-b908-d4ff30464fdf None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:36.641357 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:36.668369 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727d27a-7cee-4474-a7d3-ae2fa558599e None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:36.701305 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374df1c3-622a-4e4b-8728-cb2f52a7009c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:36.701904 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374df1c3-622a-4e4b-8728-cb2f52a7009c None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:36.702184 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374df1c3-622a-4e4b-8728-cb2f52a7009c None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:36.702465 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374df1c3-622a-4e4b-8728-cb2f52a7009c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:36.703180 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374df1c3-622a-4e4b-8728-cb2f52a7009c None admin] RBAC: Adding query filter params (group.id=b5fe56a427fe4c98b5db69e35f77285f, role.id=5691bce246d6452990f13933e19f2825, scope.project.id=f15701875ea24854a2a23f51fa4c6364) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:36.703521 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374df1c3-622a-4e4b-8728-cb2f52a7009c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:36.704930 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374df1c3-622a-4e4b-8728-cb2f52a7009c None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:36.708023 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027677f-9e37-4069-b908-d4ff30464fdf None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:36.710507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 219/448] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Aug 8 02:05:36 2022] GET /identity/v3/role_assignments?group.id=b5fe56a427fe4c98b5db69e35f77285f&scope.project.id=f15701875ea24854a2a23f51fa4c6364&role.id=5691bce246d6452990f13933e19f2825 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:36.711268 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374df1c3-622a-4e4b-8728-cb2f52a7009c None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:36.755609 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c61974-90c6-422c-88ac-b279313ec7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:36.756294 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c61974-90c6-422c-88ac-b279313ec7ba None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:36.756534 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c61974-90c6-422c-88ac-b279313ec7ba None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:36.756807 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c61974-90c6-422c-88ac-b279313ec7ba None admin] PATH_INFO: `/v3/projects/f15701875ea24854a2a23f51fa4c6364` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:36.758038 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c61974-90c6-422c-88ac-b279313ec7ba None admin] RBAC: Authorizing `identity:get_project(project_id=f15701875ea24854a2a23f51fa4c6364)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:36.760183 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c61974-90c6-422c-88ac-b279313ec7ba None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:36.762114 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 230/449] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:05:36 2022] GET /identity/v3/projects/f15701875ea24854a2a23f51fa4c6364 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:36.768301 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c61974-90c6-422c-88ac-b279313ec7ba None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:36.806926 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:36.829461 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374df1c3-622a-4e4b-8728-cb2f52a7009c None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:36.878499 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec3d38-082b-4f60-8162-0b6f2ca4054e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:36.879886 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec3d38-082b-4f60-8162-0b6f2ca4054e None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:36.879886 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec3d38-082b-4f60-8162-0b6f2ca4054e None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:36.879886 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec3d38-082b-4f60-8162-0b6f2ca4054e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:36.887016 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:36.891443 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c61974-90c6-422c-88ac-b279313ec7ba None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:36.936634 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e41456-0b8a-4fe2-ac23-1de5ecfcc867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:36.937083 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e41456-0b8a-4fe2-ac23-1de5ecfcc867 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:36.937346 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e41456-0b8a-4fe2-ac23-1de5ecfcc867 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:36.938193 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e41456-0b8a-4fe2-ac23-1de5ecfcc867 None admin] PATH_INFO: `/v3/groups/b5fe56a427fe4c98b5db69e35f77285f` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:36.939507 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e41456-0b8a-4fe2-ac23-1de5ecfcc867 None admin] RBAC: Authorizing `identity:get_group(group_id=b5fe56a427fe4c98b5db69e35f77285f)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:36.941000 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e41456-0b8a-4fe2-ac23-1de5ecfcc867 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:36.944049 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 231/450] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 8 02:05:36 2022] GET /identity/v3/groups/b5fe56a427fe4c98b5db69e35f77285f => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:05:36.948645 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e41456-0b8a-4fe2-ac23-1de5ecfcc867 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:36.962891 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec3d38-082b-4f60-8162-0b6f2ca4054e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:36.964405 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec3d38-082b-4f60-8162-0b6f2ca4054e None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:37.057679 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:37.066756 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e41456-0b8a-4fe2-ac23-1de5ecfcc867 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:37.081821 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 220/451] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:05:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:05:37.087333 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec3d38-082b-4f60-8162-0b6f2ca4054e None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:37.105450 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c263e5a-f084-42f2-a9ec-9b99be37dfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:37.106047 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c263e5a-f084-42f2-a9ec-9b99be37dfd1 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:37.106325 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c263e5a-f084-42f2-a9ec-9b99be37dfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:37.106593 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c263e5a-f084-42f2-a9ec-9b99be37dfd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:37.107299 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c263e5a-f084-42f2-a9ec-9b99be37dfd1 None admin] RBAC: Adding query filter params (group.id=b5fe56a427fe4c98b5db69e35f77285f, role.id=e513bb6d8f644c1d9156090e507a03d4, scope.project.id=f15701875ea24854a2a23f51fa4c6364) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:37.107636 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c263e5a-f084-42f2-a9ec-9b99be37dfd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:37.109056 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c263e5a-f084-42f2-a9ec-9b99be37dfd1 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:37.114748 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 232/452] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Aug 8 02:05:36 2022] GET /identity/v3/role_assignments?group.id=b5fe56a427fe4c98b5db69e35f77285f&scope.project.id=f15701875ea24854a2a23f51fa4c6364&role.id=e513bb6d8f644c1d9156090e507a03d4 => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:05:37.197303 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec3d38-082b-4f60-8162-0b6f2ca4054e None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:37.242794 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0cd95d-7c7b-4130-98bd-79ceaa2aeabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:37.243496 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0cd95d-7c7b-4130-98bd-79ceaa2aeabe None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:37.243776 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0cd95d-7c7b-4130-98bd-79ceaa2aeabe None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:37.244045 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0cd95d-7c7b-4130-98bd-79ceaa2aeabe None admin] PATH_INFO: `/v3/projects/4b600a834cd24825ac13e271234139ce` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:37.245191 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0cd95d-7c7b-4130-98bd-79ceaa2aeabe None admin] RBAC: Authorizing `identity:get_project(project_id=4b600a834cd24825ac13e271234139ce)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:37.246621 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0cd95d-7c7b-4130-98bd-79ceaa2aeabe None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:37.248293 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 221/453] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:05:37 2022] GET /identity/v3/projects/4b600a834cd24825ac13e271234139ce => generated 344 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:05:37.254003 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c263e5a-f084-42f2-a9ec-9b99be37dfd1 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:37.286765 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:37.356487 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c263e5a-f084-42f2-a9ec-9b99be37dfd1 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:37.390571 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2014a-d265-4f89-b6e0-a1093737dda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:37.391203 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2014a-d265-4f89-b6e0-a1093737dda3 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:37.391584 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2014a-d265-4f89-b6e0-a1093737dda3 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:37.391855 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2014a-d265-4f89-b6e0-a1093737dda3 None admin] PATH_INFO: `/v3/groups/9645eabf030c4251a844be514b656c8f` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:37.392942 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2014a-d265-4f89-b6e0-a1093737dda3 None admin] RBAC: Authorizing `identity:get_group(group_id=9645eabf030c4251a844be514b656c8f)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:37.394376 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2014a-d265-4f89-b6e0-a1093737dda3 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:37.395953 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 233/454] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 8 02:05:37 2022] GET /identity/v3/groups/9645eabf030c4251a844be514b656c8f => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:37.402292 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0cd95d-7c7b-4130-98bd-79ceaa2aeabe None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:37.453373 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:37.503342 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0cd95d-7c7b-4130-98bd-79ceaa2aeabe None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:37.539128 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4aa8b-f666-4854-822e-219a02712ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:37.539795 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4aa8b-f666-4854-822e-219a02712ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:37.540079 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4aa8b-f666-4854-822e-219a02712ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:37.540354 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4aa8b-f666-4854-822e-219a02712ee1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:37.541071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d4aa8b-f666-4854-822e-219a02712ee1 None admin] RBAC: Adding query filter params (group.id=9645eabf030c4251a844be514b656c8f, role.id=84da65a75e544d1191ec53cb6b05aa73, scope.project.id=4b600a834cd24825ac13e271234139ce) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:37.541404 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d4aa8b-f666-4854-822e-219a02712ee1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:37.542813 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d4aa8b-f666-4854-822e-219a02712ee1 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:37.548421 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 222/455] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Aug 8 02:05:37 2022] GET /identity/v3/role_assignments?group.id=9645eabf030c4251a844be514b656c8f&scope.project.id=4b600a834cd24825ac13e271234139ce&role.id=84da65a75e544d1191ec53cb6b05aa73 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:40.107915 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab783d-f7b2-481c-b23a-98930c6261d9 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:40.108465 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab783d-f7b2-481c-b23a-98930c6261d9 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:40.108465 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab783d-f7b2-481c-b23a-98930c6261d9 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:40.110080 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 234/456] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:40.115140 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40a72d-ef87-47b1-850f-5f1b7bc55f1d None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:40.115560 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40a72d-ef87-47b1-850f-5f1b7bc55f1d None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:40.115723 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40a72d-ef87-47b1-850f-5f1b7bc55f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:40.140355 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-0c40a72d-ef87-47b1-850f-5f1b7bc55f1d None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:40.141571 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-0c40a72d-ef87-47b1-850f-5f1b7bc55f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:40.157794 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8a00e-db56-4a49-94e7-b2ea4d8ba9e6 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:40.158343 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8a00e-db56-4a49-94e7-b2ea4d8ba9e6 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:40.158868 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8a00e-db56-4a49-94e7-b2ea4d8ba9e6 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:40.160666 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 235/457] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:40.169860 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124baf8b-323e-4d81-909d-f42155965882 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:40.170388 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124baf8b-323e-4d81-909d-f42155965882 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:40.170864 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124baf8b-323e-4d81-909d-f42155965882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:40.205119 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-124baf8b-323e-4d81-909d-f42155965882 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:40.208342 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-124baf8b-323e-4d81-909d-f42155965882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:40.245764 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 223/458] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:40.269021 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1da31-272b-401e-a8c0-ac41d4e65cdf None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:40.269576 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1da31-272b-401e-a8c0-ac41d4e65cdf None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:40.270031 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1da31-272b-401e-a8c0-ac41d4e65cdf None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:40.271593 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 224/459] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:05:40.277058 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b74fcf-3693-4e55-bf79-6b09abc86ba8 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:40.277569 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b74fcf-3693-4e55-bf79-6b09abc86ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:40.278039 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b74fcf-3693-4e55-bf79-6b09abc86ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:40.299696 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-07b74fcf-3693-4e55-bf79-6b09abc86ba8 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:40.301804 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-07b74fcf-3693-4e55-bf79-6b09abc86ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:40.309079 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 236/460] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:05:40.315381 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124baf8b-323e-4d81-909d-f42155965882 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:40.356176 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:40.358043 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:40.390900 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 225/461] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:05:40.392083 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b74fcf-3693-4e55-bf79-6b09abc86ba8 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:40.430507 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124baf8b-323e-4d81-909d-f42155965882 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:40.474131 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c6f8d-54fc-43f6-8cca-cf2c5d273f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:40.475044 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c6f8d-54fc-43f6-8cca-cf2c5d273f8d None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:40.475516 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c6f8d-54fc-43f6-8cca-cf2c5d273f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:40.475976 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c6f8d-54fc-43f6-8cca-cf2c5d273f8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:40.487135 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c6f8d-54fc-43f6-8cca-cf2c5d273f8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:40.488804 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c6f8d-54fc-43f6-8cca-cf2c5d273f8d None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:40.504753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-964c6f8d-54fc-43f6-8cca-cf2c5d273f8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:40.504753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:40.504753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:40.504753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:40.504753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:40.504753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:40.504753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:40.504753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:40.504753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:40.504753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:40.504753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:40.504753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:40.504753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:05:40.504753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:05:40.504753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:05:40.504753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:05:40.505704 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:40.505704 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:40.505704 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:40.505704 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:40.505704 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:40.505704 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:40.505704 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:40.505704 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:40.505704 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:40.505704 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:40.505704 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:40.505704 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:40.505704 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:40.505704 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:40.505704 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:40.505704 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:40.505704 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:05:40.506573 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:05:40.506573 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:40.506573 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:40.508779 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 237/462] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:05:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:40.513755 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c6f8d-54fc-43f6-8cca-cf2c5d273f8d None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:40.523757 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b74fcf-3693-4e55-bf79-6b09abc86ba8 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:40.560232 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ac05d-0d8d-4051-b6c6-c9a708e141ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:40.560863 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ac05d-0d8d-4051-b6c6-c9a708e141ac None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:40.561143 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ac05d-0d8d-4051-b6c6-c9a708e141ac None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:40.561609 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ac05d-0d8d-4051-b6c6-c9a708e141ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:40.573413 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ac05d-0d8d-4051-b6c6-c9a708e141ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:40.575472 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ac05d-0d8d-4051-b6c6-c9a708e141ac None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:40.595751 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-bc6ac05d-0d8d-4051-b6c6-c9a708e141ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:40.595751 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:40.595751 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:40.595751 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:40.595751 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:40.595751 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:40.595751 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:40.595751 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:40.595751 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:40.595751 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:40.595751 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:40.595751 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:40.595751 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:05:40.595751 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:05:40.595751 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:05:40.595751 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:05:40.596712 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:40.596712 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:40.596712 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:40.596712 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:40.596712 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:40.596712 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:40.596712 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:40.596712 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:40.596712 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:40.596712 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:40.596712 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:40.596712 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:40.596712 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:40.596712 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:40.596712 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:40.596712 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:40.596712 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:05:40.597627 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:05:40.597627 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:40.597627 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:40.597787 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 226/463] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:05:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:40.599837 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0b451-e197-4651-a63e-9101bdb4fd2f None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:40.600287 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0b451-e197-4651-a63e-9101bdb4fd2f None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:40.600786 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0b451-e197-4651-a63e-9101bdb4fd2f None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:40.603643 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 227/464] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:40.608340 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0b451-e197-4651-a63e-9101bdb4fd2f None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:40.618962 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:40.641129 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c6f8d-54fc-43f6-8cca-cf2c5d273f8d None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:40.642146 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:40.677508 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35e39e-9f9d-45a8-9a71-c97c5dca7094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:40.678381 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35e39e-9f9d-45a8-9a71-c97c5dca7094 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:40.678670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35e39e-9f9d-45a8-9a71-c97c5dca7094 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:40.678944 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35e39e-9f9d-45a8-9a71-c97c5dca7094 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:40.690506 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35e39e-9f9d-45a8-9a71-c97c5dca7094 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:40.692008 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35e39e-9f9d-45a8-9a71-c97c5dca7094 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:40.707656 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-9d35e39e-9f9d-45a8-9a71-c97c5dca7094 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:40.707656 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:40.707656 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:40.707656 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:40.707656 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:40.707656 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:40.707656 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:40.707656 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:40.707656 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:40.707656 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:40.707656 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:40.707656 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:40.707656 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:05:40.707656 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:05:40.707656 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:05:40.707656 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:05:40.708744 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:40.708744 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:40.708744 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:40.708744 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:40.708744 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:40.708744 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:40.708744 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:40.708744 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:40.708744 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:40.708744 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:40.708744 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:40.708744 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:40.708744 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:40.708744 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:40.708744 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:40.708744 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:40.708744 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:05:40.709746 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:05:40.709746 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:40.709746 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:40.709746 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 238/465] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:05:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:40.709746 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35e39e-9f9d-45a8-9a71-c97c5dca7094 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:40.740424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0b451-e197-4651-a63e-9101bdb4fd2f None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:40.777959 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d9b5f-42ee-41f1-b7ed-8c06bcb838f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:40.778564 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d9b5f-42ee-41f1-b7ed-8c06bcb838f0 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:40.778846 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d9b5f-42ee-41f1-b7ed-8c06bcb838f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:40.779110 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d9b5f-42ee-41f1-b7ed-8c06bcb838f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:40.779798 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d9b5f-42ee-41f1-b7ed-8c06bcb838f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:40.780100 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d9b5f-42ee-41f1-b7ed-8c06bcb838f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:40.781573 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d9b5f-42ee-41f1-b7ed-8c06bcb838f0 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:40.793749 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 228/466] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:40.794811 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52ffb4-4ec8-4eba-9793-6d693e038b02 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:40.795188 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52ffb4-4ec8-4eba-9793-6d693e038b02 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:40.795404 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52ffb4-4ec8-4eba-9793-6d693e038b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:40.815969 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-7f52ffb4-4ec8-4eba-9793-6d693e038b02 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:40.817220 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-7f52ffb4-4ec8-4eba-9793-6d693e038b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:40.821885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35e39e-9f9d-45a8-9a71-c97c5dca7094 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:40.855545 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:40.861632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29640331-cf8b-4c9a-93fd-cb9c09d8ee39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:40.862797 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29640331-cf8b-4c9a-93fd-cb9c09d8ee39 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:40.863561 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29640331-cf8b-4c9a-93fd-cb9c09d8ee39 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:40.864010 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29640331-cf8b-4c9a-93fd-cb9c09d8ee39 None admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:40.869844 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29640331-cf8b-4c9a-93fd-cb9c09d8ee39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:40.869844 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29640331-cf8b-4c9a-93fd-cb9c09d8ee39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:40.869844 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29640331-cf8b-4c9a-93fd-cb9c09d8ee39 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:40.890989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 229/467] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:40.890989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52ffb4-4ec8-4eba-9793-6d693e038b02 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:40.891459 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 239/468] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:40.892475 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29640331-cf8b-4c9a-93fd-cb9c09d8ee39 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:40.909885 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:41.007023 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29640331-cf8b-4c9a-93fd-cb9c09d8ee39 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:41.007988 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52ffb4-4ec8-4eba-9793-6d693e038b02 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:41.044163 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b8c682-df49-424f-834a-5bdc78d8cfe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:41.044828 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8c682-df49-424f-834a-5bdc78d8cfe4 None admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:41.045113 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8c682-df49-424f-834a-5bdc78d8cfe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:41.045389 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8c682-df49-424f-834a-5bdc78d8cfe4 None admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:41.046200 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b8c682-df49-424f-834a-5bdc78d8cfe4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:41.047492 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b8c682-df49-424f-834a-5bdc78d8cfe4 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:41.047680 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab2902-8d1b-4715-9748-af7a9a66d3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:41.048290 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab2902-8d1b-4715-9748-af7a9a66d3b0 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:41.048571 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab2902-8d1b-4715-9748-af7a9a66d3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:41.048845 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab2902-8d1b-4715-9748-af7a9a66d3b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:41.049492 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab2902-8d1b-4715-9748-af7a9a66d3b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:41.049795 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab2902-8d1b-4715-9748-af7a9a66d3b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:41.051153 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab2902-8d1b-4715-9748-af7a9a66d3b0 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:41.064865 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 230/469] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:41.065669 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab2902-8d1b-4715-9748-af7a9a66d3b0 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:41.146210 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:41.156165 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 240/470] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 8 02:05:40 2022] POST /identity/v3/users => generated 246 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:05:41.157810 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b8c682-df49-424f-834a-5bdc78d8cfe4 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:41.182352 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab2902-8d1b-4715-9748-af7a9a66d3b0 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:41.232617 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c142fc-6579-4fe3-bbc5-b2e45f4eac9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:41.233614 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c142fc-6579-4fe3-bbc5-b2e45f4eac9a None admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:41.234119 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c142fc-6579-4fe3-bbc5-b2e45f4eac9a None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:41.235182 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c142fc-6579-4fe3-bbc5-b2e45f4eac9a None admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:41.236076 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c142fc-6579-4fe3-bbc5-b2e45f4eac9a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:41.237748 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c142fc-6579-4fe3-bbc5-b2e45f4eac9a None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:41.270155 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:41.303097 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 231/471] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 8 02:05:41 2022] POST /identity/v3/users => generated 248 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:05:41.304468 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c142fc-6579-4fe3-bbc5-b2e45f4eac9a None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:41.420460 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b8c682-df49-424f-834a-5bdc78d8cfe4 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:41.467259 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c142fc-6579-4fe3-bbc5-b2e45f4eac9a None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:41.481772 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c462686-19d3-4484-a8aa-2c44c5660da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:41.482678 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c462686-19d3-4484-a8aa-2c44c5660da2 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:41.483540 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c462686-19d3-4484-a8aa-2c44c5660da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:41.483827 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c462686-19d3-4484-a8aa-2c44c5660da2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:41.499188 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c462686-19d3-4484-a8aa-2c44c5660da2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:41.501397 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c462686-19d3-4484-a8aa-2c44c5660da2 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:41.503548 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:41.510414 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa16c8c-2c6d-4148-9241-4fe90b9e1517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:41.511114 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa16c8c-2c6d-4148-9241-4fe90b9e1517 None admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:41.511437 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa16c8c-2c6d-4148-9241-4fe90b9e1517 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:41.511836 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa16c8c-2c6d-4148-9241-4fe90b9e1517 None admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:41.517665 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa16c8c-2c6d-4148-9241-4fe90b9e1517 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:41.517665 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa16c8c-2c6d-4148-9241-4fe90b9e1517 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:41.520495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-7c462686-19d3-4484-a8aa-2c44c5660da2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:41.520495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:41.520495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:41.520495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:41.520495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:41.520495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:41.520495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:41.520495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:41.520495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:41.520495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:41.520495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:41.520495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:41.520495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:05:41.520495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:05:41.520495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:05:41.520495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:05:41.521558 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:41.521558 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:41.521558 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:41.521558 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:41.521558 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:41.521558 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:41.521558 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:41.521558 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:41.521558 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:41.521558 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:41.521558 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:41.521558 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:41.521558 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:41.521558 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:41.521558 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:41.521558 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:41.521558 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:05:41.522617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:05:41.522617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:41.522617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:41.527725 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 241/472] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:05:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:41.532675 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c462686-19d3-4484-a8aa-2c44c5660da2 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:41.601846 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 232/473] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 8 02:05:41 2022] POST /identity/v3/users => generated 248 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:05:41.669579 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:41.674251 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c462686-19d3-4484-a8aa-2c44c5660da2 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:41.715939 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfb210-22b4-4d17-aac3-a838ca3d2476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:41.716860 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfb210-22b4-4d17-aac3-a838ca3d2476 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:41.717313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfb210-22b4-4d17-aac3-a838ca3d2476 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:41.717756 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfb210-22b4-4d17-aac3-a838ca3d2476 None admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:41.718581 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acfb210-22b4-4d17-aac3-a838ca3d2476 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:41.719085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acfb210-22b4-4d17-aac3-a838ca3d2476 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:41.720740 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acfb210-22b4-4d17-aac3-a838ca3d2476 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:41.734422 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 242/474] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:05:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:41.740947 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa16c8c-2c6d-4148-9241-4fe90b9e1517 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:41.758174 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d67ff2-3b87-44e5-9b97-3fe688fa01b5 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:41.759274 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d67ff2-3b87-44e5-9b97-3fe688fa01b5 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:41.759614 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d67ff2-3b87-44e5-9b97-3fe688fa01b5 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:41.762249 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 243/475] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:05:41.767005 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f510c-c001-446d-a209-7773124bfa30 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:41.767274 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f510c-c001-446d-a209-7773124bfa30 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:41.767596 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f510c-c001-446d-a209-7773124bfa30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:41.788774 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-1e3f510c-c001-446d-a209-7773124bfa30 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:41.790014 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-1e3f510c-c001-446d-a209-7773124bfa30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:41.874082 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa16c8c-2c6d-4148-9241-4fe90b9e1517 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:41.879904 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 244/476] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:05:41.907670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f510c-c001-446d-a209-7773124bfa30 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:41.916058 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df3dae2-2517-4c38-8bf1-2b54f3e475aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:41.916773 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3dae2-2517-4c38-8bf1-2b54f3e475aa None admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:41.917123 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3dae2-2517-4c38-8bf1-2b54f3e475aa None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:41.917464 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3dae2-2517-4c38-8bf1-2b54f3e475aa None admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:41.918212 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df3dae2-2517-4c38-8bf1-2b54f3e475aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:41.928964 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df3dae2-2517-4c38-8bf1-2b54f3e475aa None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:42.024691 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:42.034360 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f510c-c001-446d-a209-7773124bfa30 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:42.071759 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eac175-f617-4b79-a179-afc73b2b3142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:42.072367 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eac175-f617-4b79-a179-afc73b2b3142 None admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:42.072650 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eac175-f617-4b79-a179-afc73b2b3142 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:42.072978 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eac175-f617-4b79-a179-afc73b2b3142 None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:42.073683 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eac175-f617-4b79-a179-afc73b2b3142 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:42.075321 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eac175-f617-4b79-a179-afc73b2b3142 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:42.123909 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.sql.core [None req-83eac175-f617-4b79-a179-afc73b2b3142 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 08 02:05:42.123909 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 08 02:05:42.123909 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [parameters: {'id': '1c4977a75fd34501aa41511f102d323e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 08 02:05:42.123909 dv-cinder-740146-18-smb devstack@keystone.service[80637]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80637) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 08 02:05:42.136018 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 233/477] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 8 02:05:41 2022] POST /identity/v3/users => generated 249 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:05:42.141919 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-83eac175-f617-4b79-a179-afc73b2b3142 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 08 02:05:42.141919 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:42.141919 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 08 02:05:42.141919 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 08 02:05:42.141919 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 08 02:05:42.141919 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 08 02:05:42.141919 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 08 02:05:42.141919 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application result = self._query(query) Aug 08 02:05:42.141919 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 08 02:05:42.141919 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application conn.query(q) Aug 08 02:05:42.141919 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 08 02:05:42.141919 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 08 02:05:42.141919 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 08 02:05:42.141919 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application result.read() Aug 08 02:05:42.141919 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 08 02:05:42.142824 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 08 02:05:42.142824 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 08 02:05:42.142824 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 08 02:05:42.142824 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 08 02:05:42.142824 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 08 02:05:42.142824 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 08 02:05:42.142824 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 08 02:05:42.142824 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 08 02:05:42.142824 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:42.142824 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 08 02:05:42.142824 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:42.142824 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:42.142824 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 08 02:05:42.142824 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 08 02:05:42.142824 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 08 02:05:42.142824 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return ref.to_dict() Aug 08 02:05:42.142824 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 08 02:05:42.142824 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application next(self.gen) Aug 08 02:05:42.143745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 08 02:05:42.143745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application yield resource Aug 08 02:05:42.143745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 08 02:05:42.143745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application next(self.gen) Aug 08 02:05:42.143745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 08 02:05:42.143745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self.session.rollback() Aug 08 02:05:42.143745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 08 02:05:42.143745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self.force_reraise() Aug 08 02:05:42.143745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 08 02:05:42.143745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise self.value Aug 08 02:05:42.143745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 08 02:05:42.143745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 08 02:05:42.143745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 08 02:05:42.143745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application session.commit() Aug 08 02:05:42.143745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 08 02:05:42.143745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 08 02:05:42.143745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 08 02:05:42.144573 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self._prepare_impl() Aug 08 02:05:42.144573 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 08 02:05:42.144573 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self.session.flush() Aug 08 02:05:42.144573 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 08 02:05:42.144573 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self._flush(objects) Aug 08 02:05:42.144573 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 08 02:05:42.144573 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 08 02:05:42.144573 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 08 02:05:42.144573 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application compat.raise_( Aug 08 02:05:42.144573 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 08 02:05:42.144573 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception Aug 08 02:05:42.144573 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 08 02:05:42.144573 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application flush_context.execute() Aug 08 02:05:42.144573 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 08 02:05:42.144573 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rec.execute(self) Aug 08 02:05:42.144573 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 08 02:05:42.144573 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 08 02:05:42.145474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 08 02:05:42.145474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 08 02:05:42.145474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 08 02:05:42.145474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 08 02:05:42.145474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 08 02:05:42.145474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 08 02:05:42.145474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 08 02:05:42.145474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 08 02:05:42.145474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 08 02:05:42.145474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 08 02:05:42.145474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 08 02:05:42.145474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 08 02:05:42.145474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 08 02:05:42.145474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 08 02:05:42.145474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 08 02:05:42.145474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception Aug 08 02:05:42.146282 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 08 02:05:42.146282 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 08 02:05:42.146282 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 08 02:05:42.146282 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 08 02:05:42.146282 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 08 02:05:42.146282 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application result = self._query(query) Aug 08 02:05:42.146282 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 08 02:05:42.146282 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application conn.query(q) Aug 08 02:05:42.146282 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 08 02:05:42.146282 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 08 02:05:42.146282 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 08 02:05:42.146282 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application result.read() Aug 08 02:05:42.146282 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 08 02:05:42.146282 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 08 02:05:42.146282 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 08 02:05:42.146282 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 08 02:05:42.147065 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 08 02:05:42.147065 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 08 02:05:42.147065 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 08 02:05:42.147065 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 08 02:05:42.147065 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 08 02:05:42.147065 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 08 02:05:42.147065 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [parameters: {'id': '1c4977a75fd34501aa41511f102d323e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 08 02:05:42.147065 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 08 02:05:42.147065 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:42.147065 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:05:42.147065 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:42.147065 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:42.147065 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:42.147065 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:42.147065 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:42.147065 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:42.147912 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:42.147912 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:42.147912 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:42.147912 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:42.147912 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:42.147912 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:42.147912 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 08 02:05:42.147912 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 08 02:05:42.147912 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:42.147912 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:42.147912 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 08 02:05:42.147912 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 08 02:05:42.147912 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 08 02:05:42.147912 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 08 02:05:42.147912 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 08 02:05:42.147912 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:42.148753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 245/478] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Aug 8 02:05:41 2022] POST /identity/v3/roles => generated 144 bytes in 237 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:05:42.152915 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df3dae2-2517-4c38-8bf1-2b54f3e475aa None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:42.221964 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:42.293149 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df3dae2-2517-4c38-8bf1-2b54f3e475aa None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:42.330052 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09c0c0-e8f4-401c-b0a2-46e08fdbf340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:42.330685 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09c0c0-e8f4-401c-b0a2-46e08fdbf340 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:42.330968 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09c0c0-e8f4-401c-b0a2-46e08fdbf340 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:42.331243 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09c0c0-e8f4-401c-b0a2-46e08fdbf340 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:42.341985 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09c0c0-e8f4-401c-b0a2-46e08fdbf340 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:42.347121 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-ec09c0c0-e8f4-401c-b0a2-46e08fdbf340 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:05:42.347121 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:42.347121 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:42.347121 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:42.347121 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:42.347121 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:42.347121 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:42.347121 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:42.347121 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:42.347121 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:42.347121 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:42.347121 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:42.347121 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:42.347121 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:42.347121 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:42.347121 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:42.349198 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:42.349198 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:42.349198 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:42.349198 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:42.349198 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:42.349198 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:42.349198 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:42.349198 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:42.349198 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:42.349198 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:42.349198 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:42.349198 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:42.349198 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:42.349198 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:42.349198 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:42.349198 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:42.350249 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:42.350249 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:42.350249 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:42.350249 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:42.350249 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:42.350249 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:42.350249 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:42.350249 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:42.350249 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:42.350249 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:42.350249 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 02:05:42.350249 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:42.350249 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 234/479] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 02:05:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:42.355509 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eac175-f617-4b79-a179-afc73b2b3142 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:42.472235 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eac175-f617-4b79-a179-afc73b2b3142 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:42.508877 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657bc55-334a-459c-87ff-3678402eb8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:42.509801 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657bc55-334a-459c-87ff-3678402eb8c1 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:42.510297 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657bc55-334a-459c-87ff-3678402eb8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:42.510785 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657bc55-334a-459c-87ff-3678402eb8c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:42.511824 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657bc55-334a-459c-87ff-3678402eb8c1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:42.512352 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657bc55-334a-459c-87ff-3678402eb8c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:42.513889 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657bc55-334a-459c-87ff-3678402eb8c1 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:42.523179 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 246/480] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:05:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:43.911953 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cb574-fee7-4694-b91f-0121ced254d4 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:43.912512 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cb574-fee7-4694-b91f-0121ced254d4 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:43.912512 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cb574-fee7-4694-b91f-0121ced254d4 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:43.914099 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 235/481] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:43.920117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2401e-107e-4530-8e60-c7cba1bc1459 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:43.920913 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2401e-107e-4530-8e60-c7cba1bc1459 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:43.921398 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2401e-107e-4530-8e60-c7cba1bc1459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:43.942494 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-bcb2401e-107e-4530-8e60-c7cba1bc1459 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:43.943994 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-bcb2401e-107e-4530-8e60-c7cba1bc1459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:43.955777 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:43.999255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62903b64-dd2b-4f0e-a30d-69b99cd3f5ab None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:43.999593 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62903b64-dd2b-4f0e-a30d-69b99cd3f5ab None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:43.999845 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62903b64-dd2b-4f0e-a30d-69b99cd3f5ab None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:44.001622 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 236/482] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:44.010307 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a88fe-7170-45a6-b178-4562307481c3 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:44.010596 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a88fe-7170-45a6-b178-4562307481c3 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:44.010877 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a88fe-7170-45a6-b178-4562307481c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:44.026573 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 247/483] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:05:44.040556 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-620a88fe-7170-45a6-b178-4562307481c3 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:44.041748 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-620a88fe-7170-45a6-b178-4562307481c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:44.050131 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2401e-107e-4530-8e60-c7cba1bc1459 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:44.161009 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 237/484] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:44.190740 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a88fe-7170-45a6-b178-4562307481c3 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:44.219978 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2401e-107e-4530-8e60-c7cba1bc1459 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:44.253993 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:44.268894 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0239f0-66d8-4341-b63e-00ac6eaf437f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:44.269536 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0239f0-66d8-4341-b63e-00ac6eaf437f None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:44.269815 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0239f0-66d8-4341-b63e-00ac6eaf437f None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:44.270088 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0239f0-66d8-4341-b63e-00ac6eaf437f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:44.290327 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0239f0-66d8-4341-b63e-00ac6eaf437f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:44.295192 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-0f0239f0-66d8-4341-b63e-00ac6eaf437f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:05:44.295192 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:44.295192 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:44.295192 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:44.295192 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:44.295192 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:44.295192 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:44.295192 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:44.295192 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:44.295192 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:44.295192 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:44.295192 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:44.295192 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:44.295192 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:44.295192 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:44.295192 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:44.296117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:44.296117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:44.296117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:44.296117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:44.296117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:44.296117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:44.296117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:44.296117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:44.296117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:44.296117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:44.296117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:44.296117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:44.296117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:44.296117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:44.296117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:44.296117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:44.296911 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:44.296911 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:44.296911 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:44.296911 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:44.296911 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:44.296911 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:44.296911 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:44.296911 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:44.296911 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:44.296911 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:44.296911 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:05:44.296911 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:44.303569 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 248/485] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 02:05:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:05:44.305013 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9263b7-bd66-4461-87e1-1d51116e1ce7 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:44.306258 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9263b7-bd66-4461-87e1-1d51116e1ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:44.306709 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9263b7-bd66-4461-87e1-1d51116e1ce7 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:44.309161 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 249/486] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:44.310150 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9263b7-bd66-4461-87e1-1d51116e1ce7 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:44.320325 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:44.346247 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a88fe-7170-45a6-b178-4562307481c3 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:44.384200 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ad96d-c0d9-4763-ba40-3e80d59d909f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:44.385106 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ad96d-c0d9-4763-ba40-3e80d59d909f None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:44.385766 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ad96d-c0d9-4763-ba40-3e80d59d909f None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:44.386225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ad96d-c0d9-4763-ba40-3e80d59d909f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:44.398107 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ad96d-c0d9-4763-ba40-3e80d59d909f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:44.403537 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-5d1ad96d-c0d9-4763-ba40-3e80d59d909f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:05:44.403537 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:44.403537 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:44.403537 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:44.403537 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:44.403537 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:44.403537 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:44.403537 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:44.403537 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:44.403537 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:44.403537 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:44.403537 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:44.403537 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:44.403537 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:44.403537 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:44.403537 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:44.404422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:44.404422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:44.404422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:44.404422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:44.404422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:44.404422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:44.404422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:44.404422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:44.404422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:44.404422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:44.404422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:44.404422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:44.404422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:44.404422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:44.404422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:44.404422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:44.405193 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:44.405193 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:44.405193 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:44.405193 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:44.405193 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:44.405193 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:44.405193 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:44.405193 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:44.405193 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:44.405193 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:44.405193 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:05:44.405193 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:44.407951 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 238/487] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 02:05:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:05:44.409899 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d001d5-da27-485a-adac-e26ef3c82e7b None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:44.410365 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d001d5-da27-485a-adac-e26ef3c82e7b None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:44.410820 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d001d5-da27-485a-adac-e26ef3c82e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:44.429981 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-e2d001d5-da27-485a-adac-e26ef3c82e7b None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:44.432023 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-e2d001d5-da27-485a-adac-e26ef3c82e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:44.438227 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9263b7-bd66-4461-87e1-1d51116e1ce7 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:44.476622 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45258b2-5b28-4acb-a660-d01ef2142c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:44.477775 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45258b2-5b28-4acb-a660-d01ef2142c9a None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:44.478057 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45258b2-5b28-4acb-a660-d01ef2142c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:44.478380 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45258b2-5b28-4acb-a660-d01ef2142c9a None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:44.479045 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45258b2-5b28-4acb-a660-d01ef2142c9a None admin] RBAC: Adding query filter params (name=service) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:44.479644 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45258b2-5b28-4acb-a660-d01ef2142c9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:44.481184 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45258b2-5b28-4acb-a660-d01ef2142c9a None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:44.490993 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 250/488] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 8 02:05:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:44.492035 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45258b2-5b28-4acb-a660-d01ef2142c9a None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:44.514393 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 239/489] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:44.515449 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d001d5-da27-485a-adac-e26ef3c82e7b None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:44.558863 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:44.572657 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:44.610668 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45258b2-5b28-4acb-a660-d01ef2142c9a None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:44.643120 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d001d5-da27-485a-adac-e26ef3c82e7b None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:44.648682 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502c2eb-7732-4a9d-afb3-0a43daa7c2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:44.649999 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502c2eb-7732-4a9d-afb3-0a43daa7c2cd None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:44.650423 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502c2eb-7732-4a9d-afb3-0a43daa7c2cd None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:44.650837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502c2eb-7732-4a9d-afb3-0a43daa7c2cd None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:44.651700 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a502c2eb-7732-4a9d-afb3-0a43daa7c2cd None admin] RBAC: Adding query filter params (name=service) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:44.652243 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a502c2eb-7732-4a9d-afb3-0a43daa7c2cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:44.653826 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a502c2eb-7732-4a9d-afb3-0a43daa7c2cd None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:44.662903 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 251/490] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 8 02:05:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:44.664009 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502c2eb-7732-4a9d-afb3-0a43daa7c2cd None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:44.681404 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ea13f-6aca-4cd4-82a4-3832802950f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:44.682192 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ea13f-6aca-4cd4-82a4-3832802950f5 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:44.682423 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ea13f-6aca-4cd4-82a4-3832802950f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:44.682712 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ea13f-6aca-4cd4-82a4-3832802950f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:44.693919 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ea13f-6aca-4cd4-82a4-3832802950f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:44.695405 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ea13f-6aca-4cd4-82a4-3832802950f5 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:44.710948 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-911ea13f-6aca-4cd4-82a4-3832802950f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:44.710948 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:44.710948 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:44.710948 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:44.710948 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:44.710948 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:44.710948 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:44.710948 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:44.710948 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:44.710948 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:44.710948 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:44.710948 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:44.710948 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:05:44.710948 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:05:44.710948 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:05:44.710948 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:05:44.712422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:44.712422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:44.712422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:44.712422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:44.712422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:44.712422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:44.712422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:44.712422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:44.712422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:44.712422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:44.712422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:44.712422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:44.712422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:44.712422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:44.712422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:44.712422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:44.712422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:05:44.713249 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:05:44.713249 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:44.713249 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:44.713249 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 240/491] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:44.713935 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ea13f-6aca-4cd4-82a4-3832802950f5 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:44.777002 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502c2eb-7732-4a9d-afb3-0a43daa7c2cd None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:44.794401 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:44.809367 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:44.815681 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf1b73-5111-4c12-9e28-9f4f3587543e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:44.816514 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf1b73-5111-4c12-9e28-9f4f3587543e None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:44.821537 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf1b73-5111-4c12-9e28-9f4f3587543e None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:44.821537 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf1b73-5111-4c12-9e28-9f4f3587543e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:44.822334 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ea13f-6aca-4cd4-82a4-3832802950f5 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:44.829043 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf1b73-5111-4c12-9e28-9f4f3587543e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:44.834158 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-aeaf1b73-5111-4c12-9e28-9f4f3587543e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:05:44.834158 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:44.834158 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:44.834158 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:44.834158 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:44.834158 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:44.834158 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:44.834158 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:44.834158 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:44.834158 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:44.834158 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:44.834158 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:44.834158 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:44.834158 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:44.834158 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:44.834158 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:44.835026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:44.835026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:44.835026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:44.835026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:44.835026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:44.835026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:44.835026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:44.835026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:44.835026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:44.835026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:44.835026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:44.835026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:44.835026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:44.835026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:44.835026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:44.835026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:44.835873 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:44.835873 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:44.835873 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:44.835873 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:44.835873 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:44.835873 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:44.835873 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:44.835873 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:44.835873 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:44.835873 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:44.835873 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:05:44.835873 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:44.839018 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 252/492] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 02:05:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:44.840160 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf1b73-5111-4c12-9e28-9f4f3587543e None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:44.863272 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d744ff6-0744-4163-84b1-b8d490b41c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:44.863935 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d744ff6-0744-4163-84b1-b8d490b41c49 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:44.864480 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d744ff6-0744-4163-84b1-b8d490b41c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:44.864480 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d744ff6-0744-4163-84b1-b8d490b41c49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:44.875944 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d744ff6-0744-4163-84b1-b8d490b41c49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:44.877416 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d744ff6-0744-4163-84b1-b8d490b41c49 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:44.892237 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-3d744ff6-0744-4163-84b1-b8d490b41c49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:44.892237 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:44.892237 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:44.892237 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:44.892237 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:44.892237 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:44.892237 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:44.892237 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:44.892237 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:44.892237 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:44.892237 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:44.892237 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:44.892237 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:05:44.892237 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:05:44.892237 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:05:44.892237 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:05:44.893148 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:44.893148 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:44.893148 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:44.893148 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:44.893148 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:44.893148 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:44.893148 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:44.893148 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:44.893148 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:44.893148 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:44.893148 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:44.893148 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:44.893148 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:44.893148 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:44.893148 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:44.893148 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:44.893148 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:05:44.893969 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:05:44.893969 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:44.893969 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:44.893969 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 241/493] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:44.894176 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d744ff6-0744-4163-84b1-b8d490b41c49 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:44.945318 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf1b73-5111-4c12-9e28-9f4f3587543e None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:44.995887 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d744ff6-0744-4163-84b1-b8d490b41c49 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:45.020139 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:45.029077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c019a-f278-4f11-bd4d-434a6a769a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:45.029608 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c019a-f278-4f11-bd4d-434a6a769a1d None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:45.029887 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c019a-f278-4f11-bd4d-434a6a769a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:45.030271 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c019a-f278-4f11-bd4d-434a6a769a1d None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:45.030866 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c019a-f278-4f11-bd4d-434a6a769a1d None admin] RBAC: Adding query filter params (name=service) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:45.030952 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e21258-dc05-453b-b57e-6286c908e01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:45.031166 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c019a-f278-4f11-bd4d-434a6a769a1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:45.031559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e21258-dc05-453b-b57e-6286c908e01d None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:45.031842 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e21258-dc05-453b-b57e-6286c908e01d None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:45.032115 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e21258-dc05-453b-b57e-6286c908e01d None admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:45.032567 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c019a-f278-4f11-bd4d-434a6a769a1d None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:45.038482 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e21258-dc05-453b-b57e-6286c908e01d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:45.038482 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e21258-dc05-453b-b57e-6286c908e01d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:45.038482 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e21258-dc05-453b-b57e-6286c908e01d None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:45.041376 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 242/494] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 8 02:05:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:45.042514 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54b162-2c17-4d24-b836-2b3421a3c526 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:45.042794 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54b162-2c17-4d24-b836-2b3421a3c526 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:45.043067 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54b162-2c17-4d24-b836-2b3421a3c526 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:45.044425 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 243/495] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:45.044943 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54b162-2c17-4d24-b836-2b3421a3c526 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:45.050177 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 253/496] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:45.051461 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a1ed1-1a5f-497b-a2bf-ee0a3187d85e None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:45.051747 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a1ed1-1a5f-497b-a2bf-ee0a3187d85e None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:45.052019 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a1ed1-1a5f-497b-a2bf-ee0a3187d85e None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:45.053241 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 254/497] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:45.053902 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a1ed1-1a5f-497b-a2bf-ee0a3187d85e None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:45.103335 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:45.148562 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54b162-2c17-4d24-b836-2b3421a3c526 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:45.152845 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a1ed1-1a5f-497b-a2bf-ee0a3187d85e None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:45.182376 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65211ea-2183-4aee-8e7f-7b03910d13d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:45.182969 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65211ea-2183-4aee-8e7f-7b03910d13d6 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:45.183256 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65211ea-2183-4aee-8e7f-7b03910d13d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:45.183569 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65211ea-2183-4aee-8e7f-7b03910d13d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:45.184202 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65211ea-2183-4aee-8e7f-7b03910d13d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:45.184504 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65211ea-2183-4aee-8e7f-7b03910d13d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:45.185074 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c09e04-9cec-4b8d-9b8b-4e4f6166475d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:45.185680 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c09e04-9cec-4b8d-9b8b-4e4f6166475d None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:45.185872 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65211ea-2183-4aee-8e7f-7b03910d13d6 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:45.185961 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c09e04-9cec-4b8d-9b8b-4e4f6166475d None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:45.186216 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c09e04-9cec-4b8d-9b8b-4e4f6166475d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:45.196633 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c09e04-9cec-4b8d-9b8b-4e4f6166475d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:45.197203 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 244/498] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:45.198059 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c09e04-9cec-4b8d-9b8b-4e4f6166475d None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:45.198420 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae79b4-cea8-4dc8-a3c7-aac26cfc53f5 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:45.198674 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae79b4-cea8-4dc8-a3c7-aac26cfc53f5 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:45.198953 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae79b4-cea8-4dc8-a3c7-aac26cfc53f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:45.212369 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-a6c09e04-9cec-4b8d-9b8b-4e4f6166475d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:45.212369 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:45.212369 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:45.212369 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:45.212369 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:45.212369 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:45.212369 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:45.212369 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:45.212369 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:45.212369 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:45.212369 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:45.212369 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:45.212369 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:05:45.212369 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:05:45.212369 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:05:45.212369 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:05:45.213424 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:45.213424 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:45.213424 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:45.213424 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:45.213424 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:45.213424 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:45.213424 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:45.213424 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:45.213424 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:45.213424 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:45.213424 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:45.213424 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:45.213424 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:45.213424 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:45.213424 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:45.213424 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:45.213424 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:05:45.214273 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:05:45.214273 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:45.214273 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:45.214273 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 255/499] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:05:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:45.214273 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c09e04-9cec-4b8d-9b8b-4e4f6166475d None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:45.215879 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-d2ae79b4-cea8-4dc8-a3c7-aac26cfc53f5 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:45.217065 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-d2ae79b4-cea8-4dc8-a3c7-aac26cfc53f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:45.260379 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:45.282915 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 245/500] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:45.284232 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39168289-a19b-4c95-803d-92adf65b91d2 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:45.284511 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39168289-a19b-4c95-803d-92adf65b91d2 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:45.284786 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39168289-a19b-4c95-803d-92adf65b91d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:45.316921 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-39168289-a19b-4c95-803d-92adf65b91d2 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:45.318483 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c09e04-9cec-4b8d-9b8b-4e4f6166475d None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:45.318990 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-39168289-a19b-4c95-803d-92adf65b91d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:45.320051 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:45.358374 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a6def-bea2-4558-9b00-e6bbc2dab3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:45.358994 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a6def-bea2-4558-9b00-e6bbc2dab3a8 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:45.359273 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a6def-bea2-4558-9b00-e6bbc2dab3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:45.359571 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a6def-bea2-4558-9b00-e6bbc2dab3a8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:45.366835 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a6def-bea2-4558-9b00-e6bbc2dab3a8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:45.368380 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a6def-bea2-4558-9b00-e6bbc2dab3a8 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:45.380930 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-292a6def-bea2-4558-9b00-e6bbc2dab3a8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 02:05:45.380930 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:45.380930 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:45.380930 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:45.380930 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:45.380930 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:45.380930 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:45.380930 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:45.380930 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:45.380930 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:45.380930 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:45.380930 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:45.380930 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:05:45.380930 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:05:45.380930 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:05:45.380930 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:05:45.382038 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:45.382038 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:45.382038 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:05:45.382038 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:05:45.382038 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:05:45.382038 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:05:45.382038 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:45.382038 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:45.382038 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:45.382038 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:45.382038 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:45.382038 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:45.382038 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:45.382038 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:45.382038 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:45.382038 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:45.382038 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:45.382038 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:45.383135 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:45.383135 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:45.383135 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:05:45.383135 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:05:45.383135 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:05:45.383135 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:05:45.383135 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:05:45.383135 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:05:45.383135 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 02:05:45.383135 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:45.390588 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 256/501] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:05:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:45.390588 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a6def-bea2-4558-9b00-e6bbc2dab3a8 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:45.395380 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 246/502] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:45.396317 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39168289-a19b-4c95-803d-92adf65b91d2 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:45.483030 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a6def-bea2-4558-9b00-e6bbc2dab3a8 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:45.505059 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39168289-a19b-4c95-803d-92adf65b91d2 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:45.514107 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:45.516264 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076edd4-a4ff-4e91-bb98-f6d25e41335c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:45.516890 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076edd4-a4ff-4e91-bb98-f6d25e41335c None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:45.517171 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076edd4-a4ff-4e91-bb98-f6d25e41335c None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:45.517446 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076edd4-a4ff-4e91-bb98-f6d25e41335c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:45.525206 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076edd4-a4ff-4e91-bb98-f6d25e41335c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:45.526659 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076edd4-a4ff-4e91-bb98-f6d25e41335c None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:45.537437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-f076edd4-a4ff-4e91-bb98-f6d25e41335c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:05:45.537437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:45.537437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:45.537437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:45.537437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:45.537437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:45.537437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:45.537437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:45.537437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:45.537437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:45.537437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:45.537437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:45.537437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:05:45.537437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:05:45.537437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:05:45.537437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:05:45.538737 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:45.538737 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:45.538737 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:05:45.538737 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:05:45.538737 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:05:45.538737 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:05:45.538737 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:45.538737 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:45.538737 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:45.538737 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:45.538737 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:45.538737 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:45.538737 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:45.538737 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:45.538737 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:45.538737 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:45.538737 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:45.538737 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:45.539683 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:45.539683 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:45.539683 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:05:45.539683 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:05:45.539683 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:05:45.539683 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:05:45.539683 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:05:45.539683 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:05:45.539683 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:05:45.539683 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:45.539683 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 257/503] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Aug 8 02:05:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:45.539683 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076edd4-a4ff-4e91-bb98-f6d25e41335c None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:45.540291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616cf91-0365-4314-99f4-bdcb9c5ca16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:45.540291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616cf91-0365-4314-99f4-bdcb9c5ca16f None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:45.540291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616cf91-0365-4314-99f4-bdcb9c5ca16f None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:45.540945 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616cf91-0365-4314-99f4-bdcb9c5ca16f None admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:45.541243 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616cf91-0365-4314-99f4-bdcb9c5ca16f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:45.541550 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616cf91-0365-4314-99f4-bdcb9c5ca16f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:45.542925 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616cf91-0365-4314-99f4-bdcb9c5ca16f None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:45.554607 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 247/504] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:45.556054 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616cf91-0365-4314-99f4-bdcb9c5ca16f None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:45.564891 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:45.637148 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076edd4-a4ff-4e91-bb98-f6d25e41335c None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:45.656636 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616cf91-0365-4314-99f4-bdcb9c5ca16f None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:45.669808 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5676465-5e62-4794-8f76-19f2ba98d525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:45.670424 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5676465-5e62-4794-8f76-19f2ba98d525 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:45.670706 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5676465-5e62-4794-8f76-19f2ba98d525 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:45.670979 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5676465-5e62-4794-8f76-19f2ba98d525 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:45.681266 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5676465-5e62-4794-8f76-19f2ba98d525 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:45.685975 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-d5676465-5e62-4794-8f76-19f2ba98d525 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:05:45.685975 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:45.685975 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:45.685975 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:45.685975 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:45.685975 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:45.685975 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:45.685975 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:45.685975 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:45.685975 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:45.685975 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:45.685975 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:45.685975 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:45.685975 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:45.685975 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:45.685975 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:45.686892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:45.686892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:45.686892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:45.686892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:45.686892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:45.686892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:45.686892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:45.686892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:45.686892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:45.686892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:45.686892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:45.686892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:45.686892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:45.686892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:45.686892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:45.686892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:45.687836 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:45.687836 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:45.687836 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:45.687836 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:45.687836 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:45.687836 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:45.687836 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:45.687836 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:45.687836 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:45.687836 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:45.687836 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:05:45.687836 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:45.687836 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 258/505] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 02:05:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:45.687836 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5676465-5e62-4794-8f76-19f2ba98d525 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:45.694184 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e01f2c-e918-40ad-88ff-63dfecf73bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:45.694812 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e01f2c-e918-40ad-88ff-63dfecf73bdc None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:45.695091 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e01f2c-e918-40ad-88ff-63dfecf73bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:45.695383 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e01f2c-e918-40ad-88ff-63dfecf73bdc None admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:45.696186 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e01f2c-e918-40ad-88ff-63dfecf73bdc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:45.696491 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e01f2c-e918-40ad-88ff-63dfecf73bdc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:45.697912 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e01f2c-e918-40ad-88ff-63dfecf73bdc None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:45.734214 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 248/506] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Aug 8 02:05:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:45.735023 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e01f2c-e918-40ad-88ff-63dfecf73bdc None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:45.761532 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:45.771806 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:45.789202 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5676465-5e62-4794-8f76-19f2ba98d525 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:45.822561 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6351017-f5f9-4797-9efc-99bc81c27478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:45.823183 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6351017-f5f9-4797-9efc-99bc81c27478 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:45.823495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6351017-f5f9-4797-9efc-99bc81c27478 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:45.823774 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6351017-f5f9-4797-9efc-99bc81c27478 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:45.833905 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e01f2c-e918-40ad-88ff-63dfecf73bdc None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:45.834484 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6351017-f5f9-4797-9efc-99bc81c27478 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:45.836026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6351017-f5f9-4797-9efc-99bc81c27478 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:45.851240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-b6351017-f5f9-4797-9efc-99bc81c27478 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:45.851240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:45.851240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:45.851240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:45.851240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:45.851240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:45.851240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:45.851240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:45.851240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:45.851240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:45.851240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:45.851240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:45.851240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:05:45.851240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:05:45.851240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:05:45.851240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:05:45.852216 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:45.852216 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:45.852216 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:45.852216 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:45.852216 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:45.852216 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:45.852216 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:45.852216 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:45.852216 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:45.852216 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:45.852216 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:45.852216 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:45.852216 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:45.852216 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:45.852216 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:45.852216 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:45.852216 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:05:45.853025 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:05:45.853025 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:45.853025 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:45.853025 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 259/507] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:05:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:45.853242 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6351017-f5f9-4797-9efc-99bc81c27478 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:45.874116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cbfe1-a4e5-47d8-8f7e-8c30cdd14a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:45.874729 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cbfe1-a4e5-47d8-8f7e-8c30cdd14a01 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:45.875008 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cbfe1-a4e5-47d8-8f7e-8c30cdd14a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:45.875287 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cbfe1-a4e5-47d8-8f7e-8c30cdd14a01 None admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:45.876047 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0cbfe1-a4e5-47d8-8f7e-8c30cdd14a01 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:45.876383 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0cbfe1-a4e5-47d8-8f7e-8c30cdd14a01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:45.877834 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0cbfe1-a4e5-47d8-8f7e-8c30cdd14a01 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:45.894961 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 249/508] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Aug 8 02:05:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:45.895778 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cbfe1-a4e5-47d8-8f7e-8c30cdd14a01 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:45.956321 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6351017-f5f9-4797-9efc-99bc81c27478 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:45.975390 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:45.989465 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dadeba-bb8d-443f-8ea9-862c05c111b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:45.990081 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dadeba-bb8d-443f-8ea9-862c05c111b1 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:45.990361 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dadeba-bb8d-443f-8ea9-862c05c111b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:45.990641 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dadeba-bb8d-443f-8ea9-862c05c111b1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:45.990990 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cbfe1-a4e5-47d8-8f7e-8c30cdd14a01 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:45.992578 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:45.998481 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dadeba-bb8d-443f-8ea9-862c05c111b1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:45.999947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dadeba-bb8d-443f-8ea9-862c05c111b1 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:46.011522 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-86dadeba-bb8d-443f-8ea9-862c05c111b1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 08 02:05:46.011522 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:46.011522 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:46.011522 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:46.011522 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:46.011522 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:46.011522 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:46.011522 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:46.011522 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:46.011522 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:46.011522 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:46.011522 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:46.011522 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:05:46.011522 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:05:46.011522 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:05:46.011522 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:05:46.012547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:46.012547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:46.012547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:05:46.012547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:05:46.012547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:05:46.012547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:05:46.012547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:46.012547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:46.012547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:46.012547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:46.012547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:46.012547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:46.012547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:46.012547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:46.012547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:46.012547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:46.012547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:46.012547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:46.013436 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:46.013436 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:46.013436 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:05:46.013436 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:05:46.013436 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:05:46.013436 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:05:46.013436 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:05:46.013436 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:05:46.013436 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 08 02:05:46.013436 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:46.013436 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 260/509] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:05:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:46.013975 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dadeba-bb8d-443f-8ea9-862c05c111b1 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:46.027839 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d451eb5-55ba-4a41-9a71-3d6dd639e55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:46.028441 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d451eb5-55ba-4a41-9a71-3d6dd639e55b None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:46.028716 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d451eb5-55ba-4a41-9a71-3d6dd639e55b None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:46.028988 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d451eb5-55ba-4a41-9a71-3d6dd639e55b None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:46.029659 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d451eb5-55ba-4a41-9a71-3d6dd639e55b None admin] RBAC: Adding query filter params (name=service) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:46.029957 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d451eb5-55ba-4a41-9a71-3d6dd639e55b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:46.031311 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d451eb5-55ba-4a41-9a71-3d6dd639e55b None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:46.038994 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 250/510] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 8 02:05:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:46.040370 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d451eb5-55ba-4a41-9a71-3d6dd639e55b None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:46.111975 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dadeba-bb8d-443f-8ea9-862c05c111b1 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:46.138449 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d451eb5-55ba-4a41-9a71-3d6dd639e55b None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:46.144230 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e941c4-0858-4904-b124-e56a6b860e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:46.144823 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e941c4-0858-4904-b124-e56a6b860e03 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:46.145112 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e941c4-0858-4904-b124-e56a6b860e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:46.145383 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e941c4-0858-4904-b124-e56a6b860e03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:46.171634 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d411ed-a158-469f-9f31-8891e77e0dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:46.172235 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d411ed-a158-469f-9f31-8891e77e0dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:46.172543 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d411ed-a158-469f-9f31-8891e77e0dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:46.172788 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d411ed-a158-469f-9f31-8891e77e0dc5 None admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:46.173424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d411ed-a158-469f-9f31-8891e77e0dc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:46.173725 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d411ed-a158-469f-9f31-8891e77e0dc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:46.175079 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d411ed-a158-469f-9f31-8891e77e0dc5 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:46.187015 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 251/511] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:46.187976 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d411ed-a158-469f-9f31-8891e77e0dc5 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:46.195722 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:46.208609 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:46.220900 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e941c4-0858-4904-b124-e56a6b860e03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:46.220900 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e941c4-0858-4904-b124-e56a6b860e03 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:46.284005 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d411ed-a158-469f-9f31-8891e77e0dc5 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:46.314128 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 261/512] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:05:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:05:46.314885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e941c4-0858-4904-b124-e56a6b860e03 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:46.318055 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1e340-e6bd-4c0a-bf7c-944e3e66830a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:46.318661 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1e340-e6bd-4c0a-bf7c-944e3e66830a None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:46.318943 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1e340-e6bd-4c0a-bf7c-944e3e66830a None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:46.319223 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1e340-e6bd-4c0a-bf7c-944e3e66830a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:46.390956 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a1e340-e6bd-4c0a-bf7c-944e3e66830a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:46.392755 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a1e340-e6bd-4c0a-bf7c-944e3e66830a None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:46.401323 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:46.406174 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:46.412673 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e941c4-0858-4904-b124-e56a6b860e03 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:46.446443 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa60ed-885f-4632-9f22-6070559e13e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:46.447045 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa60ed-885f-4632-9f22-6070559e13e3 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:46.447324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa60ed-885f-4632-9f22-6070559e13e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:46.447641 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa60ed-885f-4632-9f22-6070559e13e3 None admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:46.448406 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa60ed-885f-4632-9f22-6070559e13e3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:46.448785 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa60ed-885f-4632-9f22-6070559e13e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:46.450216 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa60ed-885f-4632-9f22-6070559e13e3 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:46.486197 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 262/513] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Aug 8 02:05:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:46.487071 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa60ed-885f-4632-9f22-6070559e13e3 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:46.492533 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 252/514] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:05:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:05:46.493533 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1e340-e6bd-4c0a-bf7c-944e3e66830a None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:46.586427 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa60ed-885f-4632-9f22-6070559e13e3 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:46.589679 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1e340-e6bd-4c0a-bf7c-944e3e66830a None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:46.597871 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:46.625130 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4eacc-a845-4920-8214-4ed7454e2d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:46.625756 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4eacc-a845-4920-8214-4ed7454e2d05 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:46.625877 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c98c4-4df0-434c-adaa-431813eef9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:46.626070 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4eacc-a845-4920-8214-4ed7454e2d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:46.626360 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c98c4-4df0-434c-adaa-431813eef9aa None admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:46.626504 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4eacc-a845-4920-8214-4ed7454e2d05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:46.626679 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c98c4-4df0-434c-adaa-431813eef9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:46.626905 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c98c4-4df0-434c-adaa-431813eef9aa None admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:46.627561 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c98c4-4df0-434c-adaa-431813eef9aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:46.628989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c98c4-4df0-434c-adaa-431813eef9aa None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:46.636562 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce4eacc-a845-4920-8214-4ed7454e2d05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:46.638001 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce4eacc-a845-4920-8214-4ed7454e2d05 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:46.652357 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-fce4eacc-a845-4920-8214-4ed7454e2d05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:46.652357 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:46.652357 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:46.652357 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:46.652357 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:46.652357 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:46.652357 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:46.652357 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:46.652357 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:46.652357 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:46.652357 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:46.652357 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:46.652357 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:05:46.652357 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:05:46.652357 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:05:46.652357 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:05:46.656601 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:46.656601 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:46.656601 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:46.656601 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:46.656601 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:46.656601 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:46.656601 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:46.656601 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:46.656601 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:46.656601 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:46.656601 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:46.656601 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:46.656601 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:46.656601 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:46.656601 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:46.656601 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:46.656601 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:05:46.657456 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:05:46.657456 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:46.657456 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:46.657456 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 263/515] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:05:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:46.657456 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4eacc-a845-4920-8214-4ed7454e2d05 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:46.658268 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:46.723456 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 253/516] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 8 02:05:46 2022] POST /identity/v3/users => generated 247 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:05:46.724282 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c98c4-4df0-434c-adaa-431813eef9aa None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:46.750845 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4eacc-a845-4920-8214-4ed7454e2d05 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:46.790729 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391a8c9-188a-4f50-9624-da960539c5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:46.791396 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391a8c9-188a-4f50-9624-da960539c5f1 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:46.791674 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391a8c9-188a-4f50-9624-da960539c5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:46.791951 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391a8c9-188a-4f50-9624-da960539c5f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:46.802833 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3391a8c9-188a-4f50-9624-da960539c5f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:46.804356 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3391a8c9-188a-4f50-9624-da960539c5f1 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:46.820324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-3391a8c9-188a-4f50-9624-da960539c5f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:46.820324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:46.820324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:46.820324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:46.820324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:46.820324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:46.820324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:46.820324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:46.820324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:46.820324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:46.820324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:46.820324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:46.820324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:05:46.820324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:05:46.820324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:05:46.820324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:05:46.821814 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:46.821814 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:46.821814 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:46.821814 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:46.821814 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:46.821814 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:46.821814 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:46.821814 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:46.821814 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:46.821814 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:46.821814 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:46.821814 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:46.821814 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:46.821814 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:46.821814 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:46.821814 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:46.821814 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:05:46.822696 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:05:46.822696 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:46.822696 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:46.822696 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 264/517] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:05:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:46.822906 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391a8c9-188a-4f50-9624-da960539c5f1 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:46.860320 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c98c4-4df0-434c-adaa-431813eef9aa None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:46.892060 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:46.896560 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69db5c0-a80c-4986-8165-a637d6942e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:46.897719 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69db5c0-a80c-4986-8165-a637d6942e03 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:46.897719 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69db5c0-a80c-4986-8165-a637d6942e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:46.897719 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69db5c0-a80c-4986-8165-a637d6942e03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:46.935283 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:46.944513 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391a8c9-188a-4f50-9624-da960539c5f1 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:46.981751 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69db5c0-a80c-4986-8165-a637d6942e03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:46.981944 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc5c91-76c0-43f8-8d7a-a68c92265acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:46.982515 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc5c91-76c0-43f8-8d7a-a68c92265acf None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:46.982716 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc5c91-76c0-43f8-8d7a-a68c92265acf None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:46.982989 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc5c91-76c0-43f8-8d7a-a68c92265acf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:46.983204 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69db5c0-a80c-4986-8165-a637d6942e03 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:46.996271 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc5c91-76c0-43f8-8d7a-a68c92265acf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:46.997763 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc5c91-76c0-43f8-8d7a-a68c92265acf None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:47.013606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-b5bc5c91-76c0-43f8-8d7a-a68c92265acf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:47.013606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:47.013606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:47.013606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:47.013606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:47.013606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:47.013606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:47.013606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:47.013606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:47.013606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:47.013606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:47.013606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:47.013606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:05:47.013606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:05:47.013606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:05:47.013606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:05:47.014703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:47.014703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:47.014703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:47.014703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:47.014703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:47.014703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:47.014703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:47.014703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:47.014703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:47.014703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:47.014703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:47.014703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:47.014703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:47.014703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:47.014703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:47.014703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:47.014703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:05:47.015729 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:05:47.015729 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:47.015729 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:47.015729 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 265/518] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:05:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:47.015941 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc5c91-76c0-43f8-8d7a-a68c92265acf None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:47.093343 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 254/519] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:05:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:05:47.094850 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69db5c0-a80c-4986-8165-a637d6942e03 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:47.132104 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc5c91-76c0-43f8-8d7a-a68c92265acf None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:47.141513 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:47.156538 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:47.168567 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609ddc8-87ae-4249-8e81-828a46e29917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:47.169175 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609ddc8-87ae-4249-8e81-828a46e29917 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:47.169457 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609ddc8-87ae-4249-8e81-828a46e29917 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:47.169730 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609ddc8-87ae-4249-8e81-828a46e29917 None admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:47.170774 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c609ddc8-87ae-4249-8e81-828a46e29917 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:47.171085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c609ddc8-87ae-4249-8e81-828a46e29917 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:47.172896 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c609ddc8-87ae-4249-8e81-828a46e29917 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:47.190655 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 266/520] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:47.191844 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609ddc8-87ae-4249-8e81-828a46e29917 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:47.198953 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69db5c0-a80c-4986-8165-a637d6942e03 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:47.237016 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b08d9-e7ae-45be-9109-ae358a98e19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:47.237662 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b08d9-e7ae-45be-9109-ae358a98e19b None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:47.237945 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b08d9-e7ae-45be-9109-ae358a98e19b None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:47.238223 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b08d9-e7ae-45be-9109-ae358a98e19b None admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:47.239246 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b08d9-e7ae-45be-9109-ae358a98e19b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:47.239592 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b08d9-e7ae-45be-9109-ae358a98e19b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:47.241337 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b08d9-e7ae-45be-9109-ae358a98e19b None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:47.253801 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 255/521] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:47.254596 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b08d9-e7ae-45be-9109-ae358a98e19b None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:47.304177 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609ddc8-87ae-4249-8e81-828a46e29917 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:47.347888 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb0a1b-3def-46a9-8a40-d34bf8312206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:47.348495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb0a1b-3def-46a9-8a40-d34bf8312206 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:47.348773 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb0a1b-3def-46a9-8a40-d34bf8312206 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:47.349054 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb0a1b-3def-46a9-8a40-d34bf8312206 None admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:47.349688 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb0a1b-3def-46a9-8a40-d34bf8312206 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:47.349987 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb0a1b-3def-46a9-8a40-d34bf8312206 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:47.351418 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb0a1b-3def-46a9-8a40-d34bf8312206 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:47.363879 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 267/522] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:47.364801 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb0a1b-3def-46a9-8a40-d34bf8312206 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:47.371582 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b08d9-e7ae-45be-9109-ae358a98e19b None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:47.395832 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:47.399936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:47.411960 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbfb16-78c6-4118-ba61-3eafdfb887ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:47.412675 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbfb16-78c6-4118-ba61-3eafdfb887ce None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:47.413044 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbfb16-78c6-4118-ba61-3eafdfb887ce None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:47.413340 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbfb16-78c6-4118-ba61-3eafdfb887ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:47.423960 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cbfb16-78c6-4118-ba61-3eafdfb887ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:47.425444 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cbfb16-78c6-4118-ba61-3eafdfb887ce None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:47.443416 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-f3cbfb16-78c6-4118-ba61-3eafdfb887ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:47.443416 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:47.443416 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:47.443416 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:47.443416 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:47.443416 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:47.443416 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:47.443416 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:47.443416 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:47.443416 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:47.443416 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:47.443416 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:47.443416 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:05:47.443416 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:05:47.443416 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:05:47.443416 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:05:47.444687 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:47.444687 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:47.444687 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:47.444687 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:47.444687 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:47.444687 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:47.444687 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:47.444687 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:47.444687 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:47.444687 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:47.444687 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:47.444687 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:47.444687 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:47.444687 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:47.444687 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:47.444687 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:47.444687 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:05:47.445543 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:05:47.445543 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:47.445543 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:47.445543 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 256/523] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:05:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:47.446069 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbfb16-78c6-4118-ba61-3eafdfb887ce None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:47.475913 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb0a1b-3def-46a9-8a40-d34bf8312206 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:47.512155 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd0cb3a-0a5d-4642-b17c-3886c4930105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:47.513137 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0cb3a-0a5d-4642-b17c-3886c4930105 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:47.513581 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0cb3a-0a5d-4642-b17c-3886c4930105 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:47.514053 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0cb3a-0a5d-4642-b17c-3886c4930105 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:47.521348 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd0cb3a-0a5d-4642-b17c-3886c4930105 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:47.522888 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd0cb3a-0a5d-4642-b17c-3886c4930105 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:47.534607 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-1dd0cb3a-0a5d-4642-b17c-3886c4930105 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 08 02:05:47.534607 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:47.534607 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:47.534607 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:47.534607 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:47.534607 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:47.534607 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:47.534607 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:47.534607 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:47.534607 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:47.534607 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:47.534607 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:47.534607 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:05:47.534607 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:05:47.534607 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:05:47.534607 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:05:47.535713 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:47.535713 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:47.535713 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:05:47.535713 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:05:47.535713 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:05:47.535713 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:05:47.535713 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:47.535713 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:47.535713 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:47.535713 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:47.535713 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:47.535713 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:47.535713 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:47.535713 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:47.535713 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:47.535713 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:47.535713 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:47.535713 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:47.536684 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:47.536684 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:47.536684 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:05:47.536684 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:05:47.536684 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:05:47.536684 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:05:47.536684 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:05:47.536684 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:05:47.536684 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 08 02:05:47.536684 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:47.536684 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 268/524] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 02:05:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:47.537240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd0cb3a-0a5d-4642-b17c-3886c4930105 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:47.551425 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbfb16-78c6-4118-ba61-3eafdfb887ce None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:47.586073 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fb144-0a36-4afe-897e-ada7160c78c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:47.586738 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fb144-0a36-4afe-897e-ada7160c78c0 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:47.587024 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fb144-0a36-4afe-897e-ada7160c78c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:47.587300 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fb144-0a36-4afe-897e-ada7160c78c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:47.594307 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9fb144-0a36-4afe-897e-ada7160c78c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:47.596795 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9fb144-0a36-4afe-897e-ada7160c78c0 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:47.610476 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-ec9fb144-0a36-4afe-897e-ada7160c78c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:05:47.610476 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:47.610476 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:47.610476 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:47.610476 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:47.610476 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:47.610476 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:47.610476 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:47.610476 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:47.610476 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:47.610476 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:47.610476 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:47.610476 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:05:47.610476 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:05:47.610476 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:05:47.611329 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:05:47.611329 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:47.611329 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:47.611329 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:47.611329 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:47.611329 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:47.611329 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:47.611329 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:47.611329 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:47.611329 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:47.611329 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:47.611329 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:47.611329 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:47.611329 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:47.611329 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:47.611329 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:47.611329 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:47.612218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:05:47.612218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:05:47.612218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:05:47.612218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:05:47.612218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:05:47.612218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:05:47.612218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:05:47.612218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:47.612218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 257/525] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:05:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:47.612803 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fb144-0a36-4afe-897e-ada7160c78c0 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:47.638339 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:47.647026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:47.651240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd0cb3a-0a5d-4642-b17c-3886c4930105 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:47.686387 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f83861-481e-4731-94b4-dbf3b2e7f086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:47.687016 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f83861-481e-4731-94b4-dbf3b2e7f086 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:47.687329 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f83861-481e-4731-94b4-dbf3b2e7f086 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:47.687627 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f83861-481e-4731-94b4-dbf3b2e7f086 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:47.696632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f83861-481e-4731-94b4-dbf3b2e7f086 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:47.696632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f83861-481e-4731-94b4-dbf3b2e7f086 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:47.708278 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-d6f83861-481e-4731-94b4-dbf3b2e7f086 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:05:47.708278 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:47.708278 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:47.708278 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:47.708278 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:47.708278 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:47.708278 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:47.708278 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:47.708278 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:47.708278 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:47.708278 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:47.708278 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:47.708278 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:05:47.708278 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:05:47.708278 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:05:47.709263 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:05:47.709263 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:47.709263 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:47.709263 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:47.709263 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:47.709263 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:47.709263 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:47.709263 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:47.709263 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:47.709263 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:47.709263 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:47.709263 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:47.709263 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:47.709263 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:47.709263 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:47.709263 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:47.709263 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:47.710189 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:05:47.710189 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:05:47.710189 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:05:47.710189 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:05:47.710189 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:05:47.710189 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:05:47.710189 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:05:47.710189 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:47.712504 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fb144-0a36-4afe-897e-ada7160c78c0 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:47.712921 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 269/526] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:05:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:47.713888 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f83861-481e-4731-94b4-dbf3b2e7f086 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:47.753281 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f4d19-d0d4-4969-83b7-b6d2142d3ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:47.753942 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f4d19-d0d4-4969-83b7-b6d2142d3ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:47.754228 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f4d19-d0d4-4969-83b7-b6d2142d3ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:47.754508 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f4d19-d0d4-4969-83b7-b6d2142d3ee0 None admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:47.755203 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f4d19-d0d4-4969-83b7-b6d2142d3ee0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:47.755711 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f4d19-d0d4-4969-83b7-b6d2142d3ee0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:47.756950 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f4d19-d0d4-4969-83b7-b6d2142d3ee0 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:47.768569 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 258/527] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:47.769416 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f4d19-d0d4-4969-83b7-b6d2142d3ee0 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:47.824181 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f83861-481e-4731-94b4-dbf3b2e7f086 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:47.860765 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72023739-77fb-472a-ae50-4cd4e7bd6912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:47.861375 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72023739-77fb-472a-ae50-4cd4e7bd6912 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:47.861657 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72023739-77fb-472a-ae50-4cd4e7bd6912 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:47.861931 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72023739-77fb-472a-ae50-4cd4e7bd6912 None admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:47.862667 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72023739-77fb-472a-ae50-4cd4e7bd6912 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:47.862975 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72023739-77fb-472a-ae50-4cd4e7bd6912 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:47.864473 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72023739-77fb-472a-ae50-4cd4e7bd6912 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:47.872572 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:47.879672 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f4d19-d0d4-4969-83b7-b6d2142d3ee0 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:47.885350 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 270/528] 10.222.0.23 () {56 vars in 1139 bytes} [Mon Aug 8 02:05:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:47.888189 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72023739-77fb-472a-ae50-4cd4e7bd6912 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:47.896823 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:47.918450 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f210d49c-d80c-4fbe-aaa8-5963aaaaa93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:47.919084 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210d49c-d80c-4fbe-aaa8-5963aaaaa93c None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:47.919385 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210d49c-d80c-4fbe-aaa8-5963aaaaa93c None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:47.919676 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210d49c-d80c-4fbe-aaa8-5963aaaaa93c None admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:47.920366 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f210d49c-d80c-4fbe-aaa8-5963aaaaa93c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:47.920676 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f210d49c-d80c-4fbe-aaa8-5963aaaaa93c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:47.922108 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f210d49c-d80c-4fbe-aaa8-5963aaaaa93c None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:47.940533 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 259/529] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 02:05:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:47.941361 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f210d49c-d80c-4fbe-aaa8-5963aaaaa93c None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:48.011609 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72023739-77fb-472a-ae50-4cd4e7bd6912 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:48.047979 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a843feb-b41f-46ef-a127-2ecbd1d9787a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:48.048584 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a843feb-b41f-46ef-a127-2ecbd1d9787a None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:48.048866 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a843feb-b41f-46ef-a127-2ecbd1d9787a None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:48.049140 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a843feb-b41f-46ef-a127-2ecbd1d9787a None admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:48.049825 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a843feb-b41f-46ef-a127-2ecbd1d9787a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:48.050136 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a843feb-b41f-46ef-a127-2ecbd1d9787a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:48.050787 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f210d49c-d80c-4fbe-aaa8-5963aaaaa93c None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:48.051591 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a843feb-b41f-46ef-a127-2ecbd1d9787a None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:48.069279 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 271/530] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 02:05:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:48.070070 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a843feb-b41f-46ef-a127-2ecbd1d9787a None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:48.092514 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d9c7b-96aa-4a12-8105-166743512ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:48.093135 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d9c7b-96aa-4a12-8105-166743512ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:48.093417 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d9c7b-96aa-4a12-8105-166743512ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:48.093938 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d9c7b-96aa-4a12-8105-166743512ca5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:48.101150 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d9c7b-96aa-4a12-8105-166743512ca5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:48.103126 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d9c7b-96aa-4a12-8105-166743512ca5 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:48.114089 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-ba2d9c7b-96aa-4a12-8105-166743512ca5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:05:48.114089 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:48.114089 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:48.114089 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:48.114089 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:48.114089 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:48.114089 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:48.114089 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:48.114089 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:48.114089 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:48.114089 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:48.114089 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:48.114089 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:05:48.114089 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:05:48.114089 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:05:48.114918 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:05:48.114918 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:48.114918 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:48.114918 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:48.114918 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:48.114918 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:48.114918 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:48.114918 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:48.114918 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:48.114918 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:48.114918 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:48.114918 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:48.114918 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:48.114918 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:48.114918 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:48.114918 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:48.114918 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:48.115815 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:05:48.115815 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:05:48.115815 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:05:48.115815 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:05:48.115815 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:05:48.115815 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:05:48.115815 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:05:48.115815 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:48.115815 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 260/531] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:05:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:48.116272 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d9c7b-96aa-4a12-8105-166743512ca5 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:48.135972 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:48.146264 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:48.183087 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a843feb-b41f-46ef-a127-2ecbd1d9787a None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:48.217022 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabdc456-5a00-47a5-a023-5f1b554e0b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:48.217632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdc456-5a00-47a5-a023-5f1b554e0b29 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:48.217947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdc456-5a00-47a5-a023-5f1b554e0b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:48.218213 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdc456-5a00-47a5-a023-5f1b554e0b29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:48.230197 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d9c7b-96aa-4a12-8105-166743512ca5 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:48.267215 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea408986-de6f-4012-9069-708f0e70fbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:48.267847 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea408986-de6f-4012-9069-708f0e70fbfe None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:48.268129 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea408986-de6f-4012-9069-708f0e70fbfe None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:48.268402 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea408986-de6f-4012-9069-708f0e70fbfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:48.269128 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea408986-de6f-4012-9069-708f0e70fbfe None admin] RBAC: Adding query filter params (role.id=071080f2ecc948319b313f2379ea2b97, scope.project.id=ebe178f5bce64a009bf690031676c89f, user.id=c63640b6bedd4e64b16657a34eb40f3b) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:48.269434 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea408986-de6f-4012-9069-708f0e70fbfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:48.270868 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea408986-de6f-4012-9069-708f0e70fbfe None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:48.276574 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 261/532] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:05:48 2022] GET /identity/v3/role_assignments?user.id=c63640b6bedd4e64b16657a34eb40f3b&scope.project.id=ebe178f5bce64a009bf690031676c89f&role.id=071080f2ecc948319b313f2379ea2b97 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:48.277425 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea408986-de6f-4012-9069-708f0e70fbfe None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:48.299959 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabdc456-5a00-47a5-a023-5f1b554e0b29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:48.302690 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabdc456-5a00-47a5-a023-5f1b554e0b29 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:48.370609 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:48.406125 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea408986-de6f-4012-9069-708f0e70fbfe None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:48.411066 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:48.449133 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8077b-9897-4e88-b903-5026808e094d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:48.450059 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8077b-9897-4e88-b903-5026808e094d None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:48.450718 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8077b-9897-4e88-b903-5026808e094d None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:48.451649 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8077b-9897-4e88-b903-5026808e094d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:48.452849 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c8077b-9897-4e88-b903-5026808e094d None admin] RBAC: Adding query filter params (role.id=071080f2ecc948319b313f2379ea2b97, scope.project.id=ebe178f5bce64a009bf690031676c89f, user.id=5d89e0c7d62444e4b75d3f4da49b2bc4) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:48.453345 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c8077b-9897-4e88-b903-5026808e094d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:48.455920 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c8077b-9897-4e88-b903-5026808e094d None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:48.462517 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 272/533] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:05:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:05:48.463586 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabdc456-5a00-47a5-a023-5f1b554e0b29 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:48.464868 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 262/534] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:05:48 2022] GET /identity/v3/role_assignments?user.id=5d89e0c7d62444e4b75d3f4da49b2bc4&scope.project.id=ebe178f5bce64a009bf690031676c89f&role.id=071080f2ecc948319b313f2379ea2b97 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:48.471524 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8077b-9897-4e88-b903-5026808e094d None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:48.615386 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8077b-9897-4e88-b903-5026808e094d None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:48.655697 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78280d3b-4264-42b5-a661-6e27bc26b40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:48.656742 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78280d3b-4264-42b5-a661-6e27bc26b40e None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:48.658033 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78280d3b-4264-42b5-a661-6e27bc26b40e None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:48.659075 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78280d3b-4264-42b5-a661-6e27bc26b40e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:48.661858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabdc456-5a00-47a5-a023-5f1b554e0b29 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:48.682764 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78280d3b-4264-42b5-a661-6e27bc26b40e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:48.687781 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78280d3b-4264-42b5-a661-6e27bc26b40e None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:48.692218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:48.709989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-78280d3b-4264-42b5-a661-6e27bc26b40e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:48.709989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:48.709989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:48.709989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:48.709989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:48.709989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:48.709989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:48.709989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:48.709989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:48.709989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:48.709989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:48.709989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:48.709989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:05:48.709989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:05:48.709989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:05:48.709989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:05:48.711096 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:48.711096 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:48.711096 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:48.711096 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:48.711096 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:48.711096 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:48.711096 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:48.711096 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:48.711096 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:48.711096 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:48.711096 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:48.711096 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:48.711096 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:48.711096 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:48.711096 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:48.711096 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:48.711096 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:05:48.712243 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:05:48.712243 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:48.712243 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:48.718437 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 263/535] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:05:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:48.720026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78280d3b-4264-42b5-a661-6e27bc26b40e None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:48.728796 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aac085-544f-4dd8-ac52-32f1b8f04e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:48.729650 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aac085-544f-4dd8-ac52-32f1b8f04e8d None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:48.731996 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aac085-544f-4dd8-ac52-32f1b8f04e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:48.732421 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aac085-544f-4dd8-ac52-32f1b8f04e8d None admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:48.733285 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aac085-544f-4dd8-ac52-32f1b8f04e8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:48.736511 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aac085-544f-4dd8-ac52-32f1b8f04e8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:48.738131 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aac085-544f-4dd8-ac52-32f1b8f04e8d None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:48.765786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 273/536] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 02:05:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:48.770208 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aac085-544f-4dd8-ac52-32f1b8f04e8d None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:48.799140 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:48.853082 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78280d3b-4264-42b5-a661-6e27bc26b40e None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:48.890968 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6a084-c4f9-42a6-858a-4f5d349cf1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:48.891883 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6a084-c4f9-42a6-858a-4f5d349cf1a7 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:48.892307 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6a084-c4f9-42a6-858a-4f5d349cf1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:48.892843 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6a084-c4f9-42a6-858a-4f5d349cf1a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:48.893734 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6a084-c4f9-42a6-858a-4f5d349cf1a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:48.894178 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6a084-c4f9-42a6-858a-4f5d349cf1a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:48.895716 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6a084-c4f9-42a6-858a-4f5d349cf1a7 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:48.896340 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aac085-544f-4dd8-ac52-32f1b8f04e8d None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:48.914407 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 264/537] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:48.916673 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d730b4-2d38-4cb9-b093-41ec6d815d83 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:48.917100 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d730b4-2d38-4cb9-b093-41ec6d815d83 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:48.917541 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d730b4-2d38-4cb9-b093-41ec6d815d83 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:48.919600 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 265/538] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:48.920526 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d730b4-2d38-4cb9-b093-41ec6d815d83 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:48.942621 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257f2e8-b11d-4d60-ba84-3946bf5ca2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:48.943226 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257f2e8-b11d-4d60-ba84-3946bf5ca2ab None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:48.943535 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257f2e8-b11d-4d60-ba84-3946bf5ca2ab None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:48.943811 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257f2e8-b11d-4d60-ba84-3946bf5ca2ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:48.944586 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257f2e8-b11d-4d60-ba84-3946bf5ca2ab None admin] RBAC: Adding query filter params (role.id=071080f2ecc948319b313f2379ea2b97, scope.project.id=ebe178f5bce64a009bf690031676c89f, user.id=aae574170d6f4eb8ab70805d8b5f4f08) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:48.944899 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257f2e8-b11d-4d60-ba84-3946bf5ca2ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:48.947147 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257f2e8-b11d-4d60-ba84-3946bf5ca2ab None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:48.955386 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 274/539] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:05:48 2022] GET /identity/v3/role_assignments?user.id=aae574170d6f4eb8ab70805d8b5f4f08&scope.project.id=ebe178f5bce64a009bf690031676c89f&role.id=071080f2ecc948319b313f2379ea2b97 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:48.957373 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87574ba9-0bb2-4ed3-9f2f-9ec948abc14e None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:48.957662 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87574ba9-0bb2-4ed3-9f2f-9ec948abc14e None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:48.964205 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87574ba9-0bb2-4ed3-9f2f-9ec948abc14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:49.002799 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-87574ba9-0bb2-4ed3-9f2f-9ec948abc14e None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:49.005831 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-87574ba9-0bb2-4ed3-9f2f-9ec948abc14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:49.026785 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:49.128501 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d730b4-2d38-4cb9-b093-41ec6d815d83 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:49.130162 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 275/540] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:49.174607 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87574ba9-0bb2-4ed3-9f2f-9ec948abc14e None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:49.183392 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7b977-731a-45b0-a86a-79cd86952574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:49.183392 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7b977-731a-45b0-a86a-79cd86952574 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:49.183660 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7b977-731a-45b0-a86a-79cd86952574 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:49.187414 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7b977-731a-45b0-a86a-79cd86952574 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:49.190771 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7b977-731a-45b0-a86a-79cd86952574 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:49.192290 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7b977-731a-45b0-a86a-79cd86952574 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:49.205000 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-52f7b977-731a-45b0-a86a-79cd86952574 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:05:49.205000 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:49.205000 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:49.205000 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:49.205000 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:49.205000 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:49.205000 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:49.205000 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:49.205000 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:49.205000 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:49.205000 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:49.205000 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:49.205000 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:05:49.205000 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:05:49.205000 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:05:49.206080 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:05:49.206080 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:49.206080 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:49.206080 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:49.206080 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:49.206080 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:49.206080 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:49.206080 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:49.206080 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:49.206080 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:49.206080 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:49.206080 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:49.206080 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:49.206080 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:49.206080 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:49.206080 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:49.206080 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:49.207099 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:05:49.207099 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:05:49.207099 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:05:49.207099 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:05:49.207099 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:05:49.207099 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:05:49.207099 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:05:49.207099 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:49.207099 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 266/541] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:05:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:49.214136 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7b977-731a-45b0-a86a-79cd86952574 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:49.225881 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:49.389040 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87574ba9-0bb2-4ed3-9f2f-9ec948abc14e None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:49.400316 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7b977-731a-45b0-a86a-79cd86952574 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:49.422256 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:49.449523 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d62da3-0d25-4979-ad1d-7c81ce9758f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:49.450157 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d62da3-0d25-4979-ad1d-7c81ce9758f2 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:49.450435 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d62da3-0d25-4979-ad1d-7c81ce9758f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:49.450709 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d62da3-0d25-4979-ad1d-7c81ce9758f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:49.456001 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd96096-bdbf-40c1-81d1-82bac9469aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:49.456599 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd96096-bdbf-40c1-81d1-82bac9469aff None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:49.456877 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd96096-bdbf-40c1-81d1-82bac9469aff None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:49.457150 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd96096-bdbf-40c1-81d1-82bac9469aff None admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:49.457841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd96096-bdbf-40c1-81d1-82bac9469aff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:49.458145 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd96096-bdbf-40c1-81d1-82bac9469aff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:49.461675 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd96096-bdbf-40c1-81d1-82bac9469aff None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:49.475612 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d62da3-0d25-4979-ad1d-7c81ce9758f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:49.480357 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-f6d62da3-0d25-4979-ad1d-7c81ce9758f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:05:49.480357 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:49.480357 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:49.480357 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:49.480357 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:49.480357 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:49.480357 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:49.480357 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:49.480357 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:49.480357 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:49.480357 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:49.480357 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:49.480357 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:49.480357 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:49.480357 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:49.480357 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:49.481218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:49.481218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:49.481218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:49.481218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:49.481218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:49.481218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:49.481218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:49.481218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:49.481218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:49.481218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:49.481218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:49.481218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:49.481218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:49.481218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:49.481218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:49.481218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:49.482191 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:49.482191 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:49.482191 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:49.482191 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:49.482191 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:49.482191 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:49.482191 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:49.482191 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:49.482191 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:49.482191 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:49.482191 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:05:49.482191 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:49.482191 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 276/542] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 02:05:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:05:49.484653 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 267/543] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 02:05:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:49.487554 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d62da3-0d25-4979-ad1d-7c81ce9758f2 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:49.490565 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd96096-bdbf-40c1-81d1-82bac9469aff None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:49.612661 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:49.619505 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd96096-bdbf-40c1-81d1-82bac9469aff None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:49.645096 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d62da3-0d25-4979-ad1d-7c81ce9758f2 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:49.654913 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e8d50-dcb2-440b-aecf-151e3ae5baa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:49.655611 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e8d50-dcb2-440b-aecf-151e3ae5baa5 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:49.655936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e8d50-dcb2-440b-aecf-151e3ae5baa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:49.656214 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e8d50-dcb2-440b-aecf-151e3ae5baa5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:49.657053 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e8d50-dcb2-440b-aecf-151e3ae5baa5 None admin] RBAC: Adding query filter params (role.id=071080f2ecc948319b313f2379ea2b97, scope.project.id=ebe178f5bce64a009bf690031676c89f, user.id=fa4c5732acb844369140e8d970577f94) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:49.657364 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e8d50-dcb2-440b-aecf-151e3ae5baa5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:49.658774 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e8d50-dcb2-440b-aecf-151e3ae5baa5 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:49.665261 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 268/544] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:05:49 2022] GET /identity/v3/role_assignments?user.id=fa4c5732acb844369140e8d970577f94&scope.project.id=ebe178f5bce64a009bf690031676c89f&role.id=071080f2ecc948319b313f2379ea2b97 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:49.737187 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8130c42-0359-44d4-9ef7-a8244eab4808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:49.737736 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8130c42-0359-44d4-9ef7-a8244eab4808 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:49.738022 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8130c42-0359-44d4-9ef7-a8244eab4808 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:49.738297 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8130c42-0359-44d4-9ef7-a8244eab4808 None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:49.738986 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8130c42-0359-44d4-9ef7-a8244eab4808 None admin] RBAC: Adding query filter params (name=service) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:49.739296 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8130c42-0359-44d4-9ef7-a8244eab4808 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:49.740710 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8130c42-0359-44d4-9ef7-a8244eab4808 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:49.752006 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 277/545] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 8 02:05:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:05:49.756642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e8d50-dcb2-440b-aecf-151e3ae5baa5 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:49.811784 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:49.869664 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e8d50-dcb2-440b-aecf-151e3ae5baa5 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:49.905180 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385051f-ba28-41bc-8969-7941406d99ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:49.905803 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385051f-ba28-41bc-8969-7941406d99ba None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:49.906085 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385051f-ba28-41bc-8969-7941406d99ba None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:49.906357 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385051f-ba28-41bc-8969-7941406d99ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:49.917199 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4385051f-ba28-41bc-8969-7941406d99ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:49.918696 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4385051f-ba28-41bc-8969-7941406d99ba None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:49.933255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-4385051f-ba28-41bc-8969-7941406d99ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:49.933255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:49.933255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:49.933255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:49.933255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:49.933255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:49.933255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:49.933255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:49.933255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:49.933255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:49.933255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:49.933255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:49.933255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:05:49.933255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:05:49.933255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:05:49.933255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:05:49.934225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:49.934225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:49.934225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:49.934225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:49.934225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:49.934225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:49.934225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:49.934225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:49.934225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:49.934225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:49.934225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:49.934225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:49.934225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:49.934225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:49.934225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:49.934225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:49.934225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:05:49.935472 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:05:49.935472 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:49.935472 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:49.935472 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 269/546] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:05:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:49.940310 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8130c42-0359-44d4-9ef7-a8244eab4808 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:50.097554 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8130c42-0359-44d4-9ef7-a8244eab4808 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:50.138722 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c8de8-3081-4bcf-9d8f-ba2a11052fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:50.139344 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c8de8-3081-4bcf-9d8f-ba2a11052fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:50.139623 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c8de8-3081-4bcf-9d8f-ba2a11052fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:50.139889 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c8de8-3081-4bcf-9d8f-ba2a11052fd5 None admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:50.140607 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c8de8-3081-4bcf-9d8f-ba2a11052fd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:50.140908 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c8de8-3081-4bcf-9d8f-ba2a11052fd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:50.142266 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c8de8-3081-4bcf-9d8f-ba2a11052fd5 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:50.158469 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 278/547] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:50.163963 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385051f-ba28-41bc-8969-7941406d99ba None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:50.267732 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:50.269751 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385051f-ba28-41bc-8969-7941406d99ba None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:50.304015 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274a789-b72f-48cf-98af-937768bb3466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:50.304680 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274a789-b72f-48cf-98af-937768bb3466 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:50.305730 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274a789-b72f-48cf-98af-937768bb3466 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:50.305883 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274a789-b72f-48cf-98af-937768bb3466 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:50.312962 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274a789-b72f-48cf-98af-937768bb3466 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:50.314386 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274a789-b72f-48cf-98af-937768bb3466 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:50.328102 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-4274a789-b72f-48cf-98af-937768bb3466 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 08 02:05:50.328102 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:50.328102 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:50.328102 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:50.328102 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:50.328102 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:50.328102 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:50.328102 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:50.328102 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:50.328102 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:50.328102 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:50.328102 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:50.328102 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:05:50.328102 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:05:50.328102 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:05:50.328102 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:05:50.329148 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:50.329148 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:50.329148 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:05:50.329148 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:05:50.329148 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:05:50.329148 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:05:50.329148 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:50.329148 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:50.329148 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:50.329148 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:50.329148 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:50.329148 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:50.329148 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:50.329148 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:50.329148 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:50.329148 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:50.329148 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:50.329148 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:50.331384 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:50.331384 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:50.331384 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:05:50.331384 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:05:50.331384 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:05:50.331384 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:05:50.331384 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:05:50.331384 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:05:50.331384 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 08 02:05:50.331384 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:50.331384 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 270/548] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 02:05:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:50.335089 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c8de8-3081-4bcf-9d8f-ba2a11052fd5 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:50.337927 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:50.497625 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c8de8-3081-4bcf-9d8f-ba2a11052fd5 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:50.546767 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a78c6c-3969-4921-8449-64748132b9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:50.547786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a78c6c-3969-4921-8449-64748132b9c8 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:50.548291 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a78c6c-3969-4921-8449-64748132b9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:50.548757 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a78c6c-3969-4921-8449-64748132b9c8 None admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:50.549681 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a78c6c-3969-4921-8449-64748132b9c8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:50.550196 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a78c6c-3969-4921-8449-64748132b9c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:50.551848 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a78c6c-3969-4921-8449-64748132b9c8 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:50.575542 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 279/549] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Aug 8 02:05:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:50.581405 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274a789-b72f-48cf-98af-937768bb3466 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:50.712760 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274a789-b72f-48cf-98af-937768bb3466 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:50.727519 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332d28f-2ad5-4547-8fa0-d08dbcf24520 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:50.728174 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332d28f-2ad5-4547-8fa0-d08dbcf24520 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:50.728646 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332d28f-2ad5-4547-8fa0-d08dbcf24520 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:50.733958 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 280/550] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:50.735618 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf862cd-abd8-429b-adf2-617a82a0b6a4 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:50.736111 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf862cd-abd8-429b-adf2-617a82a0b6a4 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:50.736588 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf862cd-abd8-429b-adf2-617a82a0b6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:50.747852 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b437c89-8e58-4bf1-a71a-85470d87d1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:50.748458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b437c89-8e58-4bf1-a71a-85470d87d1da None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:50.748884 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b437c89-8e58-4bf1-a71a-85470d87d1da None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:50.749119 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b437c89-8e58-4bf1-a71a-85470d87d1da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:50.780489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-eaf862cd-abd8-429b-adf2-617a82a0b6a4 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:50.781686 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-eaf862cd-abd8-429b-adf2-617a82a0b6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:50.791732 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:50.890690 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b437c89-8e58-4bf1-a71a-85470d87d1da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:50.892155 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b437c89-8e58-4bf1-a71a-85470d87d1da None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:50.897911 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:50.918474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 281/551] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:05:50.947748 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf862cd-abd8-429b-adf2-617a82a0b6a4 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:51.052805 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 271/552] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:05:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:05:51.054840 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af11ca8-19fb-419a-b94b-2f877a27b8f0 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:51.054840 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af11ca8-19fb-419a-b94b-2f877a27b8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:51.054840 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af11ca8-19fb-419a-b94b-2f877a27b8f0 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:51.058259 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 272/553] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:51.059033 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af11ca8-19fb-419a-b94b-2f877a27b8f0 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:51.060395 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf862cd-abd8-429b-adf2-617a82a0b6a4 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:51.100881 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46449758-4ace-42b7-b2b5-8df7b67a49f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:51.101883 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46449758-4ace-42b7-b2b5-8df7b67a49f7 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:51.102393 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46449758-4ace-42b7-b2b5-8df7b67a49f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:51.102901 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46449758-4ace-42b7-b2b5-8df7b67a49f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:51.113787 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46449758-4ace-42b7-b2b5-8df7b67a49f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:51.118923 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-46449758-4ace-42b7-b2b5-8df7b67a49f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:05:51.118923 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:51.118923 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:51.118923 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:51.118923 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:51.118923 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:51.118923 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:51.118923 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:51.118923 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:51.118923 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:51.118923 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:51.118923 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:51.118923 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:51.118923 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:51.118923 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:51.118923 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:51.119864 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:51.119864 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:51.119864 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:51.119864 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:51.119864 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:51.119864 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:51.119864 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:51.119864 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:51.119864 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:51.119864 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:51.119864 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:51.119864 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:51.119864 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:51.119864 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:51.119864 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:51.119864 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:51.120655 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:51.120655 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:51.120655 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:51.120655 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:51.120655 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:51.120655 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:51.120655 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:51.120655 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:51.120655 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:51.120655 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:51.120655 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:05:51.120655 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:51.127406 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:51.127820 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 282/554] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 02:05:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:05:51.129291 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a877a-1b59-4fb3-90da-ab4a51a12801 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:51.129777 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a877a-1b59-4fb3-90da-ab4a51a12801 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:51.130248 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a877a-1b59-4fb3-90da-ab4a51a12801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:51.154286 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-8a6a877a-1b59-4fb3-90da-ab4a51a12801 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:51.157463 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-8a6a877a-1b59-4fb3-90da-ab4a51a12801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:51.192631 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af11ca8-19fb-419a-b94b-2f877a27b8f0 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:51.207666 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:51.234916 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 283/555] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:51.235566 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a877a-1b59-4fb3-90da-ab4a51a12801 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:51.244990 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5783989e-65ed-41ba-8302-e867e3124cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:51.246462 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783989e-65ed-41ba-8302-e867e3124cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:51.246946 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783989e-65ed-41ba-8302-e867e3124cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:51.247882 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783989e-65ed-41ba-8302-e867e3124cd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:51.263178 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5783989e-65ed-41ba-8302-e867e3124cd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:51.265516 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5783989e-65ed-41ba-8302-e867e3124cd6 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:51.285333 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-5783989e-65ed-41ba-8302-e867e3124cd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:51.285333 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:51.285333 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:51.285333 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:51.285333 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:51.285333 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:51.285333 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:51.285333 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:51.285333 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:51.285333 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:51.285333 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:51.285333 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:51.285333 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:05:51.285333 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:05:51.285333 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:05:51.285333 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:05:51.286246 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:51.286246 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:51.286246 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:51.286246 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:51.286246 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:51.286246 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:51.286246 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:51.286246 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:51.286246 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:51.286246 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:51.286246 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:51.286246 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:51.286246 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:51.286246 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:51.286246 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:51.286246 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:51.286246 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:05:51.287092 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:05:51.287092 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:51.287092 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:51.289245 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 273/556] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:05:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:51.290734 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5783989e-65ed-41ba-8302-e867e3124cd6 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:51.369140 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a877a-1b59-4fb3-90da-ab4a51a12801 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:51.412166 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5783989e-65ed-41ba-8302-e867e3124cd6 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:51.414321 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:51.415777 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320f205-b805-4eb0-8abb-8c695e8af120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:51.417090 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320f205-b805-4eb0-8abb-8c695e8af120 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:51.417090 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320f205-b805-4eb0-8abb-8c695e8af120 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:51.417090 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320f205-b805-4eb0-8abb-8c695e8af120 None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:51.417893 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320f205-b805-4eb0-8abb-8c695e8af120 None admin] RBAC: Adding query filter params (name=service) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:51.418292 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320f205-b805-4eb0-8abb-8c695e8af120 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:51.419894 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320f205-b805-4eb0-8abb-8c695e8af120 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:51.428952 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 284/557] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 8 02:05:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:51.431046 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320f205-b805-4eb0-8abb-8c695e8af120 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:51.459487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422825d1-a6c6-4f80-9653-b1ba54297232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:51.460291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422825d1-a6c6-4f80-9653-b1ba54297232 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:51.460676 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422825d1-a6c6-4f80-9653-b1ba54297232 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:51.461035 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422825d1-a6c6-4f80-9653-b1ba54297232 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:51.472636 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422825d1-a6c6-4f80-9653-b1ba54297232 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:51.477615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-422825d1-a6c6-4f80-9653-b1ba54297232 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:05:51.477615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:51.477615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:51.477615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:51.477615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:51.477615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:51.477615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:51.477615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:51.477615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:51.477615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:51.477615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:51.477615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:51.477615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:51.477615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:51.477615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:51.477615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:51.479170 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:51.479170 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:51.479170 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:51.479170 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:51.479170 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:51.479170 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:51.479170 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:51.479170 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:51.479170 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:51.479170 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:51.479170 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:51.479170 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:51.479170 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:51.479170 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:51.479170 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:51.479170 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:51.480205 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:51.480205 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:51.480205 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:51.480205 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:51.480205 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:51.480205 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:51.480205 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:51.480205 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:51.480205 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:51.480205 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:51.480205 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:05:51.480205 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:51.481516 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 274/558] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 02:05:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:51.482434 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422825d1-a6c6-4f80-9653-b1ba54297232 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:51.497739 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:51.556912 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320f205-b805-4eb0-8abb-8c695e8af120 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:51.588691 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422825d1-a6c6-4f80-9653-b1ba54297232 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:51.592415 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be70ce0-c952-4b1a-bc49-f071c593c0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:51.593020 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be70ce0-c952-4b1a-bc49-f071c593c0d3 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:51.593297 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be70ce0-c952-4b1a-bc49-f071c593c0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:51.593569 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be70ce0-c952-4b1a-bc49-f071c593c0d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:51.594207 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be70ce0-c952-4b1a-bc49-f071c593c0d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:51.594531 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be70ce0-c952-4b1a-bc49-f071c593c0d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:51.595911 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be70ce0-c952-4b1a-bc49-f071c593c0d3 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:51.611399 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 285/559] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:51.612236 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be70ce0-c952-4b1a-bc49-f071c593c0d3 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:51.626709 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4166f-72f6-414c-baf9-66d391f7ef46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:51.627755 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4166f-72f6-414c-baf9-66d391f7ef46 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:51.628536 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4166f-72f6-414c-baf9-66d391f7ef46 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:51.628966 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4166f-72f6-414c-baf9-66d391f7ef46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:51.640008 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4166f-72f6-414c-baf9-66d391f7ef46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:51.641488 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4166f-72f6-414c-baf9-66d391f7ef46 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:51.656871 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-a4b4166f-72f6-414c-baf9-66d391f7ef46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:51.656871 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:51.656871 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:51.656871 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:51.656871 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:51.656871 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:51.656871 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:51.656871 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:51.656871 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:51.656871 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:51.656871 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:51.656871 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:51.656871 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:05:51.656871 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:05:51.656871 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:05:51.656871 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:05:51.657893 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:51.657893 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:51.657893 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:51.657893 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:51.657893 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:51.657893 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:51.657893 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:51.657893 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:51.657893 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:51.657893 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:51.657893 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:51.657893 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:51.657893 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:51.657893 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:51.657893 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:51.657893 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:51.657893 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:05:51.658802 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:05:51.658802 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:51.658802 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:51.662716 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 275/560] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:05:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:51.663970 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de314c-9b93-4ecb-a5e4-f00bd73f16a8 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:51.664257 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de314c-9b93-4ecb-a5e4-f00bd73f16a8 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:51.664558 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de314c-9b93-4ecb-a5e4-f00bd73f16a8 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:51.665984 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 276/561] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:51.666567 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de314c-9b93-4ecb-a5e4-f00bd73f16a8 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:51.684547 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:51.748057 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be70ce0-c952-4b1a-bc49-f071c593c0d3 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:51.749909 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:51.784700 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5c6cd-6d0a-4b59-9c15-710fe49ec173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:51.785735 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5c6cd-6d0a-4b59-9c15-710fe49ec173 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:51.786219 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5c6cd-6d0a-4b59-9c15-710fe49ec173 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:51.786708 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5c6cd-6d0a-4b59-9c15-710fe49ec173 None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:51.787710 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5c6cd-6d0a-4b59-9c15-710fe49ec173 None admin] RBAC: Adding query filter params (name=service) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:51.788232 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5c6cd-6d0a-4b59-9c15-710fe49ec173 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:51.789933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5c6cd-6d0a-4b59-9c15-710fe49ec173 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:51.791044 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de314c-9b93-4ecb-a5e4-f00bd73f16a8 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:51.800353 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 286/562] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 8 02:05:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:51.801202 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5c6cd-6d0a-4b59-9c15-710fe49ec173 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:51.833034 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0757c9-7225-4b2b-a143-5638aeb18d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:51.833656 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0757c9-7225-4b2b-a143-5638aeb18d8e None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:51.833938 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0757c9-7225-4b2b-a143-5638aeb18d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:51.834217 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0757c9-7225-4b2b-a143-5638aeb18d8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:51.840888 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0757c9-7225-4b2b-a143-5638aeb18d8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:51.842320 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0757c9-7225-4b2b-a143-5638aeb18d8e None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:51.853873 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-9f0757c9-7225-4b2b-a143-5638aeb18d8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:05:51.853873 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:51.853873 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:51.853873 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:51.853873 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:51.853873 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:51.853873 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:51.853873 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:51.853873 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:51.853873 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:51.853873 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:51.853873 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:51.853873 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:05:51.853873 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:05:51.853873 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:05:51.854825 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:05:51.854825 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:51.854825 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:51.854825 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:51.854825 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:51.854825 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:51.854825 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:51.854825 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:51.854825 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:51.854825 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:51.854825 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:51.854825 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:51.854825 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:51.854825 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:51.854825 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:51.854825 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:51.854825 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:51.855728 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:05:51.855728 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:05:51.855728 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:05:51.855728 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:05:51.855728 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:05:51.855728 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:05:51.855728 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:05:51.855728 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:51.855728 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 277/563] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:05:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:51.856201 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d111a-98b1-4e79-9e71-bd55627a2d3c None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:51.856727 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d111a-98b1-4e79-9e71-bd55627a2d3c None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:51.856831 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d111a-98b1-4e79-9e71-bd55627a2d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:51.876989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-c86d111a-98b1-4e79-9e71-bd55627a2d3c None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:51.878731 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-c86d111a-98b1-4e79-9e71-bd55627a2d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:51.914101 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5c6cd-6d0a-4b59-9c15-710fe49ec173 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:51.948736 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499d641-2c7d-42f3-b634-e844eb51a45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:51.949345 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499d641-2c7d-42f3-b634-e844eb51a45b None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:51.949627 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499d641-2c7d-42f3-b634-e844eb51a45b None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:51.949901 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499d641-2c7d-42f3-b634-e844eb51a45b None admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:51.950558 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499d641-2c7d-42f3-b634-e844eb51a45b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:51.950952 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499d641-2c7d-42f3-b634-e844eb51a45b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:51.952361 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499d641-2c7d-42f3-b634-e844eb51a45b None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:51.963734 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 278/564] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:51.963734 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d111a-98b1-4e79-9e71-bd55627a2d3c None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:51.964677 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 287/565] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:51.965496 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499d641-2c7d-42f3-b634-e844eb51a45b None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:51.965634 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:51.993277 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:52.066316 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d111a-98b1-4e79-9e71-bd55627a2d3c None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:52.084250 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499d641-2c7d-42f3-b634-e844eb51a45b None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:52.101470 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032164f4-d84f-4be5-964b-abf9b0f4f0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:52.102117 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032164f4-d84f-4be5-964b-abf9b0f4f0c2 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:52.102400 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032164f4-d84f-4be5-964b-abf9b0f4f0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:52.102673 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032164f4-d84f-4be5-964b-abf9b0f4f0c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:52.112364 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032164f4-d84f-4be5-964b-abf9b0f4f0c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:52.113808 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032164f4-d84f-4be5-964b-abf9b0f4f0c2 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:52.119196 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4cae47-0cbd-4914-a4b2-022e6fc76f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:52.123765 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4cae47-0cbd-4914-a4b2-022e6fc76f2f None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:52.125442 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4cae47-0cbd-4914-a4b2-022e6fc76f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:52.126322 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4cae47-0cbd-4914-a4b2-022e6fc76f2f None admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:52.127169 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4cae47-0cbd-4914-a4b2-022e6fc76f2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:52.127457 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4cae47-0cbd-4914-a4b2-022e6fc76f2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:52.128291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-032164f4-d84f-4be5-964b-abf9b0f4f0c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:52.128291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:52.128291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:52.128291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:52.128291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:52.128291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:52.128291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:52.128291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:52.128291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:52.128291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:52.128291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:52.128291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:52.128291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:05:52.128291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:05:52.128291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:05:52.128291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:05:52.129280 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:52.129280 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:52.129280 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:52.129280 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:52.129280 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:52.129280 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:52.129280 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:52.129280 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:52.129280 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:52.129280 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:52.129280 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:52.129280 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:52.129280 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:52.129280 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:52.129280 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:52.129280 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:52.129280 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:05:52.130131 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:05:52.130131 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:52.130131 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:52.130295 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4cae47-0cbd-4914-a4b2-022e6fc76f2f None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:52.130362 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 279/566] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:05:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:52.130362 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032164f4-d84f-4be5-964b-abf9b0f4f0c2 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:52.144567 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 288/567] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 02:05:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:52.144567 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4cae47-0cbd-4914-a4b2-022e6fc76f2f None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:52.187493 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:52.223543 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:52.231559 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032164f4-d84f-4be5-964b-abf9b0f4f0c2 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:52.238829 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4cae47-0cbd-4914-a4b2-022e6fc76f2f None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:52.266149 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0235f0-404d-4627-ae8d-3316c5939cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:52.266533 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0235f0-404d-4627-ae8d-3316c5939cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:52.266816 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0235f0-404d-4627-ae8d-3316c5939cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:52.267089 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0235f0-404d-4627-ae8d-3316c5939cd0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:52.273281 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b94e7d-16fb-414c-be83-f1208b0c4bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:52.274410 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b94e7d-16fb-414c-be83-f1208b0c4bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:52.274694 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b94e7d-16fb-414c-be83-f1208b0c4bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:52.274786 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0235f0-404d-4627-ae8d-3316c5939cd0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:52.274965 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b94e7d-16fb-414c-be83-f1208b0c4bd7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:52.276202 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0235f0-404d-4627-ae8d-3316c5939cd0 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:52.284735 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b94e7d-16fb-414c-be83-f1208b0c4bd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:52.286764 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-5b0235f0-404d-4627-ae8d-3316c5939cd0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 02:05:52.286764 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:52.286764 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:52.286764 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:52.286764 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:52.286764 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:52.286764 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:52.286764 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:52.286764 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:52.286764 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:52.286764 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:52.286764 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:52.286764 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:05:52.286764 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:05:52.286764 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:05:52.286764 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:05:52.287811 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:52.287811 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:52.287811 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:05:52.287811 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:05:52.287811 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:05:52.287811 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:05:52.287811 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:52.287811 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:52.287811 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:52.287811 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:52.287811 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:52.287811 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:52.287811 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:52.287811 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:52.287811 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:52.287811 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:52.287811 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:52.287811 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:52.288754 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:52.288754 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:52.288754 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:05:52.288754 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:05:52.288754 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:05:52.288754 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:05:52.288754 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:05:52.288754 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:05:52.288754 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 02:05:52.288754 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:52.288754 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 280/568] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:05:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:52.289340 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a4197-c3d1-477a-a673-425be79946f2 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:52.289340 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a4197-c3d1-477a-a673-425be79946f2 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:52.289466 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-55b94e7d-16fb-414c-be83-f1208b0c4bd7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:05:52.289466 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:52.289466 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:52.289466 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:52.289466 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:52.289466 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:52.289466 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:52.289466 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:52.289466 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:52.289466 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:52.289466 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:52.289466 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:52.289466 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:52.289466 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:52.289466 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:52.289466 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:52.290353 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:52.290353 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:52.290353 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:52.290353 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:52.290353 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:52.290353 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:52.290353 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:52.290353 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:52.290353 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:52.290353 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:52.290353 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:52.290353 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:52.290353 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:52.290353 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:52.290353 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:52.290353 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:52.295866 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:52.295866 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:52.295866 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:52.295866 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:52.295866 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:52.295866 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:52.295866 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:52.295866 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:52.295866 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:52.295866 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:52.295866 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:05:52.295866 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:52.296648 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a4197-c3d1-477a-a673-425be79946f2 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:52.296733 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 289/569] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 02:05:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:52.296811 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 281/570] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:52.296889 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b94e7d-16fb-414c-be83-f1208b0c4bd7 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:52.296967 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a4197-c3d1-477a-a673-425be79946f2 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:52.398786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b94e7d-16fb-414c-be83-f1208b0c4bd7 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:52.403032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a4197-c3d1-477a-a673-425be79946f2 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:52.419876 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:52.432305 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b75eb-b028-4f1f-bc3d-c47e49af1e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:52.432904 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b75eb-b028-4f1f-bc3d-c47e49af1e3e None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:52.433182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b75eb-b028-4f1f-bc3d-c47e49af1e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:52.433469 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b75eb-b028-4f1f-bc3d-c47e49af1e3e None admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:52.434089 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b75eb-b028-4f1f-bc3d-c47e49af1e3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:52.434391 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b75eb-b028-4f1f-bc3d-c47e49af1e3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:52.435792 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b75eb-b028-4f1f-bc3d-c47e49af1e3e None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:52.437086 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd8794-fdd1-4b4c-8484-44d219c44f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:52.437677 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd8794-fdd1-4b4c-8484-44d219c44f7b None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:52.437967 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd8794-fdd1-4b4c-8484-44d219c44f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:52.438241 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd8794-fdd1-4b4c-8484-44d219c44f7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:52.438969 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd8794-fdd1-4b4c-8484-44d219c44f7b None admin] RBAC: Adding query filter params (role.id=071080f2ecc948319b313f2379ea2b97, scope.project.id=ebe178f5bce64a009bf690031676c89f, user.id=6c212009b6a44e1bad92769630116408) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:52.439278 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd8794-fdd1-4b4c-8484-44d219c44f7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:52.440700 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd8794-fdd1-4b4c-8484-44d219c44f7b None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:52.446458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 282/571] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:05:52 2022] GET /identity/v3/role_assignments?user.id=6c212009b6a44e1bad92769630116408&scope.project.id=ebe178f5bce64a009bf690031676c89f&role.id=071080f2ecc948319b313f2379ea2b97 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:52.447219 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd8794-fdd1-4b4c-8484-44d219c44f7b None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:52.447633 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 290/572] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:05:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:52.448798 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac57e8d-1189-48e0-8f8f-1f3b7bdb1a84 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:52.449071 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac57e8d-1189-48e0-8f8f-1f3b7bdb1a84 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:52.449342 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac57e8d-1189-48e0-8f8f-1f3b7bdb1a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:52.468141 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:52.480995 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-5ac57e8d-1189-48e0-8f8f-1f3b7bdb1a84 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:52.482377 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-5ac57e8d-1189-48e0-8f8f-1f3b7bdb1a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:52.558818 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd8794-fdd1-4b4c-8484-44d219c44f7b None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:52.563397 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 291/573] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:52.563397 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac57e8d-1189-48e0-8f8f-1f3b7bdb1a84 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:52.610706 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa67d4b-d908-4a3d-ba95-30168387d60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:52.611390 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa67d4b-d908-4a3d-ba95-30168387d60c None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:52.611668 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa67d4b-d908-4a3d-ba95-30168387d60c None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:52.611964 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa67d4b-d908-4a3d-ba95-30168387d60c None admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:52.612698 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa67d4b-d908-4a3d-ba95-30168387d60c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:52.613003 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa67d4b-d908-4a3d-ba95-30168387d60c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:52.614414 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa67d4b-d908-4a3d-ba95-30168387d60c None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:52.637480 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 283/574] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Aug 8 02:05:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:52.638457 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa67d4b-d908-4a3d-ba95-30168387d60c None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:52.666761 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac57e8d-1189-48e0-8f8f-1f3b7bdb1a84 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:52.686196 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:52.706037 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878dec2b-10d2-49c0-b55f-3e5d85957f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:52.706667 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dec2b-10d2-49c0-b55f-3e5d85957f1a None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:52.706942 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dec2b-10d2-49c0-b55f-3e5d85957f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:52.707213 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dec2b-10d2-49c0-b55f-3e5d85957f1a None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:52.707981 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878dec2b-10d2-49c0-b55f-3e5d85957f1a None admin] RBAC: Adding query filter params (name=service) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:52.708294 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878dec2b-10d2-49c0-b55f-3e5d85957f1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:52.709708 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878dec2b-10d2-49c0-b55f-3e5d85957f1a None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:52.711125 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:52.722417 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 292/575] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 8 02:05:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:52.722417 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878dec2b-10d2-49c0-b55f-3e5d85957f1a None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:52.763214 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa67d4b-d908-4a3d-ba95-30168387d60c None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:52.797849 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41df7e0-7527-43cb-9b5c-3959407e78d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:52.798474 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41df7e0-7527-43cb-9b5c-3959407e78d7 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:52.798756 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41df7e0-7527-43cb-9b5c-3959407e78d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:52.799034 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41df7e0-7527-43cb-9b5c-3959407e78d7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:52.806667 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41df7e0-7527-43cb-9b5c-3959407e78d7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:52.808129 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41df7e0-7527-43cb-9b5c-3959407e78d7 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:52.820077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-c41df7e0-7527-43cb-9b5c-3959407e78d7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:05:52.820077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:52.820077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:52.820077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:52.820077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:52.820077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:52.820077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:52.820077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:52.820077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:52.820077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:52.820077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:52.820077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:52.820077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:05:52.820077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:05:52.820077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:05:52.820077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:05:52.821006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:52.821006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:52.821006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:05:52.821006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:05:52.821006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:05:52.821006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:05:52.821006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:52.821006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:52.821006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:52.821006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:52.821006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:52.821006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:52.821006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:52.821006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:52.821006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:52.821006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:52.821006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:52.821006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:52.821917 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:52.821917 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:52.821917 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:05:52.821917 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:05:52.821917 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:05:52.821917 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:05:52.821917 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:05:52.821917 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:05:52.821917 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:05:52.821917 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:52.821917 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 284/576] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Aug 8 02:05:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:52.821917 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41df7e0-7527-43cb-9b5c-3959407e78d7 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:52.831995 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878dec2b-10d2-49c0-b55f-3e5d85957f1a None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:52.867382 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa32ab6-7bec-4194-9333-bea6c860961f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:52.868746 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa32ab6-7bec-4194-9333-bea6c860961f None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:52.869047 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa32ab6-7bec-4194-9333-bea6c860961f None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:52.869348 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa32ab6-7bec-4194-9333-bea6c860961f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:52.880160 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa32ab6-7bec-4194-9333-bea6c860961f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:52.885252 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-1aa32ab6-7bec-4194-9333-bea6c860961f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:05:52.885252 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:52.885252 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:52.885252 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:52.885252 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:52.885252 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:52.885252 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:52.885252 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:52.885252 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:52.885252 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:52.885252 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:52.885252 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:52.885252 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:52.885252 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:52.885252 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:52.885252 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:52.886182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:52.886182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:52.886182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:52.886182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:52.886182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:52.886182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:52.886182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:52.886182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:52.886182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:52.886182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:52.886182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:52.886182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:52.886182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:52.886182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:52.886182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:52.886182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:52.886987 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:52.886987 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:52.886987 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:52.886987 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:52.886987 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:52.886987 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:52.886987 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:52.886987 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:52.886987 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:52.886987 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:52.886987 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:05:52.886987 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:52.886987 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 293/577] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 02:05:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:52.887744 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa32ab6-7bec-4194-9333-bea6c860961f None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:52.931639 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:52.935883 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41df7e0-7527-43cb-9b5c-3959407e78d7 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:52.946638 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:52.970042 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6613b63-b43c-4560-94bc-086fd0701c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:52.970665 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6613b63-b43c-4560-94bc-086fd0701c93 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:52.970936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6613b63-b43c-4560-94bc-086fd0701c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:52.971204 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6613b63-b43c-4560-94bc-086fd0701c93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:52.982295 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6613b63-b43c-4560-94bc-086fd0701c93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:52.983751 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6613b63-b43c-4560-94bc-086fd0701c93 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:52.997624 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-a6613b63-b43c-4560-94bc-086fd0701c93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:52.997624 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:52.997624 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:52.997624 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:52.997624 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:52.997624 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:52.997624 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:52.997624 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:52.997624 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:52.997624 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:52.997624 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:52.997624 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:52.997624 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:05:52.997624 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:05:52.997624 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:05:52.997624 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:05:53.004088 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:53.004088 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:53.004088 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:53.004088 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:53.004088 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:53.004088 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:53.004088 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:53.004088 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:53.004088 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:53.004088 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:53.004088 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:53.004088 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:53.004088 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:53.004088 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:53.004088 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:53.004088 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:53.004088 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:05:53.006145 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:05:53.006145 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:53.006145 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:53.006145 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 285/578] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:05:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:53.006145 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6613b63-b43c-4560-94bc-086fd0701c93 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:53.040926 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa32ab6-7bec-4194-9333-bea6c860961f None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:53.079661 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a944eb-b378-4c77-afe4-4f5c6496a8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:53.080294 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a944eb-b378-4c77-afe4-4f5c6496a8aa None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:53.080572 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a944eb-b378-4c77-afe4-4f5c6496a8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:53.080841 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a944eb-b378-4c77-afe4-4f5c6496a8aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:53.094535 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a944eb-b378-4c77-afe4-4f5c6496a8aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:53.096398 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a944eb-b378-4c77-afe4-4f5c6496a8aa None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:53.107876 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6613b63-b43c-4560-94bc-086fd0701c93 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:53.113322 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-81a944eb-b378-4c77-afe4-4f5c6496a8aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:53.113322 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:53.113322 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:53.113322 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:53.113322 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:53.113322 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:53.113322 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:53.113322 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:53.113322 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:53.113322 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:53.113322 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:53.113322 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:53.113322 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:05:53.113322 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:05:53.113322 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:05:53.113322 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:05:53.114230 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:53.114230 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:53.114230 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:53.114230 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:53.114230 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:53.114230 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:53.114230 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:53.114230 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:53.114230 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:53.114230 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:53.114230 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:53.114230 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:53.114230 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:53.114230 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:53.114230 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:53.114230 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:53.114230 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:05:53.115104 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:05:53.115104 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:53.115104 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:53.115913 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 294/579] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:05:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:53.116799 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a944eb-b378-4c77-afe4-4f5c6496a8aa None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:53.149416 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccc922-33c5-4b2a-ad08-72297508f51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:53.150383 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccc922-33c5-4b2a-ad08-72297508f51d None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:53.150826 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccc922-33c5-4b2a-ad08-72297508f51d None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:53.151293 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccc922-33c5-4b2a-ad08-72297508f51d None admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:53.152424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ccc922-33c5-4b2a-ad08-72297508f51d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:53.153039 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ccc922-33c5-4b2a-ad08-72297508f51d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:53.154631 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ccc922-33c5-4b2a-ad08-72297508f51d None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:53.179677 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 286/580] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Aug 8 02:05:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:53.179677 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccc922-33c5-4b2a-ad08-72297508f51d None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:53.192812 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:53.222417 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a944eb-b378-4c77-afe4-4f5c6496a8aa None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:53.232210 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:53.256828 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c5677-7e22-4342-8f60-a8362f388c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:53.257425 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c5677-7e22-4342-8f60-a8362f388c30 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:53.257702 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c5677-7e22-4342-8f60-a8362f388c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:53.257974 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c5677-7e22-4342-8f60-a8362f388c30 None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:53.258704 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c5677-7e22-4342-8f60-a8362f388c30 None admin] RBAC: Adding query filter params (name=service) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:53.259005 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c5677-7e22-4342-8f60-a8362f388c30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:53.260388 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c5677-7e22-4342-8f60-a8362f388c30 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:53.270700 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 295/581] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 8 02:05:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:53.276293 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c5677-7e22-4342-8f60-a8362f388c30 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:53.288088 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccc922-33c5-4b2a-ad08-72297508f51d None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:53.323903 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a6a91-5a56-4d30-b570-a72cdfa294a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:53.324503 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a6a91-5a56-4d30-b570-a72cdfa294a5 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:53.324785 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a6a91-5a56-4d30-b570-a72cdfa294a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:53.325052 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a6a91-5a56-4d30-b570-a72cdfa294a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:53.325696 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a6a91-5a56-4d30-b570-a72cdfa294a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:53.326001 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a6a91-5a56-4d30-b570-a72cdfa294a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:53.327374 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a6a91-5a56-4d30-b570-a72cdfa294a5 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:53.342651 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 287/582] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:53.342651 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a6a91-5a56-4d30-b570-a72cdfa294a5 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:53.396158 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c5677-7e22-4342-8f60-a8362f388c30 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:53.418238 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:53.441704 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de48cf-ee30-4f02-a0f0-88e51b386794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:53.442470 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de48cf-ee30-4f02-a0f0-88e51b386794 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:53.442760 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de48cf-ee30-4f02-a0f0-88e51b386794 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:53.443370 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de48cf-ee30-4f02-a0f0-88e51b386794 None admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:53.444301 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de48cf-ee30-4f02-a0f0-88e51b386794 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:53.444617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de48cf-ee30-4f02-a0f0-88e51b386794 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:53.446972 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de48cf-ee30-4f02-a0f0-88e51b386794 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:53.452746 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a6a91-5a56-4d30-b570-a72cdfa294a5 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:53.463211 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 296/583] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:53.464080 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de48cf-ee30-4f02-a0f0-88e51b386794 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:53.492254 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2ce20-af55-4fcd-aaff-574946f77ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:53.493033 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2ce20-af55-4fcd-aaff-574946f77ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:53.493388 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2ce20-af55-4fcd-aaff-574946f77ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:53.493669 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2ce20-af55-4fcd-aaff-574946f77ec7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:53.496907 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:53.505744 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2ce20-af55-4fcd-aaff-574946f77ec7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:53.508954 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2ce20-af55-4fcd-aaff-574946f77ec7 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:53.522285 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-d8f2ce20-af55-4fcd-aaff-574946f77ec7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:53.522285 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:53.522285 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:53.522285 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:53.522285 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:53.522285 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:53.522285 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:53.522285 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:53.522285 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:53.522285 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:53.522285 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:53.522285 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:53.522285 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:05:53.522285 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:05:53.522285 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:05:53.522285 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:05:53.523469 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:53.523469 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:53.523469 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:53.523469 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:53.523469 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:53.523469 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:53.523469 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:53.523469 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:53.523469 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:53.523469 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:53.523469 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:53.523469 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:53.523469 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:53.523469 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:53.523469 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:53.523469 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:53.523469 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:05:53.525331 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:05:53.525331 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:53.525331 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:53.528405 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 288/584] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:05:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:53.528928 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2ce20-af55-4fcd-aaff-574946f77ec7 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:53.577871 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de48cf-ee30-4f02-a0f0-88e51b386794 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:53.614509 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d57dfd-aad0-4f9e-ada1-7f60fe3303aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:53.615135 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d57dfd-aad0-4f9e-ada1-7f60fe3303aa None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:53.615443 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d57dfd-aad0-4f9e-ada1-7f60fe3303aa None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:53.615720 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d57dfd-aad0-4f9e-ada1-7f60fe3303aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:53.627713 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d57dfd-aad0-4f9e-ada1-7f60fe3303aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:53.629672 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d57dfd-aad0-4f9e-ada1-7f60fe3303aa None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:53.634821 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2ce20-af55-4fcd-aaff-574946f77ec7 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:53.648462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-46d57dfd-aad0-4f9e-ada1-7f60fe3303aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:53.648462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:53.648462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:53.648462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:53.648462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:53.648462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:53.648462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:53.648462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:53.648462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:53.648462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:53.648462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:53.648462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:53.648462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:05:53.648462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:05:53.648462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:05:53.648462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:05:53.649612 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:53.649612 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:53.649612 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:53.649612 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:53.649612 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:53.649612 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:53.649612 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:53.649612 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:53.649612 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:53.649612 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:53.649612 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:53.649612 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:53.649612 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:53.649612 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:53.649612 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:53.649612 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:53.649612 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:05:53.655641 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:05:53.655641 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:53.655641 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:53.655641 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 297/585] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:05:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:53.655641 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d57dfd-aad0-4f9e-ada1-7f60fe3303aa None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:53.657535 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:53.672997 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326047fc-52f6-4d43-aac0-89a32036c80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:53.673552 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326047fc-52f6-4d43-aac0-89a32036c80a None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:53.673832 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326047fc-52f6-4d43-aac0-89a32036c80a None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:53.674106 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326047fc-52f6-4d43-aac0-89a32036c80a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:53.681784 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326047fc-52f6-4d43-aac0-89a32036c80a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:53.683210 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326047fc-52f6-4d43-aac0-89a32036c80a None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:53.695028 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-326047fc-52f6-4d43-aac0-89a32036c80a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:05:53.695028 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:53.695028 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:53.695028 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:53.695028 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:53.695028 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:53.695028 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:53.695028 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:53.695028 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:53.695028 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:53.695028 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:53.695028 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:53.695028 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:05:53.695028 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:05:53.695028 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:05:53.696241 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:05:53.696241 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:53.696241 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:53.696241 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:53.696241 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:53.696241 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:53.696241 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:53.696241 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:53.696241 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:53.696241 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:53.696241 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:53.696241 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:53.696241 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:53.696241 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:53.696241 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:53.696241 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:53.696241 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:53.697315 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:05:53.697315 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:05:53.697315 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:05:53.697315 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:05:53.697315 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:05:53.697315 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:05:53.697315 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:05:53.697315 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:53.704387 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 289/586] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:05:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:53.705201 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326047fc-52f6-4d43-aac0-89a32036c80a None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:53.737060 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:53.755663 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d57dfd-aad0-4f9e-ada1-7f60fe3303aa None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:53.790206 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04ad09-15eb-4b88-93bc-7e6e2afdf91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:53.790909 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04ad09-15eb-4b88-93bc-7e6e2afdf91c None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:53.791251 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04ad09-15eb-4b88-93bc-7e6e2afdf91c None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:53.791558 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04ad09-15eb-4b88-93bc-7e6e2afdf91c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:53.798917 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c04ad09-15eb-4b88-93bc-7e6e2afdf91c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:53.800372 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c04ad09-15eb-4b88-93bc-7e6e2afdf91c None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:53.812327 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-3c04ad09-15eb-4b88-93bc-7e6e2afdf91c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 08 02:05:53.812327 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:53.812327 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:53.812327 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:53.812327 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:53.812327 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:53.812327 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:53.812327 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:53.812327 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:53.812327 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:53.812327 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:53.812327 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:53.812327 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:05:53.812327 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:05:53.812327 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:05:53.812327 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:05:53.813404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:53.813404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:53.813404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:05:53.813404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:05:53.813404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:05:53.813404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:05:53.813404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:53.813404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:53.813404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:53.813404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:53.813404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:53.813404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:53.813404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:53.813404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:53.813404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:53.813404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:53.813404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:53.813404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:53.814325 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:53.814325 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:53.814325 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:05:53.814325 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:05:53.814325 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:05:53.814325 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:05:53.814325 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:05:53.814325 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:05:53.814325 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 08 02:05:53.814325 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:53.814325 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 298/587] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:05:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:53.814898 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04ad09-15eb-4b88-93bc-7e6e2afdf91c None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:53.819912 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326047fc-52f6-4d43-aac0-89a32036c80a None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:53.854767 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab6bd9-b694-4898-9d9d-75eaf786f159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:53.855470 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab6bd9-b694-4898-9d9d-75eaf786f159 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:53.855761 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab6bd9-b694-4898-9d9d-75eaf786f159 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:53.856037 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab6bd9-b694-4898-9d9d-75eaf786f159 None admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:53.856681 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab6bd9-b694-4898-9d9d-75eaf786f159 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:53.856987 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab6bd9-b694-4898-9d9d-75eaf786f159 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:53.858340 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab6bd9-b694-4898-9d9d-75eaf786f159 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:53.873289 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 290/588] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:53.874577 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab6bd9-b694-4898-9d9d-75eaf786f159 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:53.921968 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:53.924376 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04ad09-15eb-4b88-93bc-7e6e2afdf91c None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:53.960062 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833a2ff-d1a0-4ac6-a801-8e432b72c180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:53.960669 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833a2ff-d1a0-4ac6-a801-8e432b72c180 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:53.960955 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833a2ff-d1a0-4ac6-a801-8e432b72c180 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:53.961227 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833a2ff-d1a0-4ac6-a801-8e432b72c180 None admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:53.962413 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9833a2ff-d1a0-4ac6-a801-8e432b72c180 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:53.962722 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9833a2ff-d1a0-4ac6-a801-8e432b72c180 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:53.964120 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9833a2ff-d1a0-4ac6-a801-8e432b72c180 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:53.976088 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 299/589] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:53.976088 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833a2ff-d1a0-4ac6-a801-8e432b72c180 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:53.983901 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:53.991450 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab6bd9-b694-4898-9d9d-75eaf786f159 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:54.047302 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a443660-fd06-430a-9114-26cd3b7aff0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:54.048027 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a443660-fd06-430a-9114-26cd3b7aff0b None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:54.048368 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a443660-fd06-430a-9114-26cd3b7aff0b None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:54.048716 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a443660-fd06-430a-9114-26cd3b7aff0b None admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:54.049481 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a443660-fd06-430a-9114-26cd3b7aff0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:54.049860 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a443660-fd06-430a-9114-26cd3b7aff0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:54.051373 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a443660-fd06-430a-9114-26cd3b7aff0b None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:54.064367 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 291/590] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 02:05:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:54.065254 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a443660-fd06-430a-9114-26cd3b7aff0b None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:54.125903 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833a2ff-d1a0-4ac6-a801-8e432b72c180 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:54.161082 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedcec0d-4450-4cf5-876e-904e73823398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:54.161686 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcec0d-4450-4cf5-876e-904e73823398 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:54.161959 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcec0d-4450-4cf5-876e-904e73823398 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:54.162237 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcec0d-4450-4cf5-876e-904e73823398 None admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:54.162958 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedcec0d-4450-4cf5-876e-904e73823398 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:54.163267 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedcec0d-4450-4cf5-876e-904e73823398 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:54.165230 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedcec0d-4450-4cf5-876e-904e73823398 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:54.177362 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:54.182090 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a443660-fd06-430a-9114-26cd3b7aff0b None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:54.183324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 300/591] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Aug 8 02:05:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:54.188291 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedcec0d-4450-4cf5-876e-904e73823398 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:54.219006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd56e4-4350-4afb-a652-3c83663929d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:54.219747 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd56e4-4350-4afb-a652-3c83663929d8 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:54.220034 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd56e4-4350-4afb-a652-3c83663929d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:54.220314 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd56e4-4350-4afb-a652-3c83663929d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:54.227810 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd56e4-4350-4afb-a652-3c83663929d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:54.229372 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd56e4-4350-4afb-a652-3c83663929d8 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:54.241154 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-16dd56e4-4350-4afb-a652-3c83663929d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:05:54.241154 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:54.241154 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:54.241154 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:54.241154 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:54.241154 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:54.241154 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:54.241154 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:54.241154 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:54.241154 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:54.241154 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:54.241154 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:54.241154 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:05:54.241154 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:05:54.241154 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:05:54.242041 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:05:54.242041 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:54.242041 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:54.242041 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:54.242041 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:54.242041 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:54.242041 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:54.242041 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:54.242041 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:54.242041 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:54.242041 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:54.242041 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:54.242041 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:54.242041 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:54.242041 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:54.242041 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:54.242041 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:54.243011 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:05:54.243011 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:05:54.243011 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:05:54.243011 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:05:54.243011 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:05:54.243011 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:05:54.243011 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:05:54.243011 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:54.243011 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 292/592] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:05:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:54.243011 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd56e4-4350-4afb-a652-3c83663929d8 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:54.253957 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:54.298437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedcec0d-4450-4cf5-876e-904e73823398 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:54.336196 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059bbe44-76b2-4525-a6ae-c41d42b3035b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:54.336824 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bbe44-76b2-4525-a6ae-c41d42b3035b None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:54.337103 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bbe44-76b2-4525-a6ae-c41d42b3035b None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:54.337375 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bbe44-76b2-4525-a6ae-c41d42b3035b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:54.344808 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059bbe44-76b2-4525-a6ae-c41d42b3035b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:54.346244 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059bbe44-76b2-4525-a6ae-c41d42b3035b None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:54.347060 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd56e4-4350-4afb-a652-3c83663929d8 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:54.358182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-059bbe44-76b2-4525-a6ae-c41d42b3035b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 08 02:05:54.358182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:54.358182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:54.358182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:54.358182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:54.358182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:54.358182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:54.358182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:54.358182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:54.358182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:54.358182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:54.358182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:54.358182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:05:54.358182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:05:54.358182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:05:54.358182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:05:54.359121 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:54.359121 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:54.359121 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:05:54.359121 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:05:54.359121 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:05:54.359121 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:05:54.359121 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:54.359121 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:54.359121 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:54.359121 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:54.359121 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:54.359121 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:54.359121 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:54.359121 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:54.359121 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:54.359121 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:54.359121 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:54.359121 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:54.360400 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:54.360400 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:54.360400 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:05:54.360400 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:05:54.360400 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:05:54.360400 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:05:54.360400 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:05:54.360400 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:05:54.360400 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 08 02:05:54.360400 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:54.360400 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 301/593] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 02:05:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:54.360400 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059bbe44-76b2-4525-a6ae-c41d42b3035b None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:54.386771 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f1c46-b3a5-4cb0-8c2a-adcec39b5bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:54.388350 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f1c46-b3a5-4cb0-8c2a-adcec39b5bc2 None admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:54.388788 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f1c46-b3a5-4cb0-8c2a-adcec39b5bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:54.389388 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f1c46-b3a5-4cb0-8c2a-adcec39b5bc2 None admin] PATH_INFO: `/v3/projects/ebe178f5bce64a009bf690031676c89f/users/c63640b6bedd4e64b16657a34eb40f3b/roles/071080f2ecc948319b313f2379ea2b97` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:54.408333 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f1c46-b3a5-4cb0-8c2a-adcec39b5bc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebe178f5bce64a009bf690031676c89f, user_id=c63640b6bedd4e64b16657a34eb40f3b, role_id=071080f2ecc948319b313f2379ea2b97)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:54.409767 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f1c46-b3a5-4cb0-8c2a-adcec39b5bc2 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:54.469749 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059bbe44-76b2-4525-a6ae-c41d42b3035b None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:54.483225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 293/594] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 02:05:54 2022] PUT /identity/v3/projects/ebe178f5bce64a009bf690031676c89f/users/c63640b6bedd4e64b16657a34eb40f3b/roles/071080f2ecc948319b313f2379ea2b97 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:05:54.484145 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f1c46-b3a5-4cb0-8c2a-adcec39b5bc2 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:54.495642 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:54.497054 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:54.511547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab42b10-715c-4eb1-b049-c392be9a7e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:54.512202 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab42b10-715c-4eb1-b049-c392be9a7e63 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:54.512485 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab42b10-715c-4eb1-b049-c392be9a7e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:54.524803 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab42b10-715c-4eb1-b049-c392be9a7e63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:54.525699 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab42b10-715c-4eb1-b049-c392be9a7e63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:54.527177 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab42b10-715c-4eb1-b049-c392be9a7e63 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:54.544068 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-4ab42b10-715c-4eb1-b049-c392be9a7e63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:54.544068 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:54.544068 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:54.544068 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:54.544068 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:54.544068 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:54.544068 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:54.544068 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:54.544068 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:54.544068 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:54.544068 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:54.544068 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:54.544068 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:05:54.544068 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:05:54.544068 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:05:54.544068 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:05:54.545253 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:54.545253 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:54.545253 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:54.545253 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:54.545253 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:54.545253 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:54.545253 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:54.545253 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:54.545253 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:54.545253 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:54.545253 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:54.545253 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:54.545253 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:54.545253 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:54.545253 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:54.545253 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:54.545253 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:05:54.546326 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:05:54.546326 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:54.546326 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:54.547403 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 302/595] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:05:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:54.548123 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab42b10-715c-4eb1-b049-c392be9a7e63 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:54.603132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f1c46-b3a5-4cb0-8c2a-adcec39b5bc2 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:54.646716 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1537db2a-ec6f-4e76-a427-70a130cf5047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:54.647368 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537db2a-ec6f-4e76-a427-70a130cf5047 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:54.647895 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537db2a-ec6f-4e76-a427-70a130cf5047 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:54.648008 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537db2a-ec6f-4e76-a427-70a130cf5047 None admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:54.648611 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1537db2a-ec6f-4e76-a427-70a130cf5047 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:54.649415 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1537db2a-ec6f-4e76-a427-70a130cf5047 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:54.650844 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1537db2a-ec6f-4e76-a427-70a130cf5047 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:54.660957 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab42b10-715c-4eb1-b049-c392be9a7e63 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:54.663014 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 294/596] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 02:05:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:54.664269 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1f553-ae8a-445a-bd51-9fcc38202393 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:54.664597 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1f553-ae8a-445a-bd51-9fcc38202393 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:54.664879 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1f553-ae8a-445a-bd51-9fcc38202393 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:54.670112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 295/597] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:54.670112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1f553-ae8a-445a-bd51-9fcc38202393 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:54.702769 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47bbbe-0633-4ddf-8392-c57b6e98b834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:54.703559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47bbbe-0633-4ddf-8392-c57b6e98b834 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:54.703841 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47bbbe-0633-4ddf-8392-c57b6e98b834 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:54.704167 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47bbbe-0633-4ddf-8392-c57b6e98b834 None admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:54.705014 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47bbbe-0633-4ddf-8392-c57b6e98b834 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:54.705325 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47bbbe-0633-4ddf-8392-c57b6e98b834 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:54.706823 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47bbbe-0633-4ddf-8392-c57b6e98b834 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:54.727692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 303/598] 10.222.0.23 () {56 vars in 1139 bytes} [Mon Aug 8 02:05:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:54.728742 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47bbbe-0633-4ddf-8392-c57b6e98b834 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:54.750572 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:54.763678 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:54.783767 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1f553-ae8a-445a-bd51-9fcc38202393 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:54.819481 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15283c-7f1e-4019-98f0-bf8ba0386f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:54.820182 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15283c-7f1e-4019-98f0-bf8ba0386f53 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:54.820549 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15283c-7f1e-4019-98f0-bf8ba0386f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:54.820972 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15283c-7f1e-4019-98f0-bf8ba0386f53 None admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:54.821691 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15283c-7f1e-4019-98f0-bf8ba0386f53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:54.822061 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15283c-7f1e-4019-98f0-bf8ba0386f53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:54.823516 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15283c-7f1e-4019-98f0-bf8ba0386f53 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:54.836092 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 296/599] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:54.837142 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0e6d3-0537-4156-8415-6e4e93949dcb None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:54.837426 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0e6d3-0537-4156-8415-6e4e93949dcb None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:54.837699 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0e6d3-0537-4156-8415-6e4e93949dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:54.840435 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47bbbe-0633-4ddf-8392-c57b6e98b834 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:54.855480 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-b9a0e6d3-0537-4156-8415-6e4e93949dcb None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:54.856753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-b9a0e6d3-0537-4156-8415-6e4e93949dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:54.874963 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f42d1a-31f9-4b1c-b0dd-1b82087bb686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:54.875645 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f42d1a-31f9-4b1c-b0dd-1b82087bb686 None admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:54.875926 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f42d1a-31f9-4b1c-b0dd-1b82087bb686 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:54.876200 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f42d1a-31f9-4b1c-b0dd-1b82087bb686 None admin] PATH_INFO: `/v3/projects/ebe178f5bce64a009bf690031676c89f/users/5d89e0c7d62444e4b75d3f4da49b2bc4/roles/071080f2ecc948319b313f2379ea2b97` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:54.892833 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f42d1a-31f9-4b1c-b0dd-1b82087bb686 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebe178f5bce64a009bf690031676c89f, user_id=5d89e0c7d62444e4b75d3f4da49b2bc4, role_id=071080f2ecc948319b313f2379ea2b97)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:54.894286 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f42d1a-31f9-4b1c-b0dd-1b82087bb686 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:54.922535 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 297/600] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:54.923496 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0e6d3-0537-4156-8415-6e4e93949dcb None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:54.983468 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 304/601] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 02:05:54 2022] PUT /identity/v3/projects/ebe178f5bce64a009bf690031676c89f/users/5d89e0c7d62444e4b75d3f4da49b2bc4/roles/071080f2ecc948319b313f2379ea2b97 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:05:54.983468 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f42d1a-31f9-4b1c-b0dd-1b82087bb686 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:55.001848 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:55.049420 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0e6d3-0537-4156-8415-6e4e93949dcb None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:55.067996 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:55.088463 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f42d1a-31f9-4b1c-b0dd-1b82087bb686 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:55.098422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34b21c-1edc-43de-9a0c-b8433473428d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:55.099644 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34b21c-1edc-43de-9a0c-b8433473428d None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:55.100028 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34b21c-1edc-43de-9a0c-b8433473428d None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:55.100698 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34b21c-1edc-43de-9a0c-b8433473428d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:55.115873 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b34b21c-1edc-43de-9a0c-b8433473428d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:55.119250 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b34b21c-1edc-43de-9a0c-b8433473428d None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:55.127479 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012e83d-b891-4814-b604-a7759ed85e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:55.128213 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012e83d-b891-4814-b604-a7759ed85e4a None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:55.128493 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012e83d-b891-4814-b604-a7759ed85e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:55.128781 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012e83d-b891-4814-b604-a7759ed85e4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:55.140290 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a012e83d-b891-4814-b604-a7759ed85e4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:55.141818 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a012e83d-b891-4814-b604-a7759ed85e4a None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:55.142323 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-0b34b21c-1edc-43de-9a0c-b8433473428d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:55.142323 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:55.142323 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:55.142323 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:55.142323 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:55.142323 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:55.142323 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:55.142323 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:55.142323 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:55.142323 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:55.142323 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:55.142323 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:55.142323 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:05:55.142323 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:05:55.142323 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:05:55.142323 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:05:55.143458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:55.143458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:55.143458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:55.143458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:55.143458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:55.143458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:55.143458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:55.143458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:55.143458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:55.143458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:55.143458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:55.143458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:55.143458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:55.143458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:55.143458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:55.143458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:55.143458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:05:55.144548 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:05:55.144548 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:55.144548 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:55.146358 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 298/602] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:05:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:55.147343 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34b21c-1edc-43de-9a0c-b8433473428d None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:55.166172 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-a012e83d-b891-4814-b604-a7759ed85e4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:05:55.166172 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:55.166172 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:55.166172 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:55.166172 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:55.166172 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:55.166172 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:55.166172 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:55.166172 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:55.166172 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:55.166172 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:55.166172 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:55.166172 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:05:55.166172 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:05:55.166172 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:05:55.167329 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:05:55.167329 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:55.167329 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:55.167329 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:55.167329 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:55.167329 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:55.167329 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:55.167329 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:55.167329 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:55.167329 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:55.167329 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:55.167329 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:55.167329 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:55.167329 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:55.167329 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:55.167329 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:55.167329 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:55.168470 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:05:55.168470 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:05:55.168470 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:05:55.168470 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:05:55.168470 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:05:55.168470 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:05:55.168470 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:05:55.168470 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:55.169832 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 305/603] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:05:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:55.171164 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012e83d-b891-4814-b604-a7759ed85e4a None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:55.264310 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34b21c-1edc-43de-9a0c-b8433473428d None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:55.278270 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:55.299344 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa74a5-f9ca-4540-9440-82dd86bdebe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:55.300197 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa74a5-f9ca-4540-9440-82dd86bdebe0 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:55.300585 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa74a5-f9ca-4540-9440-82dd86bdebe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:55.300960 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa74a5-f9ca-4540-9440-82dd86bdebe0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:55.309812 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012e83d-b891-4814-b604-a7759ed85e4a None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:55.314030 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa74a5-f9ca-4540-9440-82dd86bdebe0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:55.318593 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-32aa74a5-f9ca-4540-9440-82dd86bdebe0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:05:55.318593 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:55.318593 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:55.318593 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:55.318593 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:55.318593 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:55.318593 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:55.318593 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:55.318593 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:55.318593 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:55.318593 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:55.318593 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:55.318593 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:55.318593 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:55.318593 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:55.318593 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:55.319725 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:55.319725 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:55.319725 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:55.319725 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:55.319725 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:55.319725 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:55.319725 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:55.319725 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:55.319725 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:55.319725 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:55.319725 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:55.319725 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:55.319725 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:55.319725 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:55.319725 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:55.319725 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:55.320797 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:55.320797 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:55.320797 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:55.320797 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:55.320797 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:55.320797 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:55.320797 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:55.320797 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:55.320797 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:55.320797 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:55.320797 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:05:55.320797 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:55.322687 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 299/604] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 02:05:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:55.327685 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa74a5-f9ca-4540-9440-82dd86bdebe0 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:55.356463 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a0665-5fd7-4643-825c-d6ad76bb31fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:55.357551 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a0665-5fd7-4643-825c-d6ad76bb31fe None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:55.357979 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a0665-5fd7-4643-825c-d6ad76bb31fe None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:55.358624 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a0665-5fd7-4643-825c-d6ad76bb31fe None admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:55.359881 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a0665-5fd7-4643-825c-d6ad76bb31fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:55.360620 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a0665-5fd7-4643-825c-d6ad76bb31fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:55.362787 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a0665-5fd7-4643-825c-d6ad76bb31fe None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:55.380990 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 306/605] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:55.386001 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a0665-5fd7-4643-825c-d6ad76bb31fe None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:55.386001 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:55.458115 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa74a5-f9ca-4540-9440-82dd86bdebe0 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:55.494012 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965fccf-9d46-4732-b22f-61771eca9f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:55.494857 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965fccf-9d46-4732-b22f-61771eca9f8e None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:55.495286 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965fccf-9d46-4732-b22f-61771eca9f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:55.495756 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965fccf-9d46-4732-b22f-61771eca9f8e None admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:55.496582 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965fccf-9d46-4732-b22f-61771eca9f8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:55.497050 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965fccf-9d46-4732-b22f-61771eca9f8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:55.497976 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a0665-5fd7-4643-825c-d6ad76bb31fe None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:55.498860 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965fccf-9d46-4732-b22f-61771eca9f8e None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:55.512864 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 300/606] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 02:05:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:55.513920 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965fccf-9d46-4732-b22f-61771eca9f8e None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:55.535589 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e484d-11a6-4f8e-9c28-fb4ddf933173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:55.536558 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e484d-11a6-4f8e-9c28-fb4ddf933173 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:55.537058 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e484d-11a6-4f8e-9c28-fb4ddf933173 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:55.537544 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e484d-11a6-4f8e-9c28-fb4ddf933173 None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:55.538556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e484d-11a6-4f8e-9c28-fb4ddf933173 None admin] RBAC: Adding query filter params (name=service) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:55.539061 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e484d-11a6-4f8e-9c28-fb4ddf933173 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:55.540832 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e484d-11a6-4f8e-9c28-fb4ddf933173 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:55.551504 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 307/607] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 8 02:05:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:55.552294 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e484d-11a6-4f8e-9c28-fb4ddf933173 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:55.567727 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:55.621528 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:55.625652 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965fccf-9d46-4732-b22f-61771eca9f8e None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:55.660223 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfccfe2-3a88-4f13-af08-8bff95bcb591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:55.660850 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfccfe2-3a88-4f13-af08-8bff95bcb591 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:55.661180 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfccfe2-3a88-4f13-af08-8bff95bcb591 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:55.661459 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfccfe2-3a88-4f13-af08-8bff95bcb591 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:55.664024 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e484d-11a6-4f8e-9c28-fb4ddf933173 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:55.668975 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfccfe2-3a88-4f13-af08-8bff95bcb591 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:55.670471 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfccfe2-3a88-4f13-af08-8bff95bcb591 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:55.682034 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-abfccfe2-3a88-4f13-af08-8bff95bcb591 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:05:55.682034 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:55.682034 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:55.682034 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:55.682034 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:55.682034 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:55.682034 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:55.682034 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:55.682034 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:55.682034 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:55.682034 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:55.682034 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:55.682034 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:05:55.682034 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:05:55.682034 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:05:55.683108 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:05:55.683108 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:55.683108 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:55.683108 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:55.683108 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:55.683108 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:55.683108 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:55.683108 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:55.683108 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:55.683108 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:55.683108 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:55.683108 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:55.683108 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:55.683108 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:55.683108 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:55.683108 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:55.683108 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:55.684315 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:05:55.684315 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:05:55.684315 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:05:55.684315 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:05:55.684315 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:05:55.684315 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:05:55.684315 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:05:55.684315 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:55.687469 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 301/608] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:05:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:55.688288 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfccfe2-3a88-4f13-af08-8bff95bcb591 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:55.705355 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d9036-53ca-4db0-bae9-39c04dd4625b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:55.706238 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d9036-53ca-4db0-bae9-39c04dd4625b None admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:55.706666 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d9036-53ca-4db0-bae9-39c04dd4625b None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:55.707110 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d9036-53ca-4db0-bae9-39c04dd4625b None admin] PATH_INFO: `/v3/projects/ebe178f5bce64a009bf690031676c89f/users/aae574170d6f4eb8ab70805d8b5f4f08/roles/071080f2ecc948319b313f2379ea2b97` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:55.721888 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d9036-53ca-4db0-bae9-39c04dd4625b None admin] RBAC: Authorizing `identity:create_grant(project_id=ebe178f5bce64a009bf690031676c89f, user_id=aae574170d6f4eb8ab70805d8b5f4f08, role_id=071080f2ecc948319b313f2379ea2b97)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:55.723537 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d9036-53ca-4db0-bae9-39c04dd4625b None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:55.787450 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:55.795731 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfccfe2-3a88-4f13-af08-8bff95bcb591 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:55.831505 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70ed9d-6891-4198-9dab-abdf655dc2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:55.831505 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70ed9d-6891-4198-9dab-abdf655dc2f3 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:55.831505 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70ed9d-6891-4198-9dab-abdf655dc2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:55.831505 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70ed9d-6891-4198-9dab-abdf655dc2f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:55.834233 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 308/609] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 02:05:55 2022] PUT /identity/v3/projects/ebe178f5bce64a009bf690031676c89f/users/aae574170d6f4eb8ab70805d8b5f4f08/roles/071080f2ecc948319b313f2379ea2b97 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:05:55.835580 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d9036-53ca-4db0-bae9-39c04dd4625b None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:55.843610 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70ed9d-6891-4198-9dab-abdf655dc2f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:55.846520 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70ed9d-6891-4198-9dab-abdf655dc2f3 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:55.860396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-6a70ed9d-6891-4198-9dab-abdf655dc2f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:55.860396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:55.860396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:55.860396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:55.860396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:55.860396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:55.860396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:55.860396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:55.860396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:55.860396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:55.860396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:55.860396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:55.860396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:05:55.860396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:05:55.860396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:05:55.860396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:05:55.861431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:55.861431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:55.861431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:55.861431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:55.861431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:55.861431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:55.861431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:55.861431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:55.861431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:55.861431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:55.861431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:55.861431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:55.861431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:55.861431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:55.861431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:55.861431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:55.861431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:05:55.862328 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:05:55.862328 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:55.862328 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:55.871458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 302/610] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:05:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:55.872520 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70ed9d-6891-4198-9dab-abdf655dc2f3 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:56.002686 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70ed9d-6891-4198-9dab-abdf655dc2f3 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:56.045853 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c69a14-1aa8-4bf7-b926-7ff670daf39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:56.046392 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c69a14-1aa8-4bf7-b926-7ff670daf39d None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:56.046671 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c69a14-1aa8-4bf7-b926-7ff670daf39d None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:56.046941 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c69a14-1aa8-4bf7-b926-7ff670daf39d None admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:56.047614 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c69a14-1aa8-4bf7-b926-7ff670daf39d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:56.047915 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c69a14-1aa8-4bf7-b926-7ff670daf39d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:56.049293 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c69a14-1aa8-4bf7-b926-7ff670daf39d None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:56.065630 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d9036-53ca-4db0-bae9-39c04dd4625b None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:56.078151 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 303/611] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:56.084958 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c69a14-1aa8-4bf7-b926-7ff670daf39d None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:56.086957 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:56.096494 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:56.119334 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066360d-13e6-4198-9e0b-793589e9d4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:56.120071 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066360d-13e6-4198-9e0b-793589e9d4be None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:56.120352 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066360d-13e6-4198-9e0b-793589e9d4be None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:56.120853 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066360d-13e6-4198-9e0b-793589e9d4be None admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:56.121549 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d066360d-13e6-4198-9e0b-793589e9d4be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:56.121858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d066360d-13e6-4198-9e0b-793589e9d4be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:56.123330 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d066360d-13e6-4198-9e0b-793589e9d4be None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:56.136405 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 309/612] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 02:05:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:56.143847 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066360d-13e6-4198-9e0b-793589e9d4be None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:56.270281 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c69a14-1aa8-4bf7-b926-7ff670daf39d None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:56.330739 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066360d-13e6-4198-9e0b-793589e9d4be None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:56.333401 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0a2a3-c1a9-45a0-84e6-fe4527c64ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:56.334033 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0a2a3-c1a9-45a0-84e6-fe4527c64ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:56.334310 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0a2a3-c1a9-45a0-84e6-fe4527c64ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:56.334581 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0a2a3-c1a9-45a0-84e6-fe4527c64ee7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:56.350152 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0a2a3-c1a9-45a0-84e6-fe4527c64ee7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:56.351615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0a2a3-c1a9-45a0-84e6-fe4527c64ee7 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:56.368116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-45f0a2a3-c1a9-45a0-84e6-fe4527c64ee7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 08 02:05:56.368116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:56.368116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:56.368116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:56.368116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:56.368116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:56.368116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:56.368116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:56.368116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:56.368116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:56.368116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:56.368116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:56.368116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:05:56.368116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:05:56.368116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:05:56.368116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:05:56.369067 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:56.369067 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:56.369067 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:05:56.369067 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:05:56.369067 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:05:56.369067 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:05:56.369067 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:56.369067 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:56.369067 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:56.369067 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:56.369067 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:56.369067 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:56.369067 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:56.369067 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:56.369067 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:56.369067 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:56.369067 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:56.369067 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:56.369984 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:56.369984 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:56.369984 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:05:56.369984 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:05:56.369984 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:05:56.369984 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:05:56.369984 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:05:56.369984 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:05:56.369984 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 08 02:05:56.369984 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:56.369984 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 304/613] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 02:05:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:56.375962 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0a2a3-c1a9-45a0-84e6-fe4527c64ee7 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:56.400436 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece34142-5b1c-4997-84c5-944d14f81d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:56.401103 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece34142-5b1c-4997-84c5-944d14f81d72 None admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:56.401380 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece34142-5b1c-4997-84c5-944d14f81d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:56.401650 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece34142-5b1c-4997-84c5-944d14f81d72 None admin] PATH_INFO: `/v3/projects/ebe178f5bce64a009bf690031676c89f/users/fa4c5732acb844369140e8d970577f94/roles/071080f2ecc948319b313f2379ea2b97` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:56.428520 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece34142-5b1c-4997-84c5-944d14f81d72 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebe178f5bce64a009bf690031676c89f, user_id=fa4c5732acb844369140e8d970577f94, role_id=071080f2ecc948319b313f2379ea2b97)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:56.429957 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece34142-5b1c-4997-84c5-944d14f81d72 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:56.472161 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:56.505452 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0a2a3-c1a9-45a0-84e6-fe4527c64ee7 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:56.517985 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 310/614] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 02:05:56 2022] PUT /identity/v3/projects/ebe178f5bce64a009bf690031676c89f/users/fa4c5732acb844369140e8d970577f94/roles/071080f2ecc948319b313f2379ea2b97 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:05:56.559940 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8126bdd-ea91-4e33-bcbf-c5c9f9493697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:56.560550 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8126bdd-ea91-4e33-bcbf-c5c9f9493697 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:56.560880 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8126bdd-ea91-4e33-bcbf-c5c9f9493697 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:56.561159 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8126bdd-ea91-4e33-bcbf-c5c9f9493697 None admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:56.561941 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8126bdd-ea91-4e33-bcbf-c5c9f9493697 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:56.562245 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8126bdd-ea91-4e33-bcbf-c5c9f9493697 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:56.563727 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8126bdd-ea91-4e33-bcbf-c5c9f9493697 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:56.589123 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 305/615] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Aug 8 02:05:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:56.594804 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece34142-5b1c-4997-84c5-944d14f81d72 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:56.610222 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d43706-84c3-4ca2-a685-8b495f641c95 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:56.610599 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d43706-84c3-4ca2-a685-8b495f641c95 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:56.610769 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d43706-84c3-4ca2-a685-8b495f641c95 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:56.612553 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 306/616] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:56.618444 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af2662-cc80-4f6b-9c7f-907b119896eb None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:56.618851 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af2662-cc80-4f6b-9c7f-907b119896eb None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:56.619131 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af2662-cc80-4f6b-9c7f-907b119896eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:56.644969 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:56.651706 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-13af2662-cc80-4f6b-9c7f-907b119896eb None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:56.652933 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-13af2662-cc80-4f6b-9c7f-907b119896eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:56.770249 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece34142-5b1c-4997-84c5-944d14f81d72 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:56.770691 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 307/617] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:56.796804 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af2662-cc80-4f6b-9c7f-907b119896eb None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:56.805924 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153cf95b-374d-448f-85df-6530610febeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:56.806561 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153cf95b-374d-448f-85df-6530610febeb None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:56.806839 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153cf95b-374d-448f-85df-6530610febeb None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:56.807114 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153cf95b-374d-448f-85df-6530610febeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:56.817525 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153cf95b-374d-448f-85df-6530610febeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:56.818963 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153cf95b-374d-448f-85df-6530610febeb None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:56.833958 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-153cf95b-374d-448f-85df-6530610febeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:56.833958 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:56.833958 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:56.833958 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:56.833958 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:56.833958 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:56.833958 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:56.833958 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:56.833958 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:56.833958 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:56.833958 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:56.833958 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:56.833958 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:05:56.833958 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:05:56.833958 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:05:56.833958 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:05:56.834947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:56.834947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:56.834947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:56.834947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:56.834947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:56.834947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:56.834947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:56.834947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:56.834947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:56.834947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:56.834947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:56.834947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:56.834947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:56.834947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:56.834947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:56.834947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:56.834947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:05:56.835885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:05:56.835885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:56.835885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:56.835885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 311/618] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:05:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:56.841431 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153cf95b-374d-448f-85df-6530610febeb None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:56.868381 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:56.919179 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af2662-cc80-4f6b-9c7f-907b119896eb None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:56.963653 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e18dd-313c-4fb3-ace3-52f9eeaf3dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:56.964653 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e18dd-313c-4fb3-ace3-52f9eeaf3dcb None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:56.965145 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e18dd-313c-4fb3-ace3-52f9eeaf3dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:56.965619 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e18dd-313c-4fb3-ace3-52f9eeaf3dcb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:56.983381 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e18dd-313c-4fb3-ace3-52f9eeaf3dcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:56.986057 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-7d4e18dd-313c-4fb3-ace3-52f9eeaf3dcb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:05:56.986057 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:56.986057 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:56.986057 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:56.986057 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:56.986057 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:56.986057 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:56.986057 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:56.986057 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:56.986057 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:56.986057 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:56.986057 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:56.986057 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:56.986057 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:56.986057 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:56.986057 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:56.986953 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:56.986953 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:56.986953 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:56.986953 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:56.986953 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:56.986953 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:56.986953 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:56.986953 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:56.986953 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:56.986953 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:56.986953 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:56.986953 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:56.986953 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:56.986953 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:56.986953 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:56.986953 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:56.987817 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:56.987817 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:56.987817 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:56.987817 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:56.987817 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:56.987817 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:56.987817 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:56.987817 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:56.987817 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:56.987817 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:56.987817 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:05:56.987817 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:56.987817 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 308/619] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 02:05:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:05:56.994008 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e18dd-313c-4fb3-ace3-52f9eeaf3dcb None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:57.021702 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:57.100063 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153cf95b-374d-448f-85df-6530610febeb None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:57.120049 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e18dd-313c-4fb3-ace3-52f9eeaf3dcb None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:57.145818 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:57.146716 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ab809-4650-494b-a45a-3f5a5e4ceedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:57.147330 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ab809-4650-494b-a45a-3f5a5e4ceedd None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:57.147635 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ab809-4650-494b-a45a-3f5a5e4ceedd None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:57.147920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ab809-4650-494b-a45a-3f5a5e4ceedd None admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:57.148569 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ab809-4650-494b-a45a-3f5a5e4ceedd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:57.148906 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ab809-4650-494b-a45a-3f5a5e4ceedd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:57.150283 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ab809-4650-494b-a45a-3f5a5e4ceedd None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:57.175925 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 312/620] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:57.177825 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f71a3-aed8-46a0-9e64-c81eb78e3628 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:57.178116 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f71a3-aed8-46a0-9e64-c81eb78e3628 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:57.178392 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f71a3-aed8-46a0-9e64-c81eb78e3628 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:57.180747 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 313/621] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:57.181636 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f71a3-aed8-46a0-9e64-c81eb78e3628 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:57.193080 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b4f5f-bf6a-4e28-8af7-443016721d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:57.193683 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b4f5f-bf6a-4e28-8af7-443016721d22 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:57.193961 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b4f5f-bf6a-4e28-8af7-443016721d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:57.194336 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b4f5f-bf6a-4e28-8af7-443016721d22 None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:57.195005 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b4f5f-bf6a-4e28-8af7-443016721d22 None admin] RBAC: Adding query filter params (name=service) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:57.195307 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b4f5f-bf6a-4e28-8af7-443016721d22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:57.196853 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b4f5f-bf6a-4e28-8af7-443016721d22 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:57.210546 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 309/622] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 8 02:05:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:57.211899 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f427f54-4f49-4279-a58a-783293363374 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:57.212191 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f427f54-4f49-4279-a58a-783293363374 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:57.212470 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f427f54-4f49-4279-a58a-783293363374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:57.231368 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-4f427f54-4f49-4279-a58a-783293363374 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:57.232689 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-4f427f54-4f49-4279-a58a-783293363374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:57.311106 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f71a3-aed8-46a0-9e64-c81eb78e3628 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:57.314325 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 310/623] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:57.315217 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f427f54-4f49-4279-a58a-783293363374 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:57.374246 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9498221-67ea-4500-853f-e5032e617ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:57.374972 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9498221-67ea-4500-853f-e5032e617ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:57.375257 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9498221-67ea-4500-853f-e5032e617ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:57.377117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9498221-67ea-4500-853f-e5032e617ae1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:57.380563 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:57.388149 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9498221-67ea-4500-853f-e5032e617ae1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:57.388149 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9498221-67ea-4500-853f-e5032e617ae1 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:57.400055 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-c9498221-67ea-4500-853f-e5032e617ae1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:05:57.400055 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:57.400055 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:57.400055 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:57.400055 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:57.400055 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:57.400055 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:57.400055 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:57.400055 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:57.400055 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:57.400055 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:57.400055 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:57.400055 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:05:57.400055 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:05:57.400055 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:05:57.401014 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:05:57.401014 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:57.401014 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:57.401014 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:57.401014 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:57.401014 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:57.401014 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:57.401014 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:57.401014 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:57.401014 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:57.401014 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:57.401014 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:57.401014 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:57.401014 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:57.401014 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:57.401014 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:57.401014 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:57.401897 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:05:57.401897 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:05:57.401897 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:05:57.401897 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:05:57.401897 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:05:57.401897 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:05:57.401897 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:05:57.401897 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:57.405723 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 314/624] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:05:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:57.406597 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9498221-67ea-4500-853f-e5032e617ae1 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:57.420569 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f427f54-4f49-4279-a58a-783293363374 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:57.422989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:57.457001 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070b78b-8539-4cf8-b66f-8a3142ea8a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:57.457636 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070b78b-8539-4cf8-b66f-8a3142ea8a14 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:57.457916 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070b78b-8539-4cf8-b66f-8a3142ea8a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:57.458189 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070b78b-8539-4cf8-b66f-8a3142ea8a14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:57.469545 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b070b78b-8539-4cf8-b66f-8a3142ea8a14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:57.471003 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b070b78b-8539-4cf8-b66f-8a3142ea8a14 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:57.486037 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-b070b78b-8539-4cf8-b66f-8a3142ea8a14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:57.486037 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:57.486037 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:57.486037 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:57.486037 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:57.486037 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:57.486037 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:57.486037 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:57.486037 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:57.486037 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:57.486037 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:57.486037 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:57.486037 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:05:57.486037 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:05:57.486037 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:05:57.486037 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:05:57.489638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:57.489638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:57.489638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:57.489638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:57.489638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:57.489638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:57.489638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:57.489638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:57.489638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:57.489638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:57.489638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:57.489638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:57.489638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:57.489638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:57.489638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:57.489638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:57.489638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:05:57.493246 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:05:57.493246 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:57.493246 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:57.493246 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 311/625] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:05:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:57.493246 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070b78b-8539-4cf8-b66f-8a3142ea8a14 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:57.535526 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9498221-67ea-4500-853f-e5032e617ae1 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:57.572832 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5149cd-4b34-49c4-8bbc-b34bff4554a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:57.573558 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5149cd-4b34-49c4-8bbc-b34bff4554a2 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:57.573844 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5149cd-4b34-49c4-8bbc-b34bff4554a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:57.574118 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5149cd-4b34-49c4-8bbc-b34bff4554a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:57.585223 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5149cd-4b34-49c4-8bbc-b34bff4554a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:57.590820 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-ac5149cd-4b34-49c4-8bbc-b34bff4554a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:05:57.590820 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:57.590820 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:57.590820 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:57.590820 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:57.590820 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:57.590820 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:57.590820 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:57.590820 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:57.590820 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:57.590820 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:57.590820 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:57.590820 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:57.590820 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:57.590820 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:57.590820 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:57.593026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:57.593026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:57.593026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:57.593026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:57.593026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:57.593026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:57.593026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:57.593026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:57.593026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:57.593026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:57.593026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:57.593026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:57.593026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:57.593026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:57.593026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:57.593026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:57.595151 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:57.595151 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:57.595151 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:57.595151 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:57.595151 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:57.595151 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:57.595151 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:57.595151 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:57.595151 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:57.595151 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:57.595151 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:05:57.595151 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:57.596726 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070b78b-8539-4cf8-b66f-8a3142ea8a14 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:57.603378 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 315/626] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 02:05:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:57.603378 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5149cd-4b34-49c4-8bbc-b34bff4554a2 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:57.629831 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c886b6-5eff-4844-9a32-b43ee86c3ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:57.630364 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c886b6-5eff-4844-9a32-b43ee86c3ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:57.630646 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c886b6-5eff-4844-9a32-b43ee86c3ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:57.630921 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c886b6-5eff-4844-9a32-b43ee86c3ef1 None admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:57.631632 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c886b6-5eff-4844-9a32-b43ee86c3ef1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:57.631927 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c886b6-5eff-4844-9a32-b43ee86c3ef1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:57.633886 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c886b6-5eff-4844-9a32-b43ee86c3ef1 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:57.650853 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 312/627] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 02:05:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:57.651747 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c886b6-5eff-4844-9a32-b43ee86c3ef1 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:57.657793 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:57.669695 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:57.713632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5149cd-4b34-49c4-8bbc-b34bff4554a2 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:57.755764 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa9a00-577d-4b8c-80b9-0f9360521b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:57.756660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa9a00-577d-4b8c-80b9-0f9360521b27 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:57.756946 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa9a00-577d-4b8c-80b9-0f9360521b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:57.757221 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa9a00-577d-4b8c-80b9-0f9360521b27 None admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:57.757873 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa9a00-577d-4b8c-80b9-0f9360521b27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:57.758207 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa9a00-577d-4b8c-80b9-0f9360521b27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:57.759923 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa9a00-577d-4b8c-80b9-0f9360521b27 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:57.774683 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c886b6-5eff-4844-9a32-b43ee86c3ef1 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:57.780233 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 316/628] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:57.780233 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa9a00-577d-4b8c-80b9-0f9360521b27 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:57.817087 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c0a99-c095-4b5b-b29a-4aeb7691630b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:57.817627 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c0a99-c095-4b5b-b29a-4aeb7691630b None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:57.817909 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c0a99-c095-4b5b-b29a-4aeb7691630b None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:57.818183 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c0a99-c095-4b5b-b29a-4aeb7691630b None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:57.818847 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2c0a99-c095-4b5b-b29a-4aeb7691630b None admin] RBAC: Adding query filter params (name=service) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:57.819148 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2c0a99-c095-4b5b-b29a-4aeb7691630b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:57.820567 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2c0a99-c095-4b5b-b29a-4aeb7691630b None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:57.834259 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 313/629] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 8 02:05:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:57.834259 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c0a99-c095-4b5b-b29a-4aeb7691630b None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:57.895469 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa9a00-577d-4b8c-80b9-0f9360521b27 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:57.911267 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:57.918327 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:57.934467 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a3023-29ac-479b-99d1-48b7a2a65e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:57.935531 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a3023-29ac-479b-99d1-48b7a2a65e3f None admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:57.936013 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a3023-29ac-479b-99d1-48b7a2a65e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:57.936513 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a3023-29ac-479b-99d1-48b7a2a65e3f None admin] PATH_INFO: `/v3/projects/ebe178f5bce64a009bf690031676c89f/users/6c212009b6a44e1bad92769630116408/roles/071080f2ecc948319b313f2379ea2b97` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:57.940673 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c0a99-c095-4b5b-b29a-4aeb7691630b None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:57.952777 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a3023-29ac-479b-99d1-48b7a2a65e3f None admin] RBAC: Authorizing `identity:create_grant(project_id=ebe178f5bce64a009bf690031676c89f, user_id=6c212009b6a44e1bad92769630116408, role_id=071080f2ecc948319b313f2379ea2b97)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:57.954668 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a3023-29ac-479b-99d1-48b7a2a65e3f None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:57.978190 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11352557-4e24-4058-8a91-ffac82ba9999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:57.978871 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11352557-4e24-4058-8a91-ffac82ba9999 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:57.979155 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11352557-4e24-4058-8a91-ffac82ba9999 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:57.979459 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11352557-4e24-4058-8a91-ffac82ba9999 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:57.987405 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11352557-4e24-4058-8a91-ffac82ba9999 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:57.988892 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11352557-4e24-4058-8a91-ffac82ba9999 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:58.000714 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-11352557-4e24-4058-8a91-ffac82ba9999 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 02:05:58.000714 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:58.000714 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:58.000714 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:58.000714 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:58.000714 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:58.000714 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:58.000714 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:58.000714 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:58.000714 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:58.000714 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:58.000714 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:58.000714 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:05:58.000714 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:05:58.000714 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:05:58.000714 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:05:58.001673 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:58.001673 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:58.001673 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:05:58.001673 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:05:58.001673 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:05:58.001673 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:05:58.001673 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:58.001673 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:58.001673 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:58.001673 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:58.001673 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:58.001673 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:58.001673 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:58.001673 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:58.001673 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:58.001673 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:58.001673 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:58.001673 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:58.002603 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:58.002603 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:58.002603 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:05:58.002603 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:05:58.002603 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:05:58.002603 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:05:58.002603 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:05:58.002603 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:05:58.002603 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 02:05:58.002603 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:58.002603 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 314/630] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:05:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:58.002603 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11352557-4e24-4058-8a91-ffac82ba9999 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:58.047664 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 317/631] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 02:05:57 2022] PUT /identity/v3/projects/ebe178f5bce64a009bf690031676c89f/users/6c212009b6a44e1bad92769630116408/roles/071080f2ecc948319b313f2379ea2b97 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:05:58.048948 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a3023-29ac-479b-99d1-48b7a2a65e3f None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:58.187833 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11352557-4e24-4058-8a91-ffac82ba9999 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:58.251278 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a3023-29ac-479b-99d1-48b7a2a65e3f None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:58.257160 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d4ad6-441b-4a72-9d8b-250589c5e797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:58.257803 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d4ad6-441b-4a72-9d8b-250589c5e797 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:58.258085 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d4ad6-441b-4a72-9d8b-250589c5e797 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:58.258422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d4ad6-441b-4a72-9d8b-250589c5e797 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:58.268230 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:58.273658 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d4ad6-441b-4a72-9d8b-250589c5e797 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:58.276039 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d4ad6-441b-4a72-9d8b-250589c5e797 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:58.294856 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe9b1ed-7b8e-4214-81ed-9c421e4188b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:58.295590 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-8e7d4ad6-441b-4a72-9d8b-250589c5e797 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:58.295590 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:58.295590 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:58.295590 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:58.295590 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:58.295590 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:58.295590 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:58.295590 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:58.295590 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:58.295590 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:58.295590 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:58.295590 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:58.295590 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:05:58.295590 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:05:58.295590 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:05:58.295590 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:05:58.296686 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:58.296686 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:58.296686 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:58.296686 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:58.296686 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:58.296686 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:58.296686 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:58.296686 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:58.296686 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:58.296686 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:58.296686 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:58.296686 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:58.296686 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:58.296686 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:58.296686 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:58.296686 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:58.296686 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:05:58.297707 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:05:58.297707 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:58.297707 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:58.297707 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 315/632] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:05:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:58.298308 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9b1ed-7b8e-4214-81ed-9c421e4188b9 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:58.298775 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9b1ed-7b8e-4214-81ed-9c421e4188b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:58.299218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9b1ed-7b8e-4214-81ed-9c421e4188b9 None admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:58.300828 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe9b1ed-7b8e-4214-81ed-9c421e4188b9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:58.301322 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe9b1ed-7b8e-4214-81ed-9c421e4188b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:58.302831 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d4ad6-441b-4a72-9d8b-250589c5e797 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:58.303166 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe9b1ed-7b8e-4214-81ed-9c421e4188b9 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:58.330046 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 318/633] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Aug 8 02:05:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:58.331282 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54501314-dabd-41e1-b86f-fec844148095 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:58.331616 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54501314-dabd-41e1-b86f-fec844148095 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:58.331889 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54501314-dabd-41e1-b86f-fec844148095 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:58.333425 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 319/634] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:58.337527 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54501314-dabd-41e1-b86f-fec844148095 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:58.370459 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:58.429839 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d4ad6-441b-4a72-9d8b-250589c5e797 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:58.466735 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106e5f7-7a47-4e1b-893d-db3ecde32714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:58.467600 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106e5f7-7a47-4e1b-893d-db3ecde32714 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:58.468135 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106e5f7-7a47-4e1b-893d-db3ecde32714 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:58.468479 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106e5f7-7a47-4e1b-893d-db3ecde32714 None admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:58.469256 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106e5f7-7a47-4e1b-893d-db3ecde32714 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:58.469661 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106e5f7-7a47-4e1b-893d-db3ecde32714 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:58.471398 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106e5f7-7a47-4e1b-893d-db3ecde32714 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:58.475395 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54501314-dabd-41e1-b86f-fec844148095 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:58.490392 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 316/635] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:58.491990 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44eaaaa-e9d9-4ae7-9c3e-b963af9fb0bb None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:58.492375 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44eaaaa-e9d9-4ae7-9c3e-b963af9fb0bb None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:58.493315 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44eaaaa-e9d9-4ae7-9c3e-b963af9fb0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:58.512410 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-e44eaaaa-e9d9-4ae7-9c3e-b963af9fb0bb None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:58.513827 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d548e5-8090-4f96-90e6-93751d543893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:58.513966 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-e44eaaaa-e9d9-4ae7-9c3e-b963af9fb0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:58.514444 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d548e5-8090-4f96-90e6-93751d543893 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:58.514723 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d548e5-8090-4f96-90e6-93751d543893 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:58.514995 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d548e5-8090-4f96-90e6-93751d543893 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:58.564956 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:58.588968 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 317/636] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:58.590197 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44eaaaa-e9d9-4ae7-9c3e-b963af9fb0bb None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:58.612365 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d548e5-8090-4f96-90e6-93751d543893 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:58.614156 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d548e5-8090-4f96-90e6-93751d543893 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:58.641013 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:58.724655 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44eaaaa-e9d9-4ae7-9c3e-b963af9fb0bb None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:58.739437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 320/637] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:05:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:05:58.740421 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d548e5-8090-4f96-90e6-93751d543893 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:58.765743 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897b645-5d8f-473e-984a-a3309918aa06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:58.766763 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897b645-5d8f-473e-984a-a3309918aa06 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:58.767448 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897b645-5d8f-473e-984a-a3309918aa06 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:58.768226 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897b645-5d8f-473e-984a-a3309918aa06 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:58.779022 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9897b645-5d8f-473e-984a-a3309918aa06 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:58.780665 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9897b645-5d8f-473e-984a-a3309918aa06 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:58.795977 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-9897b645-5d8f-473e-984a-a3309918aa06 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:05:58.795977 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:58.795977 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:58.795977 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:58.795977 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:58.795977 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:58.795977 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:58.795977 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:58.795977 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:58.795977 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:58.795977 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:58.795977 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:58.795977 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:05:58.795977 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:05:58.795977 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:05:58.795977 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:05:58.796989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:58.796989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:58.796989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:05:58.796989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:05:58.796989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:05:58.796989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:05:58.796989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:58.796989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:58.796989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:58.796989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:58.796989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:58.796989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:58.796989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:58.796989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:58.796989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:58.796989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:58.796989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:58.796989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:58.797919 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:58.797919 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:58.797919 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:05:58.797919 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:05:58.797919 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:05:58.797919 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:05:58.797919 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:05:58.797919 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:05:58.797919 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:05:58.797919 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:58.797919 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 318/638] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Aug 8 02:05:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:58.798998 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897b645-5d8f-473e-984a-a3309918aa06 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:58.848553 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:58.850905 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d548e5-8090-4f96-90e6-93751d543893 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:58.878621 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:58.890808 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016d17f-fd68-4a87-82a8-d035cd4fe062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:58.891613 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016d17f-fd68-4a87-82a8-d035cd4fe062 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:58.891992 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016d17f-fd68-4a87-82a8-d035cd4fe062 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:58.892277 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016d17f-fd68-4a87-82a8-d035cd4fe062 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:58.903161 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7016d17f-fd68-4a87-82a8-d035cd4fe062 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:58.907933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-7016d17f-fd68-4a87-82a8-d035cd4fe062 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:05:58.907933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:58.907933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:58.907933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:58.907933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:58.907933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:58.907933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:58.907933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:58.907933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:58.907933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:58.907933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:58.907933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:58.907933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:58.907933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:58.907933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:58.907933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:58.909035 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:58.909035 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:58.909035 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:58.909035 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:58.909035 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:58.909035 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:58.909035 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:58.909035 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:58.909035 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:58.909035 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:58.909035 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:58.909035 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:58.909035 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:58.909035 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:58.909035 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:58.909035 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:58.910110 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:58.910110 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:58.910110 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:58.910110 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:58.910110 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:58.910110 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:58.910110 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:58.910110 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:58.910110 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:58.910110 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:58.910110 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:05:58.910110 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:58.910847 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897b645-5d8f-473e-984a-a3309918aa06 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:58.918151 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 321/639] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 02:05:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:58.918151 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3f142-7738-4cbd-a216-fdeb9e2432f6 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:58.918151 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3f142-7738-4cbd-a216-fdeb9e2432f6 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:58.918151 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3f142-7738-4cbd-a216-fdeb9e2432f6 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:58.918151 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 322/640] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:05:58.918151 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3f142-7738-4cbd-a216-fdeb9e2432f6 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:58.949855 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc19466-7691-4a60-9321-32006f565f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:58.950701 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc19466-7691-4a60-9321-32006f565f2a None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:58.950881 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc19466-7691-4a60-9321-32006f565f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:58.951122 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc19466-7691-4a60-9321-32006f565f2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:58.964581 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc19466-7691-4a60-9321-32006f565f2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:58.966433 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc19466-7691-4a60-9321-32006f565f2a None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:58.980810 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-5dc19466-7691-4a60-9321-32006f565f2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:58.980810 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:58.980810 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:58.980810 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:58.980810 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:58.980810 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:58.980810 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:58.980810 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:58.980810 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:58.980810 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:58.980810 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:58.980810 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:58.980810 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:05:58.980810 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:05:58.980810 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:05:58.980810 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:05:58.981947 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:58.981947 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:58.981947 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:58.981947 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:58.981947 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:58.981947 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:58.981947 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:58.981947 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:58.981947 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:58.981947 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:58.981947 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:58.981947 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:58.981947 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:58.981947 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:58.981947 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:58.981947 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:58.981947 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:05:58.982998 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:05:58.982998 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:58.982998 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:58.986443 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 319/641] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:05:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:58.987270 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc19466-7691-4a60-9321-32006f565f2a None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:59.031014 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3f142-7738-4cbd-a216-fdeb9e2432f6 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:59.066661 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a3fd4-d6c2-44f5-850e-360a188aefbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:59.067835 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a3fd4-d6c2-44f5-850e-360a188aefbb None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:59.068401 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a3fd4-d6c2-44f5-850e-360a188aefbb None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:59.068819 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a3fd4-d6c2-44f5-850e-360a188aefbb None admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:59.069766 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a3fd4-d6c2-44f5-850e-360a188aefbb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:59.070216 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a3fd4-d6c2-44f5-850e-360a188aefbb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:59.071891 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a3fd4-d6c2-44f5-850e-360a188aefbb None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:59.079703 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:59.089636 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc19466-7691-4a60-9321-32006f565f2a None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:59.092375 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 323/642] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Aug 8 02:05:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:59.097832 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4a7ac-2197-4fcc-a0fe-b83481122d52 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:59.098126 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4a7ac-2197-4fcc-a0fe-b83481122d52 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:59.098405 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4a7ac-2197-4fcc-a0fe-b83481122d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:59.115669 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-e9b4a7ac-2197-4fcc-a0fe-b83481122d52 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:05:59.116871 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-e9b4a7ac-2197-4fcc-a0fe-b83481122d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:05:59.125574 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17255f41-f1ea-4dcf-b2ec-e83309d6bcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:59.126176 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17255f41-f1ea-4dcf-b2ec-e83309d6bcce None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:59.126457 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17255f41-f1ea-4dcf-b2ec-e83309d6bcce None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:59.126726 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17255f41-f1ea-4dcf-b2ec-e83309d6bcce None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:59.127415 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17255f41-f1ea-4dcf-b2ec-e83309d6bcce None admin] RBAC: Adding query filter params (name=service) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:59.127722 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17255f41-f1ea-4dcf-b2ec-e83309d6bcce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:59.129191 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17255f41-f1ea-4dcf-b2ec-e83309d6bcce None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:59.138119 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 320/643] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 8 02:05:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:59.143200 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17255f41-f1ea-4dcf-b2ec-e83309d6bcce None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:59.155102 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:59.189225 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 324/644] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:05:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:05:59.190352 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4a7ac-2197-4fcc-a0fe-b83481122d52 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:59.263459 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17255f41-f1ea-4dcf-b2ec-e83309d6bcce None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:59.300598 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4a7ac-2197-4fcc-a0fe-b83481122d52 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:59.302232 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34a09d-d883-4055-a778-e611634429f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:59.303565 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34a09d-d883-4055-a778-e611634429f5 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:59.303870 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34a09d-d883-4055-a778-e611634429f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:59.304151 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34a09d-d883-4055-a778-e611634429f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:59.304807 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be34a09d-d883-4055-a778-e611634429f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:59.305208 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be34a09d-d883-4055-a778-e611634429f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:59.306952 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be34a09d-d883-4055-a778-e611634429f5 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:59.320044 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 321/645] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:59.321458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34a09d-d883-4055-a778-e611634429f5 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:59.338633 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:59.345120 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c2cf1-5ef1-4397-a51e-dc28ed0d14d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:59.351749 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c2cf1-5ef1-4397-a51e-dc28ed0d14d6 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:59.351749 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c2cf1-5ef1-4397-a51e-dc28ed0d14d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:59.351749 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c2cf1-5ef1-4397-a51e-dc28ed0d14d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:59.394270 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:59.425327 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c2cf1-5ef1-4397-a51e-dc28ed0d14d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:59.427833 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c2cf1-5ef1-4397-a51e-dc28ed0d14d6 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:59.433656 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34a09d-d883-4055-a778-e611634429f5 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:59.478054 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd09578-a639-49ff-8d2d-a3d12ec8ac58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:59.478677 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd09578-a639-49ff-8d2d-a3d12ec8ac58 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:59.478964 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd09578-a639-49ff-8d2d-a3d12ec8ac58 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:59.479241 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd09578-a639-49ff-8d2d-a3d12ec8ac58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:59.490552 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd09578-a639-49ff-8d2d-a3d12ec8ac58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:59.492035 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd09578-a639-49ff-8d2d-a3d12ec8ac58 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:59.506459 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-dbd09578-a639-49ff-8d2d-a3d12ec8ac58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:59.506459 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:59.506459 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:59.506459 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:59.506459 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:59.506459 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:59.506459 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:59.506459 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:59.506459 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:59.506459 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:59.506459 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:59.506459 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:59.506459 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:05:59.506459 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:05:59.506459 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:05:59.506459 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:05:59.512607 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:59.512607 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:59.512607 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:59.512607 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:59.512607 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:59.512607 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:59.512607 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:59.512607 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:59.512607 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:59.512607 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:59.512607 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:59.512607 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:59.512607 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:59.512607 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:59.512607 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:59.512607 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:59.512607 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:05:59.513947 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:05:59.513947 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:59.513947 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:59.513947 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 322/646] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:05:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:59.513947 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd09578-a639-49ff-8d2d-a3d12ec8ac58 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:59.543693 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 325/647] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:05:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:05:59.544496 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c2cf1-5ef1-4397-a51e-dc28ed0d14d6 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:59.582862 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:59.619024 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd09578-a639-49ff-8d2d-a3d12ec8ac58 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:59.619552 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:59.653078 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c2cf1-5ef1-4397-a51e-dc28ed0d14d6 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:59.654795 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0fd20-a9db-47af-830e-f5b7f1c1d03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:59.656231 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0fd20-a9db-47af-830e-f5b7f1c1d03e None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:59.656535 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0fd20-a9db-47af-830e-f5b7f1c1d03e None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:59.656817 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0fd20-a9db-47af-830e-f5b7f1c1d03e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:59.669024 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0fd20-a9db-47af-830e-f5b7f1c1d03e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:05:59.674574 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-93f0fd20-a9db-47af-830e-f5b7f1c1d03e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:05:59.674574 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:59.674574 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:59.674574 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:59.674574 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:59.674574 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:59.674574 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:59.674574 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:59.674574 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:59.674574 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:59.674574 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:59.674574 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:59.674574 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:05:59.674574 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:05:59.674574 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:05:59.674574 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:05:59.675507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:05:59.675507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:05:59.675507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:05:59.675507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:05:59.675507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:59.675507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:59.675507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:59.675507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:59.675507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:59.675507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:59.675507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:59.675507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:59.675507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:59.675507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:59.675507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:59.675507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:59.676354 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:59.676354 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:59.676354 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:59.676354 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:59.676354 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:05:59.676354 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:05:59.676354 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:05:59.676354 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:05:59.676354 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:05:59.676354 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:05:59.676354 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:05:59.676354 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:05:59.676354 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 323/648] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 02:05:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:59.677046 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0fd20-a9db-47af-830e-f5b7f1c1d03e None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:59.691689 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e60268-9fcd-415f-a216-5fb8073b43a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:59.692320 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e60268-9fcd-415f-a216-5fb8073b43a1 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:59.692608 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e60268-9fcd-415f-a216-5fb8073b43a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:59.692885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e60268-9fcd-415f-a216-5fb8073b43a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:59.700081 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e60268-9fcd-415f-a216-5fb8073b43a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:59.701540 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e60268-9fcd-415f-a216-5fb8073b43a1 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:59.712721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-39e60268-9fcd-415f-a216-5fb8073b43a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:05:59.712721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:59.712721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:59.712721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:59.712721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:59.712721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:59.712721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:59.712721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:59.712721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:59.712721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:59.712721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:59.712721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:59.712721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:05:59.712721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:05:59.712721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:05:59.713771 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:05:59.713771 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:59.713771 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:59.713771 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:59.713771 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:59.713771 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:59.713771 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:59.713771 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:59.713771 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:59.713771 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:59.713771 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:59.713771 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:59.713771 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:59.713771 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:59.713771 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:59.713771 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:59.713771 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:59.714830 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:05:59.714830 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:05:59.714830 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:05:59.714830 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:05:59.714830 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:05:59.714830 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:05:59.714830 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:05:59.714830 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:59.714830 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 326/649] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:05:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:59.714830 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e60268-9fcd-415f-a216-5fb8073b43a1 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:59.785475 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0fd20-a9db-47af-830e-f5b7f1c1d03e None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:59.812224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:59.821152 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec2af8-bba2-4c06-b6dd-078c04f839cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:59.826515 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e60268-9fcd-415f-a216-5fb8073b43a1 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:59.826634 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec2af8-bba2-4c06-b6dd-078c04f839cb None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:59.826634 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec2af8-bba2-4c06-b6dd-078c04f839cb None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:59.826634 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec2af8-bba2-4c06-b6dd-078c04f839cb None admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:59.826634 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec2af8-bba2-4c06-b6dd-078c04f839cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:59.826634 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec2af8-bba2-4c06-b6dd-078c04f839cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:59.826634 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec2af8-bba2-4c06-b6dd-078c04f839cb None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:59.841650 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 324/650] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:59.841650 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec2af8-bba2-4c06-b6dd-078c04f839cb None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:59.855578 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:05:59.861514 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c897b4d-8ee9-4bec-aea2-ce4948bc4dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:59.862411 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c897b4d-8ee9-4bec-aea2-ce4948bc4dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:59.862692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c897b4d-8ee9-4bec-aea2-ce4948bc4dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:59.862974 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c897b4d-8ee9-4bec-aea2-ce4948bc4dd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:59.874817 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c897b4d-8ee9-4bec-aea2-ce4948bc4dd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:59.877066 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c897b4d-8ee9-4bec-aea2-ce4948bc4dd0 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:59.892577 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-9c897b4d-8ee9-4bec-aea2-ce4948bc4dd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:59.892577 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:05:59.892577 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:05:59.892577 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:05:59.892577 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:05:59.892577 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:05:59.892577 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:05:59.892577 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:05:59.892577 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:05:59.892577 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:05:59.892577 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:05:59.892577 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:05:59.892577 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:05:59.892577 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:05:59.892577 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:05:59.892577 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:05:59.893740 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:05:59.893740 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:05:59.893740 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:05:59.893740 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:05:59.893740 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:05:59.893740 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:05:59.893740 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:05:59.893740 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:05:59.893740 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:05:59.893740 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:05:59.893740 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:05:59.893740 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:05:59.893740 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:05:59.893740 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:05:59.893740 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:05:59.893740 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:05:59.893740 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:05:59.894624 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:05:59.894624 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:05:59.894624 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:05:59.898642 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 327/651] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:05:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:05:59.899674 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c897b4d-8ee9-4bec-aea2-ce4948bc4dd0 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:05:59.947210 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec2af8-bba2-4c06-b6dd-078c04f839cb None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:05:59.981147 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe21b8c-41c4-4b89-b0b6-b12f6581d87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:05:59.981750 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe21b8c-41c4-4b89-b0b6-b12f6581d87d None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:05:59.982030 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe21b8c-41c4-4b89-b0b6-b12f6581d87d None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:05:59.982301 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe21b8c-41c4-4b89-b0b6-b12f6581d87d None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:05:59.982958 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe21b8c-41c4-4b89-b0b6-b12f6581d87d None admin] RBAC: Adding query filter params (name=service) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:05:59.983262 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe21b8c-41c4-4b89-b0b6-b12f6581d87d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:05:59.984665 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe21b8c-41c4-4b89-b0b6-b12f6581d87d None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:05:59.993557 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 325/652] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 8 02:05:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:05:59.994330 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe21b8c-41c4-4b89-b0b6-b12f6581d87d None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:00.010560 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c897b4d-8ee9-4bec-aea2-ce4948bc4dd0 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:00.047614 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823bd429-3534-405a-bb35-70d5b4b8942c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:00.048148 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823bd429-3534-405a-bb35-70d5b4b8942c None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:00.048429 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823bd429-3534-405a-bb35-70d5b4b8942c None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:00.048706 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823bd429-3534-405a-bb35-70d5b4b8942c None admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:00.049391 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823bd429-3534-405a-bb35-70d5b4b8942c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:00.049697 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823bd429-3534-405a-bb35-70d5b4b8942c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:00.051112 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823bd429-3534-405a-bb35-70d5b4b8942c None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:00.051731 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:00.068841 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 328/653] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 02:05:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:00.068841 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823bd429-3534-405a-bb35-70d5b4b8942c None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:00.111567 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:00.112867 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe21b8c-41c4-4b89-b0b6-b12f6581d87d None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:00.150572 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed251557-4e12-47ae-87f3-372753be64dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:00.151208 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed251557-4e12-47ae-87f3-372753be64dd None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:00.151566 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed251557-4e12-47ae-87f3-372753be64dd None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:00.151795 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed251557-4e12-47ae-87f3-372753be64dd None admin] PATH_INFO: `/v3/users/glance` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:00.159681 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed251557-4e12-47ae-87f3-372753be64dd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:00.161123 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed251557-4e12-47ae-87f3-372753be64dd None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:00.172359 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-ed251557-4e12-47ae-87f3-372753be64dd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 08 02:06:00.172359 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:00.172359 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:00.172359 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:00.172359 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:00.172359 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:00.172359 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:00.172359 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:00.172359 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:00.172359 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:00.172359 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:00.172359 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:00.172359 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:06:00.172359 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:06:00.172359 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:06:00.172359 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:06:00.173438 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:00.173438 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:00.173438 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:06:00.173438 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:00.173438 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:06:00.173438 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:00.173438 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:00.173438 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:00.173438 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:00.173438 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:00.173438 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:00.173438 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:00.173438 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:00.173438 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:00.173438 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:00.173438 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:00.173438 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:00.173438 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:00.174364 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:00.174364 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:00.174364 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:06:00.174364 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:06:00.174364 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:06:00.174364 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:06:00.174364 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:06:00.174364 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:06:00.174364 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 08 02:06:00.174364 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:00.174364 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 326/654] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:05:59 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:00.174364 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed251557-4e12-47ae-87f3-372753be64dd None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:00.183923 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823bd429-3534-405a-bb35-70d5b4b8942c None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:00.218302 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91779882-fa7f-44fa-b47c-f8b711c821e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:00.218908 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91779882-fa7f-44fa-b47c-f8b711c821e9 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:00.219190 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91779882-fa7f-44fa-b47c-f8b711c821e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:00.219499 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91779882-fa7f-44fa-b47c-f8b711c821e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:00.220140 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91779882-fa7f-44fa-b47c-f8b711c821e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:00.220452 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91779882-fa7f-44fa-b47c-f8b711c821e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:00.221804 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91779882-fa7f-44fa-b47c-f8b711c821e9 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:00.233150 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 329/655] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:00.233929 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91779882-fa7f-44fa-b47c-f8b711c821e9 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:00.273404 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed251557-4e12-47ae-87f3-372753be64dd None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:00.282031 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:00.306886 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd58db3-4dee-4005-9604-eff08f903cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:00.307465 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd58db3-4dee-4005-9604-eff08f903cbf None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:00.307751 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd58db3-4dee-4005-9604-eff08f903cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:00.308029 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd58db3-4dee-4005-9604-eff08f903cbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:00.318806 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd58db3-4dee-4005-9604-eff08f903cbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:00.320295 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd58db3-4dee-4005-9604-eff08f903cbf None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:00.333305 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91779882-fa7f-44fa-b47c-f8b711c821e9 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:00.334801 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:00.335009 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-bfd58db3-4dee-4005-9604-eff08f903cbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:00.335009 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:00.335009 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:00.335009 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:00.335009 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:00.335009 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:00.335009 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:00.335009 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:00.335009 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:00.335009 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:00.335009 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:00.335009 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:00.335009 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:00.335009 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:00.335009 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:00.335009 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:00.336112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:00.336112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:00.336112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:00.336112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:00.336112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:00.336112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:00.336112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:00.336112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:00.336112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:00.336112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:00.336112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:00.336112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:00.336112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:00.336112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:00.336112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:00.336112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:00.336112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:00.337165 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:00.337165 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:00.337165 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:00.337165 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 327/656] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:00.337480 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd58db3-4dee-4005-9604-eff08f903cbf None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:00.368466 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201969a5-4101-4e5b-af0e-3faf2447594b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:00.369071 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201969a5-4101-4e5b-af0e-3faf2447594b None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:00.369356 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201969a5-4101-4e5b-af0e-3faf2447594b None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:00.369633 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201969a5-4101-4e5b-af0e-3faf2447594b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:00.370354 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201969a5-4101-4e5b-af0e-3faf2447594b None admin] RBAC: Adding query filter params (role.id=071080f2ecc948319b313f2379ea2b97, scope.project.id=ebe178f5bce64a009bf690031676c89f, user.id=c63640b6bedd4e64b16657a34eb40f3b) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:00.370664 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201969a5-4101-4e5b-af0e-3faf2447594b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:00.372112 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201969a5-4101-4e5b-af0e-3faf2447594b None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:00.380707 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 330/657] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:06:00 2022] GET /identity/v3/role_assignments?user.id=c63640b6bedd4e64b16657a34eb40f3b&scope.project.id=ebe178f5bce64a009bf690031676c89f&role.id=071080f2ecc948319b313f2379ea2b97 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:00.380707 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a4b2e-606d-43ff-824d-72221fea0db1 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:00.380707 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a4b2e-606d-43ff-824d-72221fea0db1 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:00.380707 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a4b2e-606d-43ff-824d-72221fea0db1 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:00.381075 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 331/658] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:00.381836 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a4b2e-606d-43ff-824d-72221fea0db1 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:00.462096 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd58db3-4dee-4005-9604-eff08f903cbf None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:00.496048 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a4b2e-606d-43ff-824d-72221fea0db1 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:00.499558 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5643f-f5c2-4ac1-9377-f4c64ec14ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:00.500173 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5643f-f5c2-4ac1-9377-f4c64ec14ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:00.500455 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5643f-f5c2-4ac1-9377-f4c64ec14ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:00.500733 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5643f-f5c2-4ac1-9377-f4c64ec14ef7 None admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:00.501471 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a5643f-f5c2-4ac1-9377-f4c64ec14ef7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:00.501779 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a5643f-f5c2-4ac1-9377-f4c64ec14ef7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:00.503225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a5643f-f5c2-4ac1-9377-f4c64ec14ef7 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:00.522843 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 328/659] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Aug 8 02:06:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:00.523720 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5643f-f5c2-4ac1-9377-f4c64ec14ef7 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:00.543157 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fdb495-dcec-4ad3-a16f-d1a90fcbe1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:00.544067 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fdb495-dcec-4ad3-a16f-d1a90fcbe1b2 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:00.544610 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fdb495-dcec-4ad3-a16f-d1a90fcbe1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:00.544610 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fdb495-dcec-4ad3-a16f-d1a90fcbe1b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:00.548442 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:00.552851 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fdb495-dcec-4ad3-a16f-d1a90fcbe1b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:00.554311 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fdb495-dcec-4ad3-a16f-d1a90fcbe1b2 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:00.647056 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5643f-f5c2-4ac1-9377-f4c64ec14ef7 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:00.684729 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09f3b7-e8d7-4e5c-bd9a-1c3628780cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:00.685338 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09f3b7-e8d7-4e5c-bd9a-1c3628780cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:00.685615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09f3b7-e8d7-4e5c-bd9a-1c3628780cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:00.685887 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09f3b7-e8d7-4e5c-bd9a-1c3628780cc2 None admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:00.686529 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd09f3b7-e8d7-4e5c-bd9a-1c3628780cc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:00.686830 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd09f3b7-e8d7-4e5c-bd9a-1c3628780cc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:00.688234 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd09f3b7-e8d7-4e5c-bd9a-1c3628780cc2 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:00.689205 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-f2fdb495-dcec-4ad3-a16f-d1a90fcbe1b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:00.689205 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:00.689205 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:00.689205 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:00.689205 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:00.689205 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:00.689205 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:00.689205 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:00.689205 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:00.689205 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:00.689205 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:00.689205 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:00.689205 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:06:00.689205 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:06:00.689205 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:06:00.690183 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:06:00.690183 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:00.690183 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:00.690183 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:00.690183 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:00.690183 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:00.690183 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:00.690183 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:00.690183 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:00.690183 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:00.690183 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:00.690183 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:00.690183 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:00.690183 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:00.690183 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:00.690183 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:00.690183 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:00.691089 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:06:00.691089 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:06:00.691089 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:06:00.691089 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:06:00.691089 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:06:00.691089 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:06:00.691089 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:00.691089 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:00.691089 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 332/660] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:06:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:00.691869 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9bdf2-9b7f-48ff-aa0c-929486e039b6 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:00.692063 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9bdf2-9b7f-48ff-aa0c-929486e039b6 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:00.692335 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9bdf2-9b7f-48ff-aa0c-929486e039b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:00.706131 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 329/661] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:00.707342 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09f3b7-e8d7-4e5c-bd9a-1c3628780cc2 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:00.711477 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-b9d9bdf2-9b7f-48ff-aa0c-929486e039b6 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:00.712662 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-b9d9bdf2-9b7f-48ff-aa0c-929486e039b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:00.734270 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:00.795831 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 333/662] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:06:00.795831 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9bdf2-9b7f-48ff-aa0c-929486e039b6 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:00.799535 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:00.826218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09f3b7-e8d7-4e5c-bd9a-1c3628780cc2 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:00.862125 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84d3f9-572c-4e7b-aa4e-48f0c825f861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:00.862729 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84d3f9-572c-4e7b-aa4e-48f0c825f861 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:00.863022 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84d3f9-572c-4e7b-aa4e-48f0c825f861 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:00.863283 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84d3f9-572c-4e7b-aa4e-48f0c825f861 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:00.903403 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9bdf2-9b7f-48ff-aa0c-929486e039b6 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:00.933856 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f84d3f9-572c-4e7b-aa4e-48f0c825f861 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:00.935289 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f84d3f9-572c-4e7b-aa4e-48f0c825f861 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:00.937449 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51eb8e-0668-4c82-93d8-023d4ab7084c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:00.938158 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51eb8e-0668-4c82-93d8-023d4ab7084c None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:00.938442 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51eb8e-0668-4c82-93d8-023d4ab7084c None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:00.938722 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51eb8e-0668-4c82-93d8-023d4ab7084c None admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:00.939437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc51eb8e-0668-4c82-93d8-023d4ab7084c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:00.939775 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc51eb8e-0668-4c82-93d8-023d4ab7084c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:00.941168 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc51eb8e-0668-4c82-93d8-023d4ab7084c None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:00.958015 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 334/663] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 02:06:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:00.958015 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51eb8e-0668-4c82-93d8-023d4ab7084c None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:00.973757 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:01.024191 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:01.051244 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 330/664] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:06:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:06:01.051244 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84d3f9-572c-4e7b-aa4e-48f0c825f861 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:01.062681 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51eb8e-0668-4c82-93d8-023d4ab7084c None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:01.103437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee85bb-b84d-4a28-8fd8-b6c270ca007a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:01.104145 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee85bb-b84d-4a28-8fd8-b6c270ca007a None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:01.104326 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee85bb-b84d-4a28-8fd8-b6c270ca007a None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:01.104597 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee85bb-b84d-4a28-8fd8-b6c270ca007a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:01.112006 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee85bb-b84d-4a28-8fd8-b6c270ca007a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:01.113428 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee85bb-b84d-4a28-8fd8-b6c270ca007a None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:01.125107 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-91ee85bb-b84d-4a28-8fd8-b6c270ca007a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 08 02:06:01.125107 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:01.125107 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:01.125107 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:01.125107 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:01.125107 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:01.125107 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:01.125107 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:01.125107 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:01.125107 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:01.125107 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:01.125107 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:01.125107 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:06:01.125107 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:06:01.125107 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:06:01.125107 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:06:01.126063 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:01.126063 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:01.126063 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:06:01.126063 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:01.126063 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:06:01.126063 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:01.126063 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:01.126063 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:01.126063 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:01.126063 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:01.126063 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:01.126063 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:01.126063 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:01.126063 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:01.126063 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:01.126063 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:01.126063 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:01.126063 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:01.126998 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:01.126998 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:01.126998 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:06:01.126998 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:06:01.126998 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:06:01.126998 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:06:01.126998 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:06:01.126998 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:06:01.126998 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 08 02:06:01.126998 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:01.126998 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 335/665] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 02:06:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:01.126998 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee85bb-b84d-4a28-8fd8-b6c270ca007a None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:01.155031 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84d3f9-572c-4e7b-aa4e-48f0c825f861 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:01.191390 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea4cd7-73a4-403c-83e6-89a675d6fff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:01.192006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea4cd7-73a4-403c-83e6-89a675d6fff8 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:01.192286 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea4cd7-73a4-403c-83e6-89a675d6fff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:01.192566 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea4cd7-73a4-403c-83e6-89a675d6fff8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:01.203099 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea4cd7-73a4-403c-83e6-89a675d6fff8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:06:01.207681 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-71ea4cd7-73a4-403c-83e6-89a675d6fff8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:06:01.207681 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:01.207681 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:01.207681 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:01.207681 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:01.207681 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:01.207681 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:01.207681 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:01.207681 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:01.207681 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:01.207681 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:01.207681 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:01.207681 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:06:01.207681 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:06:01.207681 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:06:01.207681 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:06:01.208637 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:06:01.208637 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:06:01.208637 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:06:01.208637 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:06:01.208637 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:01.208637 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:01.208637 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:01.208637 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:01.208637 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:01.208637 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:01.208637 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:01.208637 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:01.208637 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:01.208637 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:01.208637 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:01.208637 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:01.209457 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:01.209457 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:01.209457 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:01.209457 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:01.209457 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:06:01.209457 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:06:01.209457 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:06:01.209457 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:06:01.209457 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:06:01.209457 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:06:01.209457 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:06:01.209457 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:01.209457 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 331/666] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 02:06:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:01.210148 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea4cd7-73a4-403c-83e6-89a675d6fff8 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:01.222228 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:01.245492 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee85bb-b84d-4a28-8fd8-b6c270ca007a None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:01.252888 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:01.281069 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3246ab-0675-4f05-a36a-fec9f615a336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:01.281888 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3246ab-0675-4f05-a36a-fec9f615a336 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:01.282308 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3246ab-0675-4f05-a36a-fec9f615a336 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:01.282589 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3246ab-0675-4f05-a36a-fec9f615a336 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:01.283392 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3246ab-0675-4f05-a36a-fec9f615a336 None admin] RBAC: Adding query filter params (role.id=071080f2ecc948319b313f2379ea2b97, scope.project.id=ebe178f5bce64a009bf690031676c89f, user.id=5d89e0c7d62444e4b75d3f4da49b2bc4) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:01.283654 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3246ab-0675-4f05-a36a-fec9f615a336 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:01.286514 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3246ab-0675-4f05-a36a-fec9f615a336 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:01.291060 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 336/667] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:06:01 2022] GET /identity/v3/role_assignments?user.id=5d89e0c7d62444e4b75d3f4da49b2bc4&scope.project.id=ebe178f5bce64a009bf690031676c89f&role.id=071080f2ecc948319b313f2379ea2b97 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:01.299684 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3246ab-0675-4f05-a36a-fec9f615a336 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:01.329751 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea4cd7-73a4-403c-83e6-89a675d6fff8 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:01.368496 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf0c60-8f13-412c-9e25-11154558f807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:01.369157 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf0c60-8f13-412c-9e25-11154558f807 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:01.369437 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf0c60-8f13-412c-9e25-11154558f807 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:01.369709 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf0c60-8f13-412c-9e25-11154558f807 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:01.383273 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf0c60-8f13-412c-9e25-11154558f807 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:01.383273 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf0c60-8f13-412c-9e25-11154558f807 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:01.402408 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-78bf0c60-8f13-412c-9e25-11154558f807 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:01.402408 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:01.402408 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:01.402408 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:01.402408 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:01.402408 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:01.402408 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:01.402408 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:01.402408 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:01.402408 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:01.402408 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:01.402408 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:01.402408 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:01.402408 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:01.402408 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:01.402408 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:01.403422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:01.403422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:01.403422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:01.403422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:01.403422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:01.403422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:01.403422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:01.403422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:01.403422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:01.403422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:01.403422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:01.403422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:01.403422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:01.403422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:01.403422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:01.403422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:01.403422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:01.404324 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:01.404324 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:01.404324 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:01.407511 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 332/668] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:01.408475 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf0c60-8f13-412c-9e25-11154558f807 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:01.437393 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3246ab-0675-4f05-a36a-fec9f615a336 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:01.475440 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac4323-37fc-4ed6-94d5-1510f9089721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:01.476943 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac4323-37fc-4ed6-94d5-1510f9089721 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:01.477191 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac4323-37fc-4ed6-94d5-1510f9089721 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:01.477464 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac4323-37fc-4ed6-94d5-1510f9089721 None admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:01.478198 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac4323-37fc-4ed6-94d5-1510f9089721 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:01.478500 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac4323-37fc-4ed6-94d5-1510f9089721 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:01.479953 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac4323-37fc-4ed6-94d5-1510f9089721 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:01.496543 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:01.509014 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 337/669] 10.222.0.23 () {56 vars in 1139 bytes} [Mon Aug 8 02:06:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:01.509515 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac4323-37fc-4ed6-94d5-1510f9089721 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:01.523735 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:01.538026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf0c60-8f13-412c-9e25-11154558f807 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:01.581337 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb7377-2135-41c4-aad4-7a581ba715bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:01.582357 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb7377-2135-41c4-aad4-7a581ba715bf None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:01.583084 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb7377-2135-41c4-aad4-7a581ba715bf None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:01.583392 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb7377-2135-41c4-aad4-7a581ba715bf None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:01.584079 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb7377-2135-41c4-aad4-7a581ba715bf None admin] RBAC: Adding query filter params (name=service) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:01.584373 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb7377-2135-41c4-aad4-7a581ba715bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:01.585741 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb7377-2135-41c4-aad4-7a581ba715bf None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:01.598562 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 333/670] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 8 02:06:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:01.598893 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb7377-2135-41c4-aad4-7a581ba715bf None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:01.644184 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac4323-37fc-4ed6-94d5-1510f9089721 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:01.681365 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605414f-6a0a-4f7c-a5b6-c2af52c1b472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:01.682324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605414f-6a0a-4f7c-a5b6-c2af52c1b472 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:01.682875 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605414f-6a0a-4f7c-a5b6-c2af52c1b472 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:01.683437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605414f-6a0a-4f7c-a5b6-c2af52c1b472 None admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:01.684326 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605414f-6a0a-4f7c-a5b6-c2af52c1b472 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:01.684840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605414f-6a0a-4f7c-a5b6-c2af52c1b472 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:01.686416 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605414f-6a0a-4f7c-a5b6-c2af52c1b472 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:01.699093 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 338/671] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:01.700365 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605414f-6a0a-4f7c-a5b6-c2af52c1b472 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:01.732620 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb7377-2135-41c4-aad4-7a581ba715bf None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:01.767391 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb6fa8-224d-4992-9ae6-359a9f3fef37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:01.768039 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb6fa8-224d-4992-9ae6-359a9f3fef37 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:01.768388 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb6fa8-224d-4992-9ae6-359a9f3fef37 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:01.768603 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb6fa8-224d-4992-9ae6-359a9f3fef37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:01.806302 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605414f-6a0a-4f7c-a5b6-c2af52c1b472 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:01.840286 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb6fa8-224d-4992-9ae6-359a9f3fef37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:01.841649 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e301b2-6641-4caf-a50e-00602e3335f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:01.841862 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb6fa8-224d-4992-9ae6-359a9f3fef37 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:01.842678 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e301b2-6641-4caf-a50e-00602e3335f5 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:01.843176 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e301b2-6641-4caf-a50e-00602e3335f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:01.843682 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e301b2-6641-4caf-a50e-00602e3335f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:01.854667 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e301b2-6641-4caf-a50e-00602e3335f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:01.856549 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e301b2-6641-4caf-a50e-00602e3335f5 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:01.871520 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-27e301b2-6641-4caf-a50e-00602e3335f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:01.871520 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:01.871520 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:01.871520 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:01.871520 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:01.871520 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:01.871520 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:01.871520 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:01.871520 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:01.871520 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:01.871520 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:01.871520 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:01.871520 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:01.871520 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:01.871520 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:01.871520 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:01.872580 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:01.872580 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:01.872580 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:01.872580 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:01.872580 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:01.872580 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:01.872580 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:01.872580 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:01.872580 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:01.872580 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:01.872580 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:01.872580 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:01.872580 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:01.872580 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:01.872580 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:01.872580 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:01.872580 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:01.873603 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:01.873603 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:01.873603 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:01.877015 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 339/672] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:01.878142 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e301b2-6641-4caf-a50e-00602e3335f5 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:01.930557 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:01.950155 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 334/673] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:06:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:06:01.951033 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb6fa8-224d-4992-9ae6-359a9f3fef37 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:01.978609 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:01.993804 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e301b2-6641-4caf-a50e-00602e3335f5 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:02.008058 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:02.015985 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:02.037446 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e39101-5c0c-410c-9d90-4cf81a8812d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:02.038712 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e39101-5c0c-410c-9d90-4cf81a8812d0 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:02.039544 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e39101-5c0c-410c-9d90-4cf81a8812d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:02.040294 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e39101-5c0c-410c-9d90-4cf81a8812d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:02.049339 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e39101-5c0c-410c-9d90-4cf81a8812d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:02.051162 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e39101-5c0c-410c-9d90-4cf81a8812d0 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:02.066463 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-77e39101-5c0c-410c-9d90-4cf81a8812d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:02.066463 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:02.066463 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:02.066463 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:02.066463 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:02.066463 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:02.066463 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:02.066463 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:02.066463 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:02.066463 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:02.066463 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:02.066463 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:02.066463 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:06:02.066463 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:06:02.066463 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:06:02.067406 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:06:02.067406 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:02.067406 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:02.067406 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:02.067406 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:02.067406 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:02.067406 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:02.067406 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:02.067406 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:02.067406 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:02.067406 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:02.067406 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:02.067406 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:02.067406 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:02.067406 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:02.067406 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:02.067406 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:02.068313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:06:02.068313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:06:02.068313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:06:02.068313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:06:02.068313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:06:02.068313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:06:02.068313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:02.068313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:02.070085 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb6fa8-224d-4992-9ae6-359a9f3fef37 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:02.072532 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 340/674] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:06:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:02.073391 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e39101-5c0c-410c-9d90-4cf81a8812d0 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:02.113048 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac7bd7-a01b-4ec4-8933-44520a1a37c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:02.113653 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac7bd7-a01b-4ec4-8933-44520a1a37c9 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:02.113932 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac7bd7-a01b-4ec4-8933-44520a1a37c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:02.114206 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac7bd7-a01b-4ec4-8933-44520a1a37c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:02.114843 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac7bd7-a01b-4ec4-8933-44520a1a37c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:02.115148 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac7bd7-a01b-4ec4-8933-44520a1a37c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:02.116544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac7bd7-a01b-4ec4-8933-44520a1a37c9 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:02.129222 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 335/675] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:02.130141 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac7bd7-a01b-4ec4-8933-44520a1a37c9 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:02.210194 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e39101-5c0c-410c-9d90-4cf81a8812d0 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:02.254705 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac7bd7-a01b-4ec4-8933-44520a1a37c9 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:02.257806 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6fcec1-6cb0-4b14-9dbb-64181e2e9a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:02.259291 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6fcec1-6cb0-4b14-9dbb-64181e2e9a5f None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:02.259870 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6fcec1-6cb0-4b14-9dbb-64181e2e9a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:02.260354 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6fcec1-6cb0-4b14-9dbb-64181e2e9a5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:02.268988 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:02.275866 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6fcec1-6cb0-4b14-9dbb-64181e2e9a5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:02.278252 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6fcec1-6cb0-4b14-9dbb-64181e2e9a5f None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:02.290408 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7789c6-15ed-43cf-9706-57e7133fa580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:02.296620 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7789c6-15ed-43cf-9706-57e7133fa580 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:02.296620 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7789c6-15ed-43cf-9706-57e7133fa580 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:02.296620 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7789c6-15ed-43cf-9706-57e7133fa580 None admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:02.296620 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7789c6-15ed-43cf-9706-57e7133fa580 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:02.296620 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7789c6-15ed-43cf-9706-57e7133fa580 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:02.296620 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7789c6-15ed-43cf-9706-57e7133fa580 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:02.297048 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-3c6fcec1-6cb0-4b14-9dbb-64181e2e9a5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:02.297048 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:02.297048 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:02.297048 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:02.297048 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:02.297048 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:02.297048 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:02.297048 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:02.297048 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:02.297048 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:02.297048 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:02.297048 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:02.297048 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:02.297048 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:02.297048 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:02.297048 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:02.298032 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:02.298032 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:02.298032 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:02.298032 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:02.298032 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:02.298032 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:02.298032 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:02.298032 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:02.298032 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:02.298032 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:02.298032 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:02.298032 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:02.298032 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:02.298032 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:02.298032 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:02.298032 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:02.298032 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:02.298917 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:02.298917 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:02.298917 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:02.298917 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 341/676] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:02.298917 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6fcec1-6cb0-4b14-9dbb-64181e2e9a5f None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:02.316881 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 336/677] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 02:06:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:02.318140 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7789c6-15ed-43cf-9706-57e7133fa580 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:02.333624 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:02.416915 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6fcec1-6cb0-4b14-9dbb-64181e2e9a5f None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:02.422806 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7789c6-15ed-43cf-9706-57e7133fa580 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:02.453607 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1bfd11-2cf5-47d8-a859-2886dfaf2086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:02.454402 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bfd11-2cf5-47d8-a859-2886dfaf2086 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:02.454832 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bfd11-2cf5-47d8-a859-2886dfaf2086 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:02.455208 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bfd11-2cf5-47d8-a859-2886dfaf2086 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:02.459314 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc3bd2-6b93-4f16-89a3-f0af33de9ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:02.460035 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc3bd2-6b93-4f16-89a3-f0af33de9ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:02.460377 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc3bd2-6b93-4f16-89a3-f0af33de9ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:02.460604 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc3bd2-6b93-4f16-89a3-f0af33de9ca5 None admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:02.461294 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fc3bd2-6b93-4f16-89a3-f0af33de9ca5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:02.461589 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fc3bd2-6b93-4f16-89a3-f0af33de9ca5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:02.462957 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fc3bd2-6b93-4f16-89a3-f0af33de9ca5 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:02.463914 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1bfd11-2cf5-47d8-a859-2886dfaf2086 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:02.465439 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1bfd11-2cf5-47d8-a859-2886dfaf2086 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:02.475074 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 337/678] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:02.475802 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc3bd2-6b93-4f16-89a3-f0af33de9ca5 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:02.478273 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-5d1bfd11-2cf5-47d8-a859-2886dfaf2086 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 08 02:06:02.478273 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:02.478273 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:02.478273 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:02.478273 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:02.478273 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:02.478273 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:02.478273 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:02.478273 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:02.478273 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:02.478273 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:02.478273 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:02.478273 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:06:02.478273 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:06:02.478273 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:06:02.478273 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:06:02.479660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:02.479660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:02.479660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:06:02.479660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:02.479660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:06:02.479660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:02.479660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:02.479660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:02.479660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:02.479660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:02.479660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:02.479660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:02.479660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:02.479660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:02.479660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:02.479660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:02.479660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:02.479660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:02.481869 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:02.481869 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:02.481869 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:06:02.481869 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:06:02.481869 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:06:02.481869 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:06:02.481869 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:06:02.481869 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:06:02.481869 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 08 02:06:02.481869 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:02.481869 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 342/679] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 02:06:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:02.481869 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a54791-10e5-4e98-b276-daa14d5c3c69 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:02.484285 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a54791-10e5-4e98-b276-daa14d5c3c69 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:02.484285 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a54791-10e5-4e98-b276-daa14d5c3c69 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:02.484285 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 343/680] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:02.488481 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a54791-10e5-4e98-b276-daa14d5c3c69 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:02.512781 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:02.575446 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:02.595613 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc3bd2-6b93-4f16-89a3-f0af33de9ca5 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:02.602560 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a54791-10e5-4e98-b276-daa14d5c3c69 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:02.631903 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccdb214-15c5-4982-8332-312aacd4da44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:02.632525 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdb214-15c5-4982-8332-312aacd4da44 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:02.632805 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdb214-15c5-4982-8332-312aacd4da44 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:02.633081 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdb214-15c5-4982-8332-312aacd4da44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:02.633822 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccdb214-15c5-4982-8332-312aacd4da44 None admin] RBAC: Adding query filter params (role.id=071080f2ecc948319b313f2379ea2b97, scope.project.id=ebe178f5bce64a009bf690031676c89f, user.id=aae574170d6f4eb8ab70805d8b5f4f08) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:02.634133 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccdb214-15c5-4982-8332-312aacd4da44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:02.635621 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccdb214-15c5-4982-8332-312aacd4da44 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:02.642055 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 338/681] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:06:02 2022] GET /identity/v3/role_assignments?user.id=aae574170d6f4eb8ab70805d8b5f4f08&scope.project.id=ebe178f5bce64a009bf690031676c89f&role.id=071080f2ecc948319b313f2379ea2b97 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:02.642563 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded7a77-d1f6-4912-a432-fe479482fdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:02.642892 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccdb214-15c5-4982-8332-312aacd4da44 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:02.643659 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded7a77-d1f6-4912-a432-fe479482fdc0 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:02.644079 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded7a77-d1f6-4912-a432-fe479482fdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:02.644502 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded7a77-d1f6-4912-a432-fe479482fdc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:02.658952 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded7a77-d1f6-4912-a432-fe479482fdc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:02.660893 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded7a77-d1f6-4912-a432-fe479482fdc0 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:02.674585 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-3ded7a77-d1f6-4912-a432-fe479482fdc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:02.674585 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:02.674585 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:02.674585 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:02.674585 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:02.674585 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:02.674585 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:02.674585 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:02.674585 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:02.674585 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:02.674585 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:02.674585 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:02.674585 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:06:02.674585 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:06:02.674585 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:06:02.675837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:06:02.675837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:02.675837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:02.675837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:02.675837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:02.675837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:02.675837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:02.675837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:02.675837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:02.675837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:02.675837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:02.675837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:02.675837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:02.675837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:02.675837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:02.675837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:02.675837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:02.676719 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:06:02.676719 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:06:02.676719 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:06:02.676719 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:06:02.676719 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:06:02.676719 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:06:02.676719 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:02.676719 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:02.684397 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 344/682] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:06:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:02.686076 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48942a0-4b3e-48ce-8ec3-4102584ac0eb None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:02.686581 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48942a0-4b3e-48ce-8ec3-4102584ac0eb None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:02.686861 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48942a0-4b3e-48ce-8ec3-4102584ac0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:02.705381 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-f48942a0-4b3e-48ce-8ec3-4102584ac0eb None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:02.706614 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-f48942a0-4b3e-48ce-8ec3-4102584ac0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:02.774495 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:02.787414 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 345/683] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:06:02.787414 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48942a0-4b3e-48ce-8ec3-4102584ac0eb None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:02.788629 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccdb214-15c5-4982-8332-312aacd4da44 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:02.846155 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf0257-1ac9-4025-b917-6f835303b5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:02.847132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf0257-1ac9-4025-b917-6f835303b5cf None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:02.847645 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf0257-1ac9-4025-b917-6f835303b5cf None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:02.848056 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf0257-1ac9-4025-b917-6f835303b5cf None admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:02.848913 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf0257-1ac9-4025-b917-6f835303b5cf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:02.849376 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf0257-1ac9-4025-b917-6f835303b5cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:02.851389 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf0257-1ac9-4025-b917-6f835303b5cf None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:02.870604 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 339/684] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Aug 8 02:06:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:02.871602 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf0257-1ac9-4025-b917-6f835303b5cf None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:02.877407 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:02.918437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48942a0-4b3e-48ce-8ec3-4102584ac0eb None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:02.956093 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40263428-cd79-4d27-8863-94a8494054fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:02.956817 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40263428-cd79-4d27-8863-94a8494054fb None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:02.957102 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40263428-cd79-4d27-8863-94a8494054fb None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:02.957377 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40263428-cd79-4d27-8863-94a8494054fb None admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:02.958079 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40263428-cd79-4d27-8863-94a8494054fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:02.958386 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40263428-cd79-4d27-8863-94a8494054fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:02.959865 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40263428-cd79-4d27-8863-94a8494054fb None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:02.977307 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 346/685] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 02:06:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:02.978263 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40263428-cd79-4d27-8863-94a8494054fb None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:02.990579 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf0257-1ac9-4025-b917-6f835303b5cf None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:03.025864 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7685e2e-d2ec-42fc-934f-2ed3f29364f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:03.026414 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7685e2e-d2ec-42fc-934f-2ed3f29364f0 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:03.026698 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7685e2e-d2ec-42fc-934f-2ed3f29364f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:03.026973 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7685e2e-d2ec-42fc-934f-2ed3f29364f0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:03.027596 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7685e2e-d2ec-42fc-934f-2ed3f29364f0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:03.028989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7685e2e-d2ec-42fc-934f-2ed3f29364f0 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:03.040177 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-f7685e2e-d2ec-42fc-934f-2ed3f29364f0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 02:06:03.040177 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:03.040177 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:06:03.040177 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:06:03.040177 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:06:03.040177 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:06:03.040177 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:06:03.040177 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:03.040177 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 02:06:03.040177 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:03.040177 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:06:03.040177 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:03.040177 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:03.040177 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:03.040177 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:03.040177 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:03.040177 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:03.041209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:03.041209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:03.041209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:03.041209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:03.041209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:03.041209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:03.041209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:06:03.041209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:06:03.041209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:06:03.041209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:06:03.041209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:03.041209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:03.041209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:03.041209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:03.041209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:03.041209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:03.042064 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:03.042064 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:03.042064 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:03.042064 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:03.042064 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:03.042064 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:03.042064 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:03.042064 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:03.042064 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:03.042064 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:03.042064 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:06:03.042064 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:03.042064 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 02:06:03.042064 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:03.042064 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 340/686] 10.222.0.23 () {56 vars in 1129 bytes} [Mon Aug 8 02:06:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:03.042844 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7685e2e-d2ec-42fc-934f-2ed3f29364f0 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:03.070567 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:03.107477 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40263428-cd79-4d27-8863-94a8494054fb None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:03.146212 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:03.150614 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7685e2e-d2ec-42fc-934f-2ed3f29364f0 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:03.153482 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9cc4c-1a6c-4629-8f30-0c4d24ef3397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:03.155009 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9cc4c-1a6c-4629-8f30-0c4d24ef3397 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:03.161077 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9cc4c-1a6c-4629-8f30-0c4d24ef3397 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:03.161077 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9cc4c-1a6c-4629-8f30-0c4d24ef3397 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:03.235926 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f9cc4c-1a6c-4629-8f30-0c4d24ef3397 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:03.237397 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f9cc4c-1a6c-4629-8f30-0c4d24ef3397 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:03.316458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4f1e6-d6d9-4c30-a900-fd5536f4e629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:03.316976 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4f1e6-d6d9-4c30-a900-fd5536f4e629 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:03.317253 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4f1e6-d6d9-4c30-a900-fd5536f4e629 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:03.323379 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4f1e6-d6d9-4c30-a900-fd5536f4e629 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:03.323379 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd4f1e6-d6d9-4c30-a900-fd5536f4e629 None admin] RBAC: Adding query filter params (role.id=071080f2ecc948319b313f2379ea2b97, scope.project.id=ebe178f5bce64a009bf690031676c89f, user.id=fa4c5732acb844369140e8d970577f94) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:03.323379 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd4f1e6-d6d9-4c30-a900-fd5536f4e629 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:03.323379 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd4f1e6-d6d9-4c30-a900-fd5536f4e629 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:03.327288 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 341/687] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:06:03 2022] GET /identity/v3/role_assignments?user.id=fa4c5732acb844369140e8d970577f94&scope.project.id=ebe178f5bce64a009bf690031676c89f&role.id=071080f2ecc948319b313f2379ea2b97 => generated 608 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:03.328174 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4f1e6-d6d9-4c30-a900-fd5536f4e629 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:03.371451 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 347/688] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:06:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:06:03.374603 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9cc4c-1a6c-4629-8f30-0c4d24ef3397 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:03.415275 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:03.442863 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:03.464854 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4f1e6-d6d9-4c30-a900-fd5536f4e629 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:03.502092 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93e761-1d4b-4b11-8c25-58f0a366d8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:03.502700 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93e761-1d4b-4b11-8c25-58f0a366d8b4 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:03.502975 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93e761-1d4b-4b11-8c25-58f0a366d8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:03.503238 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93e761-1d4b-4b11-8c25-58f0a366d8b4 None admin] PATH_INFO: `/v3/services` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:03.503941 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93e761-1d4b-4b11-8c25-58f0a366d8b4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:03.504245 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93e761-1d4b-4b11-8c25-58f0a366d8b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:03.505607 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93e761-1d4b-4b11-8c25-58f0a366d8b4 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:03.512757 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 342/689] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Aug 8 02:06:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:03.517815 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9cc4c-1a6c-4629-8f30-0c4d24ef3397 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:03.518219 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93e761-1d4b-4b11-8c25-58f0a366d8b4 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:03.568528 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f23fe-0e2b-42f1-a2c8-aa6622ff2f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:03.569542 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f23fe-0e2b-42f1-a2c8-aa6622ff2f1a None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:03.570200 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f23fe-0e2b-42f1-a2c8-aa6622ff2f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:03.570722 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f23fe-0e2b-42f1-a2c8-aa6622ff2f1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:03.585896 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f23fe-0e2b-42f1-a2c8-aa6622ff2f1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:03.588786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f23fe-0e2b-42f1-a2c8-aa6622ff2f1a None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:03.607547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-602f23fe-0e2b-42f1-a2c8-aa6622ff2f1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:03.607547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:03.607547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:03.607547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:03.607547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:03.607547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:03.607547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:03.607547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:03.607547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:03.607547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:03.607547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:03.607547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:03.607547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:03.607547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:03.607547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:03.607547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:03.608834 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:03.608834 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:03.608834 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:03.608834 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:03.608834 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:03.608834 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:03.608834 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:03.608834 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:03.608834 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:03.608834 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:03.608834 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:03.608834 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:03.608834 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:03.608834 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:03.608834 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:03.608834 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:03.608834 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:03.609918 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:03.609918 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:03.609918 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:03.609918 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 348/690] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:06:03.614337 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f23fe-0e2b-42f1-a2c8-aa6622ff2f1a None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:03.643034 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93e761-1d4b-4b11-8c25-58f0a366d8b4 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:03.684078 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b5e91-c1a7-49d3-84ac-4da818ecd788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:03.684774 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b5e91-c1a7-49d3-84ac-4da818ecd788 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:03.685173 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b5e91-c1a7-49d3-84ac-4da818ecd788 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:03.685463 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b5e91-c1a7-49d3-84ac-4da818ecd788 None admin] PATH_INFO: `/v3/services` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:03.686176 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b5e91-c1a7-49d3-84ac-4da818ecd788 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:03.686800 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b5e91-c1a7-49d3-84ac-4da818ecd788 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:03.688075 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b5e91-c1a7-49d3-84ac-4da818ecd788 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:03.695164 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 343/691] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Aug 8 02:06:03 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:03.720339 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:03.739086 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f23fe-0e2b-42f1-a2c8-aa6622ff2f1a None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:03.748243 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c43865-29cb-4aae-8d2e-5118bcc2c7b0 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:03.748591 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c43865-29cb-4aae-8d2e-5118bcc2c7b0 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:03.748815 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c43865-29cb-4aae-8d2e-5118bcc2c7b0 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:03.750456 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 344/692] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:03.757671 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730f35f-212f-4141-aaf3-1502a3383a1a None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:03.758038 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730f35f-212f-4141-aaf3-1502a3383a1a None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:03.758797 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730f35f-212f-4141-aaf3-1502a3383a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:03.781030 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24813a-cd0d-4dc9-8595-8e5ad753d7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:03.781656 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24813a-cd0d-4dc9-8595-8e5ad753d7e4 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:03.781947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24813a-cd0d-4dc9-8595-8e5ad753d7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:03.782222 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24813a-cd0d-4dc9-8595-8e5ad753d7e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:03.782885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24813a-cd0d-4dc9-8595-8e5ad753d7e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:03.783195 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-c730f35f-212f-4141-aaf3-1502a3383a1a None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:03.783303 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24813a-cd0d-4dc9-8595-8e5ad753d7e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:03.784449 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-c730f35f-212f-4141-aaf3-1502a3383a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:03.784669 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24813a-cd0d-4dc9-8595-8e5ad753d7e4 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:03.788545 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:03.798348 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 349/693] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:06:03.804186 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24813a-cd0d-4dc9-8595-8e5ad753d7e4 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:03.882266 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 345/694] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:06:03.908895 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730f35f-212f-4141-aaf3-1502a3383a1a None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:03.934330 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24813a-cd0d-4dc9-8595-8e5ad753d7e4 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:03.977078 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62033099-5cbb-4169-8395-9a3ff39b8b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:03.978227 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62033099-5cbb-4169-8395-9a3ff39b8b3d None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:03.978581 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62033099-5cbb-4169-8395-9a3ff39b8b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:03.978867 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62033099-5cbb-4169-8395-9a3ff39b8b3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:03.987995 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62033099-5cbb-4169-8395-9a3ff39b8b3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:03.990059 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62033099-5cbb-4169-8395-9a3ff39b8b3d None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:04.004381 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-62033099-5cbb-4169-8395-9a3ff39b8b3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:04.004381 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:04.004381 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:04.004381 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:04.004381 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:04.004381 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:04.004381 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:04.004381 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:04.004381 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:04.004381 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:04.004381 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:04.004381 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:04.004381 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:06:04.004381 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:06:04.004381 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:06:04.005313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:06:04.005313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:04.005313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:04.005313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:04.005313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:04.005313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:04.005313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:04.005313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:04.005313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:04.005313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:04.005313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:04.005313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:04.005313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:04.005313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:04.005313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:04.005313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:04.005313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:04.006372 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:06:04.006372 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:06:04.006372 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:06:04.006372 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:06:04.006372 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:06:04.006372 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:06:04.006372 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:04.006372 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:04.006372 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 350/695] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:06:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:06:04.013724 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62033099-5cbb-4169-8395-9a3ff39b8b3d None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:04.025577 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:04.035582 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730f35f-212f-4141-aaf3-1502a3383a1a None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:04.073811 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359e1c1-9f7f-4817-9af4-c0decae848ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:04.074704 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359e1c1-9f7f-4817-9af4-c0decae848ad None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:04.075131 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359e1c1-9f7f-4817-9af4-c0decae848ad None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:04.075592 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359e1c1-9f7f-4817-9af4-c0decae848ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:04.086807 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1359e1c1-9f7f-4817-9af4-c0decae848ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:06:04.091802 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-1359e1c1-9f7f-4817-9af4-c0decae848ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:06:04.091802 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:04.091802 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:04.091802 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:04.091802 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:04.091802 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:04.091802 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:04.091802 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:04.091802 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:04.091802 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:04.091802 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:04.091802 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:04.091802 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:06:04.091802 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:06:04.091802 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:06:04.091802 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:06:04.092938 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:06:04.092938 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:06:04.092938 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:06:04.092938 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:06:04.092938 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:04.092938 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:04.092938 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:04.092938 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:04.092938 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:04.092938 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:04.092938 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:04.092938 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:04.092938 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:04.092938 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:04.092938 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:04.092938 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:04.093975 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:04.093975 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:04.093975 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:04.093975 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:04.093975 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:06:04.093975 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:06:04.093975 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:06:04.093975 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:06:04.093975 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:06:04.093975 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:06:04.093975 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:06:04.093975 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:04.096474 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 346/696] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 02:06:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:06:04.097571 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:04.103409 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359e1c1-9f7f-4817-9af4-c0decae848ad None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:04.210850 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359e1c1-9f7f-4817-9af4-c0decae848ad None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:04.254781 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691889bb-05ae-4d6a-a7d2-96f29ec6f9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:04.255811 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691889bb-05ae-4d6a-a7d2-96f29ec6f9d1 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:04.256308 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691889bb-05ae-4d6a-a7d2-96f29ec6f9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:04.256593 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691889bb-05ae-4d6a-a7d2-96f29ec6f9d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:04.257262 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691889bb-05ae-4d6a-a7d2-96f29ec6f9d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:04.257566 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691889bb-05ae-4d6a-a7d2-96f29ec6f9d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:04.258975 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691889bb-05ae-4d6a-a7d2-96f29ec6f9d1 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:04.271608 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 347/697] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:06:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:04.273205 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62033099-5cbb-4169-8395-9a3ff39b8b3d None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:04.278312 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691889bb-05ae-4d6a-a7d2-96f29ec6f9d1 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:04.333237 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efcd199-be34-43e0-8cf0-df2e74659374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:04.335019 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcd199-be34-43e0-8cf0-df2e74659374 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:04.336131 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcd199-be34-43e0-8cf0-df2e74659374 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:04.337339 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcd199-be34-43e0-8cf0-df2e74659374 None admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:04.339175 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efcd199-be34-43e0-8cf0-df2e74659374 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:04.339871 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efcd199-be34-43e0-8cf0-df2e74659374 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:04.342048 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efcd199-be34-43e0-8cf0-df2e74659374 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:04.368820 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 351/698] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 02:06:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:04.374662 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efcd199-be34-43e0-8cf0-df2e74659374 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:04.403391 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:04.480145 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691889bb-05ae-4d6a-a7d2-96f29ec6f9d1 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:04.495758 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:04.547935 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931f6a2-2db0-4950-9a26-0078affcef3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:04.548563 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931f6a2-2db0-4950-9a26-0078affcef3e None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:04.548839 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931f6a2-2db0-4950-9a26-0078affcef3e None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:04.549107 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931f6a2-2db0-4950-9a26-0078affcef3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:04.564205 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efcd199-be34-43e0-8cf0-df2e74659374 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:04.575989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a931f6a2-2db0-4950-9a26-0078affcef3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:04.577439 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a931f6a2-2db0-4950-9a26-0078affcef3e None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:04.598643 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-a931f6a2-2db0-4950-9a26-0078affcef3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:04.598643 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:04.598643 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:04.598643 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:04.598643 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:04.598643 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:04.598643 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:04.598643 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:04.598643 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:04.598643 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:04.598643 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:04.598643 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:04.598643 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:04.598643 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:04.598643 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:04.598643 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:04.599648 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:04.599648 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:04.599648 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:04.599648 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:04.599648 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:04.599648 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:04.599648 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:04.599648 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:04.599648 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:04.599648 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:04.599648 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:04.599648 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:04.599648 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:04.599648 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:04.599648 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:04.599648 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:04.599648 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:04.600558 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:04.600558 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:04.600558 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:04.611244 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 348/699] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:06:04.612155 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931f6a2-2db0-4950-9a26-0078affcef3e None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:04.637429 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc5f0f-8d84-4613-8f42-104c86c10101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:04.638045 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc5f0f-8d84-4613-8f42-104c86c10101 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:04.638327 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc5f0f-8d84-4613-8f42-104c86c10101 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:04.638598 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc5f0f-8d84-4613-8f42-104c86c10101 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:04.639324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc5f0f-8d84-4613-8f42-104c86c10101 None admin] RBAC: Adding query filter params (role.id=071080f2ecc948319b313f2379ea2b97, scope.project.id=ebe178f5bce64a009bf690031676c89f, user.id=6c212009b6a44e1bad92769630116408) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:04.639652 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc5f0f-8d84-4613-8f42-104c86c10101 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:04.641075 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc5f0f-8d84-4613-8f42-104c86c10101 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:04.652259 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 352/700] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:06:04 2022] GET /identity/v3/role_assignments?user.id=6c212009b6a44e1bad92769630116408&scope.project.id=ebe178f5bce64a009bf690031676c89f&role.id=071080f2ecc948319b313f2379ea2b97 => generated 608 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:06:04.808014 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931f6a2-2db0-4950-9a26-0078affcef3e None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:04.821911 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:04.842209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f18e2-44e2-4790-9c73-0d694cd0d0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:04.842813 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f18e2-44e2-4790-9c73-0d694cd0d0e2 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:04.843101 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f18e2-44e2-4790-9c73-0d694cd0d0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:04.843399 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f18e2-44e2-4790-9c73-0d694cd0d0e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:04.844035 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f18e2-44e2-4790-9c73-0d694cd0d0e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:04.844338 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f18e2-44e2-4790-9c73-0d694cd0d0e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:04.845687 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f18e2-44e2-4790-9c73-0d694cd0d0e2 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:04.858604 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 349/701] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:04.863614 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc5f0f-8d84-4613-8f42-104c86c10101 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:04.920039 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20da310-ead9-408b-809c-2926fea33e9a None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:04.920378 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20da310-ead9-408b-809c-2926fea33e9a None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:04.920580 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20da310-ead9-408b-809c-2926fea33e9a None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:04.922191 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 350/702] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:06:04.927114 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120788fb-b85f-4bd1-ae4c-04fe173e827c None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:04.927423 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120788fb-b85f-4bd1-ae4c-04fe173e827c None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:04.927708 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120788fb-b85f-4bd1-ae4c-04fe173e827c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:04.947141 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-120788fb-b85f-4bd1-ae4c-04fe173e827c None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:04.948454 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-120788fb-b85f-4bd1-ae4c-04fe173e827c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:04.979261 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc5f0f-8d84-4613-8f42-104c86c10101 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:05.010301 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:05.018482 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158514c-f685-4507-8e1c-6082b2ff77e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:05.019113 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158514c-f685-4507-8e1c-6082b2ff77e8 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:05.019414 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158514c-f685-4507-8e1c-6082b2ff77e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:05.019690 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158514c-f685-4507-8e1c-6082b2ff77e8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:05.027436 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0158514c-f685-4507-8e1c-6082b2ff77e8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:05.028867 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0158514c-f685-4507-8e1c-6082b2ff77e8 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:05.042182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-0158514c-f685-4507-8e1c-6082b2ff77e8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:06:05.042182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:05.042182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:05.042182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:05.042182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:05.042182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:05.042182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:05.042182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:05.042182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:05.042182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:05.042182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:05.042182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:05.042182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:06:05.042182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:06:05.042182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:06:05.042182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:06:05.044538 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:05.044538 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:05.044538 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:06:05.044538 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:05.044538 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:06:05.044538 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:05.044538 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:05.044538 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:05.044538 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:05.044538 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:05.044538 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:05.044538 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:05.044538 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:05.044538 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:05.044538 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:05.044538 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:05.044538 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:05.044538 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:05.046893 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:05.046893 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:05.046893 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:06:05.046893 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:06:05.046893 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:06:05.046893 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:06:05.046893 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:06:05.046893 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:06:05.046893 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:06:05.046893 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:05.048118 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 351/703] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:06:05.048206 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 353/704] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Aug 8 02:06:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:05.055543 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120788fb-b85f-4bd1-ae4c-04fe173e827c None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:05.066133 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158514c-f685-4507-8e1c-6082b2ff77e8 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:05.172171 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120788fb-b85f-4bd1-ae4c-04fe173e827c None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:05.175894 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:05.213172 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158514c-f685-4507-8e1c-6082b2ff77e8 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:05.213886 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853311a-a813-45f6-986e-63eddaa74901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:05.214850 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853311a-a813-45f6-986e-63eddaa74901 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:05.215524 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853311a-a813-45f6-986e-63eddaa74901 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:05.216004 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853311a-a813-45f6-986e-63eddaa74901 None admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:05.216942 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f853311a-a813-45f6-986e-63eddaa74901 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:05.217471 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f853311a-a813-45f6-986e-63eddaa74901 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:05.219116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f853311a-a813-45f6-986e-63eddaa74901 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:05.244819 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 352/705] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Aug 8 02:06:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:05.251225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853311a-a813-45f6-986e-63eddaa74901 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:05.279169 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d96be-34d6-4d9e-888d-c821e336dffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:05.280156 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d96be-34d6-4d9e-888d-c821e336dffd None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:05.280672 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d96be-34d6-4d9e-888d-c821e336dffd None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:05.281148 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d96be-34d6-4d9e-888d-c821e336dffd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:05.300020 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d96be-34d6-4d9e-888d-c821e336dffd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:05.302460 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d96be-34d6-4d9e-888d-c821e336dffd None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:05.331173 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-d99d96be-34d6-4d9e-888d-c821e336dffd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:05.331173 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:05.331173 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:05.331173 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:05.331173 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:05.331173 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:05.331173 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:05.331173 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:05.331173 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:05.331173 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:05.331173 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:05.331173 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:05.331173 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:05.331173 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:05.331173 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:05.331173 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:05.332169 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:05.332169 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:05.332169 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:05.332169 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:05.332169 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:05.332169 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:05.332169 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:05.332169 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:05.332169 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:05.332169 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:05.332169 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:05.332169 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:05.332169 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:05.332169 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:05.332169 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:05.332169 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:05.332169 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:05.333062 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:05.333062 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:05.333062 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:05.336359 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 354/706] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:05.342342 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d96be-34d6-4d9e-888d-c821e336dffd None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:05.424109 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:05.448362 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853311a-a813-45f6-986e-63eddaa74901 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:05.486957 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d17407-c560-489d-b756-41dc24301d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:05.487987 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d17407-c560-489d-b756-41dc24301d78 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:05.488475 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d17407-c560-489d-b756-41dc24301d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:05.488977 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d17407-c560-489d-b756-41dc24301d78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:05.528634 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:05.551830 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d96be-34d6-4d9e-888d-c821e336dffd None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:05.604484 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d17407-c560-489d-b756-41dc24301d78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:05.605863 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d17407-c560-489d-b756-41dc24301d78 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:05.607938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7dc7d-b3ee-4090-a440-1730983cd142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:05.608856 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7dc7d-b3ee-4090-a440-1730983cd142 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:05.609342 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7dc7d-b3ee-4090-a440-1730983cd142 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:05.609818 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7dc7d-b3ee-4090-a440-1730983cd142 None admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:05.610677 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c7dc7d-b3ee-4090-a440-1730983cd142 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:05.611200 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c7dc7d-b3ee-4090-a440-1730983cd142 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:05.613657 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c7dc7d-b3ee-4090-a440-1730983cd142 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:05.636932 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 355/707] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:05.642605 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7dc7d-b3ee-4090-a440-1730983cd142 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:05.785320 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 353/708] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:06:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:06:05.791649 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d17407-c560-489d-b756-41dc24301d78 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:05.826799 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:05.833495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7dc7d-b3ee-4090-a440-1730983cd142 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:05.875812 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:05.916377 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5c89b-dc73-4d7a-ab1c-0113be0269c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:05.917028 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5c89b-dc73-4d7a-ab1c-0113be0269c1 None admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:05.917258 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5c89b-dc73-4d7a-ab1c-0113be0269c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:05.917605 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5c89b-dc73-4d7a-ab1c-0113be0269c1 None admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:05.918241 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5c89b-dc73-4d7a-ab1c-0113be0269c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:05.919687 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5c89b-dc73-4d7a-ab1c-0113be0269c1 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:05.928785 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d17407-c560-489d-b756-41dc24301d78 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:05.969881 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09147b-5d45-41fc-825a-4e96cf517b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:05.970501 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09147b-5d45-41fc-825a-4e96cf517b6d None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:05.970782 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09147b-5d45-41fc-825a-4e96cf517b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:05.971053 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09147b-5d45-41fc-825a-4e96cf517b6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:05.981866 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09147b-5d45-41fc-825a-4e96cf517b6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:05.983348 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09147b-5d45-41fc-825a-4e96cf517b6d None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:05.998533 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-fb09147b-5d45-41fc-825a-4e96cf517b6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:05.998533 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:05.998533 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:05.998533 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:05.998533 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:05.998533 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:05.998533 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:05.998533 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:05.998533 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:05.998533 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:05.998533 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:05.998533 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:05.998533 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:05.998533 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:05.998533 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:05.998533 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:06.001231 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:06.001231 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:06.001231 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:06.001231 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:06.001231 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:06.001231 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:06.001231 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:06.001231 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:06.001231 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:06.001231 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:06.001231 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:06.001231 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:06.001231 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:06.001231 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:06.001231 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:06.001231 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:06.001231 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:06.002173 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:06.002173 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:06.002173 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:06.002173 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 354/709] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:06.007008 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09147b-5d45-41fc-825a-4e96cf517b6d None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:06.031327 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 356/710] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 8 02:06:05 2022] POST /identity/v3/users => generated 254 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:06:06.123141 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09147b-5d45-41fc-825a-4e96cf517b6d None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:06.140218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:06.160584 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa43e34-c9e2-4ee3-b2ad-14bf11ea18ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:06.161189 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa43e34-c9e2-4ee3-b2ad-14bf11ea18ec None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:06.161466 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa43e34-c9e2-4ee3-b2ad-14bf11ea18ec None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:06.161738 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa43e34-c9e2-4ee3-b2ad-14bf11ea18ec None admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:06.162379 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa43e34-c9e2-4ee3-b2ad-14bf11ea18ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:06.162680 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa43e34-c9e2-4ee3-b2ad-14bf11ea18ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:06.164067 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa43e34-c9e2-4ee3-b2ad-14bf11ea18ec None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:06.177817 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 355/711] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:06.184680 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5c89b-dc73-4d7a-ab1c-0113be0269c1 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:06.214029 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c40a87-f277-4769-8566-dea7e770c125 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:06.214406 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c40a87-f277-4769-8566-dea7e770c125 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:06.214585 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c40a87-f277-4769-8566-dea7e770c125 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:06.216183 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 356/712] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:06:06.221749 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15da0c-4884-4429-afd4-0a43261895ac None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:06.222323 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15da0c-4884-4429-afd4-0a43261895ac None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:06.222805 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15da0c-4884-4429-afd4-0a43261895ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:06.250404 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-7c15da0c-4884-4429-afd4-0a43261895ac None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:06.251668 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-7c15da0c-4884-4429-afd4-0a43261895ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:06.343551 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5c89b-dc73-4d7a-ab1c-0113be0269c1 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:06.344519 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 357/713] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:06:06.345550 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08003013-d963-4466-bcf8-e343b8eaa91b None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:06.345840 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08003013-d963-4466-bcf8-e343b8eaa91b None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:06.346114 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08003013-d963-4466-bcf8-e343b8eaa91b None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:06.347346 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 358/714] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:06.353898 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0279ef7-13b4-439e-b4fa-600fd19a9f09 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:06.354184 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0279ef7-13b4-439e-b4fa-600fd19a9f09 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:06.354463 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0279ef7-13b4-439e-b4fa-600fd19a9f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:06.389039 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45bedf-e1a8-4f82-9852-44e89ff507c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:06.389990 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45bedf-e1a8-4f82-9852-44e89ff507c3 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:06.390547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45bedf-e1a8-4f82-9852-44e89ff507c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:06.390820 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45bedf-e1a8-4f82-9852-44e89ff507c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:06.392248 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-c0279ef7-13b4-439e-b4fa-600fd19a9f09 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:06.393629 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-c0279ef7-13b4-439e-b4fa-600fd19a9f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:06.401679 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45bedf-e1a8-4f82-9852-44e89ff507c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:06.403258 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45bedf-e1a8-4f82-9852-44e89ff507c3 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:06.416934 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-0a45bedf-e1a8-4f82-9852-44e89ff507c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:06.416934 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:06.416934 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:06.416934 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:06.416934 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:06.416934 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:06.416934 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:06.416934 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:06.416934 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:06.416934 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:06.416934 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:06.416934 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:06.416934 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:06:06.416934 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:06:06.416934 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:06:06.417886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:06:06.417886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:06.417886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:06.417886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:06.417886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:06.417886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:06.417886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:06.417886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:06.417886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:06.417886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:06.417886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:06.417886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:06.417886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:06.417886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:06.417886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:06.417886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:06.417886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:06.418753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:06:06.418753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:06:06.418753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:06:06.418753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:06:06.418753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:06:06.418753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:06:06.418753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:06.418753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:06.418753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 357/715] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:06:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:06.419213 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45bedf-e1a8-4f82-9852-44e89ff507c3 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:06.444098 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:06.481681 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 359/716] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:06:06.482835 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0279ef7-13b4-439e-b4fa-600fd19a9f09 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:06.520186 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:06.528917 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45bedf-e1a8-4f82-9852-44e89ff507c3 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:06.564157 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed9f04-a446-4974-a596-afa57a5dcded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:06.564769 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed9f04-a446-4974-a596-afa57a5dcded None admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:06.565052 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed9f04-a446-4974-a596-afa57a5dcded None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:06.565330 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed9f04-a446-4974-a596-afa57a5dcded None admin] PATH_INFO: `/v3/services` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:06.565974 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed9f04-a446-4974-a596-afa57a5dcded None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:06.567334 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed9f04-a446-4974-a596-afa57a5dcded None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:06.591941 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0279ef7-13b4-439e-b4fa-600fd19a9f09 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:06.625969 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4604902-bbdf-4c44-b465-88ed41d6a5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:06.626569 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4604902-bbdf-4c44-b465-88ed41d6a5df None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:06.626853 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4604902-bbdf-4c44-b465-88ed41d6a5df None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:06.627128 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4604902-bbdf-4c44-b465-88ed41d6a5df None admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:06.627877 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4604902-bbdf-4c44-b465-88ed41d6a5df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:06.628179 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4604902-bbdf-4c44-b465-88ed41d6a5df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:06.629600 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4604902-bbdf-4c44-b465-88ed41d6a5df None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:06.641525 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 360/717] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 02:06:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:06.646485 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4604902-bbdf-4c44-b465-88ed41d6a5df None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:06.667441 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 358/718] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Aug 8 02:06:06 2022] POST /identity/v3/services => generated 251 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:06:06.668643 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed9f04-a446-4974-a596-afa57a5dcded None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:06.803789 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:06.815342 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed9f04-a446-4974-a596-afa57a5dcded None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:06.857421 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3aa10-fc9f-4238-8a63-4dce88bb49fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:06.859648 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3aa10-fc9f-4238-8a63-4dce88bb49fd None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:06.860163 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3aa10-fc9f-4238-8a63-4dce88bb49fd None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:06.864680 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3aa10-fc9f-4238-8a63-4dce88bb49fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:06.864680 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e3aa10-fc9f-4238-8a63-4dce88bb49fd None admin] RBAC: Adding query filter params (role.id=84da65a75e544d1191ec53cb6b05aa73, scope.project.id=ebe178f5bce64a009bf690031676c89f, user.id=5d89e0c7d62444e4b75d3f4da49b2bc4) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:06.864680 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e3aa10-fc9f-4238-8a63-4dce88bb49fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:06.864680 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e3aa10-fc9f-4238-8a63-4dce88bb49fd None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:06.870992 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 359/719] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:06:06 2022] GET /identity/v3/role_assignments?user.id=5d89e0c7d62444e4b75d3f4da49b2bc4&scope.project.id=ebe178f5bce64a009bf690031676c89f&role.id=84da65a75e544d1191ec53cb6b05aa73 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:06.916867 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:06.925526 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4604902-bbdf-4c44-b465-88ed41d6a5df None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:06.963173 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee08b70-6e73-44c0-8c47-939f1e042d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:06.963849 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee08b70-6e73-44c0-8c47-939f1e042d35 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:06.964131 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee08b70-6e73-44c0-8c47-939f1e042d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:06.964407 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee08b70-6e73-44c0-8c47-939f1e042d35 None admin] PATH_INFO: `/v3/services/network` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:06.964999 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee08b70-6e73-44c0-8c47-939f1e042d35 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:06.966374 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee08b70-6e73-44c0-8c47-939f1e042d35 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:06.976455 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-9ee08b70-6e73-44c0-8c47-939f1e042d35 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 02:06:06.976455 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:06.976455 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:06:06.976455 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:06:06.976455 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:06:06.976455 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:06:06.976455 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:06:06.976455 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:06.976455 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 02:06:06.976455 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:06.976455 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:06:06.976455 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:06.976455 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:06.976455 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:06.976455 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:06.976455 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:06.976455 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:06.978063 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:06.978063 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:06.978063 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:06.978063 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:06.978063 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:06.978063 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:06.978063 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:06:06.978063 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:06:06.978063 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:06:06.978063 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:06:06.978063 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:06.978063 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:06.978063 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:06.978063 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:06.978063 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:06.978063 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:06.978885 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:06.978885 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:06.978885 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:06.978885 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:06.978885 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:06.978885 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:06.978885 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:06.978885 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:06.978885 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:06.978885 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:06.978885 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:06:06.978885 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:06.978885 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 02:06:06.978885 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:06.978885 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 361/720] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:06:06 2022] GET /identity/v3/services/network => generated 88 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:06.984502 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3aa10-fc9f-4238-8a63-4dce88bb49fd None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:07.129173 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3aa10-fc9f-4238-8a63-4dce88bb49fd None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:07.166016 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2a1d7-9016-47b6-8da3-96a642b60b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:07.166632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2a1d7-9016-47b6-8da3-96a642b60b4f None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:07.166969 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2a1d7-9016-47b6-8da3-96a642b60b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:07.167193 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2a1d7-9016-47b6-8da3-96a642b60b4f None admin] PATH_INFO: `/v3/services` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:07.167875 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e2a1d7-9016-47b6-8da3-96a642b60b4f None admin] RBAC: Adding query filter params (name=network) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:07.168185 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e2a1d7-9016-47b6-8da3-96a642b60b4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:07.169621 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e2a1d7-9016-47b6-8da3-96a642b60b4f None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:07.171845 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:07.175561 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 360/721] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Aug 8 02:06:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:07.184453 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee08b70-6e73-44c0-8c47-939f1e042d35 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:07.274694 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101962c-512e-4b62-b6d6-98524a73c08f None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:07.275019 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101962c-512e-4b62-b6d6-98524a73c08f None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:07.275250 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101962c-512e-4b62-b6d6-98524a73c08f None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:07.276900 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 361/722] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:07.281789 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900b31d-ab58-442a-9611-cab246ea94f1 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:07.282076 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900b31d-ab58-442a-9611-cab246ea94f1 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:07.282358 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900b31d-ab58-442a-9611-cab246ea94f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:07.312236 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-a900b31d-ab58-442a-9611-cab246ea94f1 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:07.314472 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-a900b31d-ab58-442a-9611-cab246ea94f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:07.358152 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee08b70-6e73-44c0-8c47-939f1e042d35 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:07.443672 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 362/723] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:07 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 02:06:07.475440 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73188834-8df6-41d8-9ed2-b562850a1d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:07.475440 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73188834-8df6-41d8-9ed2-b562850a1d7f None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:07.475440 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73188834-8df6-41d8-9ed2-b562850a1d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:07.475440 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73188834-8df6-41d8-9ed2-b562850a1d7f None admin] PATH_INFO: `/v3/services` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:07.475909 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73188834-8df6-41d8-9ed2-b562850a1d7f None admin] RBAC: Adding query filter params (type=network) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:07.475909 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73188834-8df6-41d8-9ed2-b562850a1d7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:07.478659 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73188834-8df6-41d8-9ed2-b562850a1d7f None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:07.481282 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900b31d-ab58-442a-9611-cab246ea94f1 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:07.517819 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 362/724] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Aug 8 02:06:07 2022] GET /identity/v3/services?type=network => generated 124 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:07.688933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900b31d-ab58-442a-9611-cab246ea94f1 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:07.735870 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:07.748353 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2203d-2a26-4c73-a69e-22b4694af7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:07.749108 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2203d-2a26-4c73-a69e-22b4694af7df None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:07.749398 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2203d-2a26-4c73-a69e-22b4694af7df None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:07.749677 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2203d-2a26-4c73-a69e-22b4694af7df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:07.786860 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a2203d-2a26-4c73-a69e-22b4694af7df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:06:07.802617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-b0a2203d-2a26-4c73-a69e-22b4694af7df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:06:07.802617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:07.802617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:07.802617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:07.802617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:07.802617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:07.802617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:07.802617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:07.802617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:07.802617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:07.802617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:07.802617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:07.802617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:06:07.802617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:06:07.802617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:06:07.802617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:06:07.803643 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:06:07.803643 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:06:07.803643 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:06:07.803643 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:06:07.803643 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:07.803643 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:07.803643 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:07.803643 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:07.803643 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:07.803643 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:07.803643 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:07.803643 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:07.803643 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:07.803643 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:07.803643 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:07.803643 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:07.804489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:07.804489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:07.804489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:07.804489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:07.804489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:06:07.804489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:06:07.804489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:06:07.804489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:06:07.804489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:06:07.804489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:06:07.804489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:06:07.804489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:07.807943 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 363/725] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 02:06:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:07.814068 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73188834-8df6-41d8-9ed2-b562850a1d7f None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:07.886327 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:08.009459 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73188834-8df6-41d8-9ed2-b562850a1d7f None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:08.047140 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec7672-a617-4475-8365-63f5fb5601d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:08.047846 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec7672-a617-4475-8365-63f5fb5601d1 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:08.048135 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec7672-a617-4475-8365-63f5fb5601d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:08.048414 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec7672-a617-4475-8365-63f5fb5601d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:08.049078 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ec7672-a617-4475-8365-63f5fb5601d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:08.049387 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ec7672-a617-4475-8365-63f5fb5601d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:08.050748 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ec7672-a617-4475-8365-63f5fb5601d1 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:08.063054 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 363/726] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:06:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:08.068408 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2203d-2a26-4c73-a69e-22b4694af7df None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:08.229986 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2203d-2a26-4c73-a69e-22b4694af7df None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:08.274826 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e81059-d0f9-408f-a15d-e529b44a7a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:08.275831 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e81059-d0f9-408f-a15d-e529b44a7a32 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:08.276309 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e81059-d0f9-408f-a15d-e529b44a7a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:08.276775 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e81059-d0f9-408f-a15d-e529b44a7a32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:08.289835 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e81059-d0f9-408f-a15d-e529b44a7a32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:08.291655 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e81059-d0f9-408f-a15d-e529b44a7a32 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:08.314718 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-53e81059-d0f9-408f-a15d-e529b44a7a32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:08.314718 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:08.314718 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:08.314718 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:08.314718 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:08.314718 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:08.314718 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:08.314718 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:08.314718 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:08.314718 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:08.314718 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:08.314718 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:08.314718 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:08.314718 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:08.314718 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:08.314718 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:08.315731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:08.315731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:08.315731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:08.315731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:08.315731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:08.315731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:08.315731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:08.315731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:08.315731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:08.315731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:08.315731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:08.315731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:08.315731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:08.315731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:08.315731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:08.315731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:08.315731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:08.316606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:08.316606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:08.316606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:08.318349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 364/727] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:08.324323 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec7672-a617-4475-8365-63f5fb5601d1 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:08.462672 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:08.486880 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec7672-a617-4475-8365-63f5fb5601d1 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:08.537289 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5fc32c-e229-41e6-a577-65008bfa6bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:08.537817 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fc32c-e229-41e6-a577-65008bfa6bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:08.538098 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fc32c-e229-41e6-a577-65008bfa6bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:08.538375 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fc32c-e229-41e6-a577-65008bfa6bf2 None admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:08.539026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5fc32c-e229-41e6-a577-65008bfa6bf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:08.539369 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5fc32c-e229-41e6-a577-65008bfa6bf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:08.540732 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5fc32c-e229-41e6-a577-65008bfa6bf2 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:08.558421 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 364/728] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:08.563654 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e81059-d0f9-408f-a15d-e529b44a7a32 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:08.642651 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:08.670120 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5a6bb-b93b-4635-8c20-0c38e9a5429f None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:08.670427 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5a6bb-b93b-4635-8c20-0c38e9a5429f None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:08.672422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5a6bb-b93b-4635-8c20-0c38e9a5429f None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:08.672422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 365/729] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:08.685598 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d31a6-b3a0-4a6e-a8e0-f05c4f05615b None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:08.685892 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d31a6-b3a0-4a6e-a8e0-f05c4f05615b None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:08.686173 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d31a6-b3a0-4a6e-a8e0-f05c4f05615b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:08.716589 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-a55d31a6-b3a0-4a6e-a8e0-f05c4f05615b None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:08.717770 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-a55d31a6-b3a0-4a6e-a8e0-f05c4f05615b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:08.718436 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e81059-d0f9-408f-a15d-e529b44a7a32 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:08.760939 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d460a58-4e07-4283-99a4-4ad6f21d21e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:08.761571 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d460a58-4e07-4283-99a4-4ad6f21d21e1 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:08.761855 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d460a58-4e07-4283-99a4-4ad6f21d21e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:08.762130 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d460a58-4e07-4283-99a4-4ad6f21d21e1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:08.777414 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d460a58-4e07-4283-99a4-4ad6f21d21e1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:08.778957 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d460a58-4e07-4283-99a4-4ad6f21d21e1 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:08.801556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-5d460a58-4e07-4283-99a4-4ad6f21d21e1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 08 02:06:08.801556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:08.801556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:08.801556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:08.801556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:08.801556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:08.801556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:08.801556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:08.801556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:08.801556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:08.801556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:08.801556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:08.801556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:06:08.801556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:06:08.801556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:06:08.801556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:06:08.802548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:08.802548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:08.802548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:06:08.802548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:08.802548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:06:08.802548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:08.802548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:08.802548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:08.802548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:08.802548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:08.802548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:08.802548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:08.802548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:08.802548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:08.802548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:08.802548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:08.802548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:08.802548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:08.803548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:08.803548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:08.803548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:06:08.803548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:06:08.803548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:06:08.803548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:06:08.803548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:06:08.803548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:06:08.803548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 08 02:06:08.803548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:08.809767 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 365/730] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 02:06:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:08.810589 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d460a58-4e07-4283-99a4-4ad6f21d21e1 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:08.817169 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 366/731] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:08 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:06:08.856308 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d31a6-b3a0-4a6e-a8e0-f05c4f05615b None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:08.921555 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d460a58-4e07-4283-99a4-4ad6f21d21e1 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:08.925910 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:08.972906 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51c41a-1099-48ed-948f-615ee5934944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:08.973551 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51c41a-1099-48ed-948f-615ee5934944 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:08.973892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51c41a-1099-48ed-948f-615ee5934944 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:08.974657 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51c41a-1099-48ed-948f-615ee5934944 None admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:08.975562 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe51c41a-1099-48ed-948f-615ee5934944 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:08.978894 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe51c41a-1099-48ed-948f-615ee5934944 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:08.978894 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe51c41a-1099-48ed-948f-615ee5934944 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:09.003001 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 366/732] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Aug 8 02:06:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:09.005064 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51c41a-1099-48ed-948f-615ee5934944 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:09.019401 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:09.058977 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d31a6-b3a0-4a6e-a8e0-f05c4f05615b None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:09.097659 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb82147-96e4-4f52-b467-11107d6d4771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:09.098636 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb82147-96e4-4f52-b467-11107d6d4771 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:09.099109 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb82147-96e4-4f52-b467-11107d6d4771 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:09.099624 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb82147-96e4-4f52-b467-11107d6d4771 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:09.113002 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb82147-96e4-4f52-b467-11107d6d4771 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:06:09.118487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-0bb82147-96e4-4f52-b467-11107d6d4771 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:06:09.118487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:09.118487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:09.118487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:09.118487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:09.118487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:09.118487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:09.118487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:09.118487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:09.118487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:09.118487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:09.118487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:09.118487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:06:09.118487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:06:09.118487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:06:09.118487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:06:09.119451 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:06:09.119451 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:06:09.119451 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:06:09.119451 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:06:09.119451 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:09.119451 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:09.119451 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:09.119451 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:09.119451 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:09.119451 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:09.119451 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:09.119451 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:09.119451 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:09.119451 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:09.119451 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:09.119451 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:09.120276 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:09.120276 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:09.120276 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:09.120276 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:09.120276 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:06:09.120276 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:06:09.120276 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:06:09.120276 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:06:09.120276 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:06:09.120276 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:06:09.120276 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:06:09.120276 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:09.123080 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 367/733] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 02:06:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:09.129808 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb82147-96e4-4f52-b467-11107d6d4771 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:09.177175 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51c41a-1099-48ed-948f-615ee5934944 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:09.242012 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb82147-96e4-4f52-b467-11107d6d4771 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:09.252612 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88b962-e7f4-4b7b-8823-ecc3ab79a7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:09.253244 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88b962-e7f4-4b7b-8823-ecc3ab79a7d7 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:09.253749 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88b962-e7f4-4b7b-8823-ecc3ab79a7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:09.253857 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88b962-e7f4-4b7b-8823-ecc3ab79a7d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:09.277642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a0816-3417-4a97-a8ff-df1d12cb6352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:09.278577 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a0816-3417-4a97-a8ff-df1d12cb6352 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:09.279052 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a0816-3417-4a97-a8ff-df1d12cb6352 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:09.279580 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a0816-3417-4a97-a8ff-df1d12cb6352 None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:09.280431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a0816-3417-4a97-a8ff-df1d12cb6352 None admin] RBAC: Adding query filter params (name=service) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:09.280924 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a0816-3417-4a97-a8ff-df1d12cb6352 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:09.282459 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a0816-3417-4a97-a8ff-df1d12cb6352 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:09.284095 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:09.292164 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 368/734] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 8 02:06:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:06:09.301120 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a0816-3417-4a97-a8ff-df1d12cb6352 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:09.312802 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:09.412100 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a0816-3417-4a97-a8ff-df1d12cb6352 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:09.424181 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88b962-e7f4-4b7b-8823-ecc3ab79a7d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:09.425653 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88b962-e7f4-4b7b-8823-ecc3ab79a7d7 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:09.450962 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700f6dd-d208-46cd-b1ea-8d484b7a5889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:09.451959 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700f6dd-d208-46cd-b1ea-8d484b7a5889 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:09.452439 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700f6dd-d208-46cd-b1ea-8d484b7a5889 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:09.452907 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700f6dd-d208-46cd-b1ea-8d484b7a5889 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:09.466655 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700f6dd-d208-46cd-b1ea-8d484b7a5889 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:09.468709 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700f6dd-d208-46cd-b1ea-8d484b7a5889 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:09.483866 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-3700f6dd-d208-46cd-b1ea-8d484b7a5889 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:09.483866 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:09.483866 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:09.483866 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:09.483866 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:09.483866 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:09.483866 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:09.483866 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:09.483866 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:09.483866 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:09.483866 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:09.483866 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:09.483866 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:09.483866 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:09.483866 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:09.483866 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:09.484851 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:09.484851 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:09.484851 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:09.484851 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:09.484851 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:09.484851 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:09.484851 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:09.484851 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:09.484851 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:09.484851 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:09.484851 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:09.484851 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:09.484851 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:09.484851 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:09.484851 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:09.484851 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:09.484851 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:09.485820 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:09.485820 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:09.485820 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:09.487988 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 369/735] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:06:09.494063 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700f6dd-d208-46cd-b1ea-8d484b7a5889 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:09.544430 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:09.613437 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700f6dd-d208-46cd-b1ea-8d484b7a5889 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:09.623527 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 367/736] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:06:09 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 08 02:06:09.625002 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a172442-d7cb-4d7d-ace9-9265e5fc66f8 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:09.625292 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a172442-d7cb-4d7d-ace9-9265e5fc66f8 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:09.625570 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a172442-d7cb-4d7d-ace9-9265e5fc66f8 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:09.631550 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 368/737] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:09.632427 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a172442-d7cb-4d7d-ace9-9265e5fc66f8 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:09.654427 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b14fe6-8042-4070-bfc1-5f72fb0c4d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:09.655430 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b14fe6-8042-4070-bfc1-5f72fb0c4d63 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:09.655922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b14fe6-8042-4070-bfc1-5f72fb0c4d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:09.656390 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b14fe6-8042-4070-bfc1-5f72fb0c4d63 None admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:09.657651 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b14fe6-8042-4070-bfc1-5f72fb0c4d63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:09.658421 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b14fe6-8042-4070-bfc1-5f72fb0c4d63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:09.660483 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b14fe6-8042-4070-bfc1-5f72fb0c4d63 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:09.676320 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 370/738] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:09.681875 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3288dc4-f738-44a0-b18d-81ce9f181b02 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:09.681875 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3288dc4-f738-44a0-b18d-81ce9f181b02 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:09.681875 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3288dc4-f738-44a0-b18d-81ce9f181b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:09.706651 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:09.708590 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-f3288dc4-f738-44a0-b18d-81ce9f181b02 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:09.710861 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-f3288dc4-f738-44a0-b18d-81ce9f181b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:09.761597 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a172442-d7cb-4d7d-ace9-9265e5fc66f8 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:09.784620 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 371/739] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:09 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:06:09.785519 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3288dc4-f738-44a0-b18d-81ce9f181b02 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:09.807368 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce36f17-a47d-4947-ac8a-a30b93e92761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:09.808080 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce36f17-a47d-4947-ac8a-a30b93e92761 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:09.808363 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce36f17-a47d-4947-ac8a-a30b93e92761 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:09.808641 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce36f17-a47d-4947-ac8a-a30b93e92761 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:09.819951 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce36f17-a47d-4947-ac8a-a30b93e92761 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:09.821458 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce36f17-a47d-4947-ac8a-a30b93e92761 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:09.833853 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:09.836385 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-3ce36f17-a47d-4947-ac8a-a30b93e92761 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:09.836385 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:09.836385 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:09.836385 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:09.836385 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:09.836385 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:09.836385 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:09.836385 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:09.836385 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:09.836385 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:09.836385 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:09.836385 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:09.836385 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:09.836385 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:09.836385 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:09.836385 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:09.841890 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:09.841890 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:09.841890 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:09.841890 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:09.841890 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:09.841890 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:09.841890 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:09.841890 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:09.841890 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:09.841890 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:09.841890 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:09.841890 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:09.841890 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:09.841890 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:09.841890 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:09.841890 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:09.841890 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:09.849276 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:09.849276 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:09.849276 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:09.849276 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 369/740] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:09.849276 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778dee3c-c336-4b26-b6b6-bd8a08aeecb9 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:09.849276 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778dee3c-c336-4b26-b6b6-bd8a08aeecb9 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:09.849276 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778dee3c-c336-4b26-b6b6-bd8a08aeecb9 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:09.849276 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 370/741] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:09.849276 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778dee3c-c336-4b26-b6b6-bd8a08aeecb9 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:09.904840 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3288dc4-f738-44a0-b18d-81ce9f181b02 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:09.941061 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51d031-f43c-4f43-b0a5-b5f64ff6cb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:09.941695 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51d031-f43c-4f43-b0a5-b5f64ff6cb61 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:09.941978 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51d031-f43c-4f43-b0a5-b5f64ff6cb61 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:09.942256 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51d031-f43c-4f43-b0a5-b5f64ff6cb61 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:09.949639 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51d031-f43c-4f43-b0a5-b5f64ff6cb61 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:09.953353 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51d031-f43c-4f43-b0a5-b5f64ff6cb61 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:09.958919 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778dee3c-c336-4b26-b6b6-bd8a08aeecb9 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:09.962708 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-8e51d031-f43c-4f43-b0a5-b5f64ff6cb61 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 02:06:09.962708 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:09.962708 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:09.962708 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:09.962708 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:09.962708 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:09.962708 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:09.962708 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:09.962708 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:09.962708 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:09.962708 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:09.962708 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:09.962708 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:06:09.962708 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:06:09.962708 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:06:09.962708 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:06:09.963666 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:09.963666 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:09.963666 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:06:09.963666 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:09.963666 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:06:09.963666 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:09.963666 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:09.963666 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:09.963666 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:09.963666 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:09.963666 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:09.963666 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:09.963666 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:09.963666 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:09.963666 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:09.963666 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:09.963666 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:09.963666 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:09.969740 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:09.969740 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:09.969740 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:06:09.969740 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:06:09.969740 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:06:09.969740 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:06:09.969740 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:06:09.969740 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:06:09.969740 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 02:06:09.969740 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:09.969740 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 372/742] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Aug 8 02:06:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:09.969740 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51d031-f43c-4f43-b0a5-b5f64ff6cb61 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:09.978582 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:10.001176 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b017ac4-3853-406e-acec-c55da9e9023f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:10.001885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b017ac4-3853-406e-acec-c55da9e9023f None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:10.002545 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b017ac4-3853-406e-acec-c55da9e9023f None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:10.002898 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b017ac4-3853-406e-acec-c55da9e9023f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:10.014915 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b017ac4-3853-406e-acec-c55da9e9023f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:06:10.020031 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-0b017ac4-3853-406e-acec-c55da9e9023f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:06:10.020031 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:10.020031 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:10.020031 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:10.020031 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:10.020031 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:10.020031 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:10.020031 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:10.020031 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:10.020031 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:10.020031 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:10.020031 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:10.020031 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:06:10.020031 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:06:10.020031 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:06:10.020031 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:06:10.020947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:06:10.020947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:06:10.020947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:06:10.020947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:06:10.020947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:10.020947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:10.020947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:10.020947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:10.020947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:10.020947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:10.020947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:10.020947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:10.020947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:10.020947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:10.020947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:10.020947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:10.021792 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:10.021792 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:10.021792 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:10.021792 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:10.021792 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:06:10.021792 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:06:10.021792 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:06:10.021792 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:06:10.021792 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:06:10.021792 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:06:10.021792 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:06:10.021792 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:10.021792 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 371/743] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 02:06:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:10.022942 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23889bc-f126-4697-9f25-007e08ac328a None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:10.022942 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23889bc-f126-4697-9f25-007e08ac328a None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:10.023189 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23889bc-f126-4697-9f25-007e08ac328a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:10.042247 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-b23889bc-f126-4697-9f25-007e08ac328a None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:10.043693 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-b23889bc-f126-4697-9f25-007e08ac328a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:10.070388 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:10.074669 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51d031-f43c-4f43-b0a5-b5f64ff6cb61 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:10.108504 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eab662-09f2-4c41-a652-56907ebf0c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:10.109107 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eab662-09f2-4c41-a652-56907ebf0c6d None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:10.109387 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eab662-09f2-4c41-a652-56907ebf0c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:10.109695 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eab662-09f2-4c41-a652-56907ebf0c6d None admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:10.110328 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eab662-09f2-4c41-a652-56907ebf0c6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:10.119415 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eab662-09f2-4c41-a652-56907ebf0c6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:10.119556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 372/744] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:10 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:06:10.119556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23889bc-f126-4697-9f25-007e08ac328a None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:10.119732 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eab662-09f2-4c41-a652-56907ebf0c6d None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:10.127507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 373/745] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:10.128991 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eab662-09f2-4c41-a652-56907ebf0c6d None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:10.215601 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23889bc-f126-4697-9f25-007e08ac328a None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:10.217186 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:10.227027 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eab662-09f2-4c41-a652-56907ebf0c6d None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:10.248394 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81218e1-d233-4890-bb2a-f3811dab080e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:10.248995 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81218e1-d233-4890-bb2a-f3811dab080e None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:10.249285 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81218e1-d233-4890-bb2a-f3811dab080e None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:10.249565 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81218e1-d233-4890-bb2a-f3811dab080e None admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:10.250283 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81218e1-d233-4890-bb2a-f3811dab080e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:10.250592 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81218e1-d233-4890-bb2a-f3811dab080e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:10.252041 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81218e1-d233-4890-bb2a-f3811dab080e None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:10.259780 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae4cfc-5136-41db-abf8-8988a85110a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:10.260372 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae4cfc-5136-41db-abf8-8988a85110a3 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:10.260656 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae4cfc-5136-41db-abf8-8988a85110a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:10.260929 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae4cfc-5136-41db-abf8-8988a85110a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:10.261575 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae4cfc-5136-41db-abf8-8988a85110a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:10.261876 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae4cfc-5136-41db-abf8-8988a85110a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:10.263205 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae4cfc-5136-41db-abf8-8988a85110a3 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:10.269350 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 373/746] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Aug 8 02:06:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:10.270351 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03540867-4772-419f-bca1-cefe5bc19041 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:10.270640 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03540867-4772-419f-bca1-cefe5bc19041 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:10.270918 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03540867-4772-419f-bca1-cefe5bc19041 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:10.272145 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 374/747] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:10.272838 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03540867-4772-419f-bca1-cefe5bc19041 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:10.277226 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 374/748] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:06:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:10.278119 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae4cfc-5136-41db-abf8-8988a85110a3 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:10.299585 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:10.372842 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03540867-4772-419f-bca1-cefe5bc19041 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:10.375993 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae4cfc-5136-41db-abf8-8988a85110a3 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:10.407056 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0570e68-e6ab-495d-ada9-06617163229d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:10.407709 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0570e68-e6ab-495d-ada9-06617163229d None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:10.407993 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0570e68-e6ab-495d-ada9-06617163229d None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:10.408268 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0570e68-e6ab-495d-ada9-06617163229d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:10.411243 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99990436-6df3-461d-9dd9-3e18a8b9d97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:10.411908 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99990436-6df3-461d-9dd9-3e18a8b9d97f None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:10.412191 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99990436-6df3-461d-9dd9-3e18a8b9d97f None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:10.412468 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99990436-6df3-461d-9dd9-3e18a8b9d97f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:10.413054 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99990436-6df3-461d-9dd9-3e18a8b9d97f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:10.414433 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99990436-6df3-461d-9dd9-3e18a8b9d97f None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:10.414775 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0570e68-e6ab-495d-ada9-06617163229d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:10.416229 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0570e68-e6ab-495d-ada9-06617163229d None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:10.423342 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-99990436-6df3-461d-9dd9-3e18a8b9d97f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 02:06:10.423342 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:10.423342 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:06:10.423342 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:06:10.423342 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:06:10.423342 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:06:10.423342 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:06:10.423342 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:10.423342 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 02:06:10.423342 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:10.423342 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:06:10.423342 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:10.423342 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:10.423342 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:10.423342 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:10.423342 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:10.423342 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:10.424511 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:10.424511 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:10.424511 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:10.424511 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:10.424511 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:10.424511 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:10.424511 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:06:10.424511 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:06:10.424511 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:06:10.424511 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:06:10.424511 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:10.424511 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:10.424511 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:10.424511 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:10.424511 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:10.424511 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:10.425669 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:10.425669 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:10.425669 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:10.425669 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:10.425669 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:10.425669 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:10.425669 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:10.425669 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:10.425669 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:10.425669 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:10.425669 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:06:10.425669 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:10.425669 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 02:06:10.425669 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:10.427044 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-c0570e68-e6ab-495d-ada9-06617163229d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:10.427044 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:10.427044 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:10.427044 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:10.427044 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:10.427044 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:10.427044 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:10.427044 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:10.427044 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:10.427044 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:10.427044 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:10.427044 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:10.427044 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:06:10.427044 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:06:10.427044 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:06:10.428080 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:06:10.428080 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:10.428080 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:10.428080 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:10.428080 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:10.428080 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:10.428080 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:10.428080 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:10.428080 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:10.428080 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:10.428080 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:10.428080 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:10.428080 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:10.428080 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:10.428080 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:10.428080 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:10.428080 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:10.435769 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:06:10.435769 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:06:10.435769 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:06:10.435769 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:06:10.435769 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:06:10.435769 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:06:10.435769 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:10.435769 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:10.435769 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 375/749] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:06:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:10.435769 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0570e68-e6ab-495d-ada9-06617163229d None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:10.436440 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 375/750] 10.222.0.23 () {56 vars in 1129 bytes} [Mon Aug 8 02:06:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:10.436440 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567e762-3dcb-4769-9f82-b0e3bf0db1b0 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:10.436440 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567e762-3dcb-4769-9f82-b0e3bf0db1b0 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:10.436440 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567e762-3dcb-4769-9f82-b0e3bf0db1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:10.449325 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-e567e762-3dcb-4769-9f82-b0e3bf0db1b0 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:10.450508 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-e567e762-3dcb-4769-9f82-b0e3bf0db1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:10.453671 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:10.515963 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 376/751] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:10 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 02:06:10.516707 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567e762-3dcb-4769-9f82-b0e3bf0db1b0 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:10.532996 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0570e68-e6ab-495d-ada9-06617163229d None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:10.539039 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:10.567221 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077bc8ce-b5e6-4d0d-bab0-9c8837d5ad9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:10.567858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bc8ce-b5e6-4d0d-bab0-9c8837d5ad9d None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:10.568146 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bc8ce-b5e6-4d0d-bab0-9c8837d5ad9d None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:10.568420 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bc8ce-b5e6-4d0d-bab0-9c8837d5ad9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:10.615426 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567e762-3dcb-4769-9f82-b0e3bf0db1b0 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:10.634755 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077bc8ce-b5e6-4d0d-bab0-9c8837d5ad9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:10.636260 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077bc8ce-b5e6-4d0d-bab0-9c8837d5ad9d None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:10.648213 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da851ac-8cd8-454e-9127-9b6dadca792d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:10.649076 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da851ac-8cd8-454e-9127-9b6dadca792d None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:10.649425 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da851ac-8cd8-454e-9127-9b6dadca792d None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:10.649706 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da851ac-8cd8-454e-9127-9b6dadca792d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:10.655908 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:10.659511 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da851ac-8cd8-454e-9127-9b6dadca792d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:10.660919 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da851ac-8cd8-454e-9127-9b6dadca792d None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:10.675439 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-0da851ac-8cd8-454e-9127-9b6dadca792d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:10.675439 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:10.675439 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:10.675439 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:10.675439 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:10.675439 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:10.675439 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:10.675439 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:10.675439 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:10.675439 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:10.675439 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:10.675439 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:10.675439 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:10.675439 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:10.675439 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:10.675439 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:10.676465 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:10.676465 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:10.676465 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:10.676465 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:10.676465 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:10.676465 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:10.676465 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:10.676465 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:10.676465 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:10.676465 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:10.676465 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:10.676465 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:10.676465 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:10.676465 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:10.676465 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:10.676465 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:10.676465 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:10.677359 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:10.677359 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:10.677359 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:10.677359 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 377/752] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:10.677359 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da851ac-8cd8-454e-9127-9b6dadca792d None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:10.735253 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 376/753] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:06:10 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 02:06:10.735950 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077bc8ce-b5e6-4d0d-bab0-9c8837d5ad9d None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:10.748914 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:10.781878 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da851ac-8cd8-454e-9127-9b6dadca792d None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:10.815564 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc75b9-1d2c-4b50-9564-ca03f18deb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:10.816171 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc75b9-1d2c-4b50-9564-ca03f18deb5d None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:10.816451 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc75b9-1d2c-4b50-9564-ca03f18deb5d None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:10.816728 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc75b9-1d2c-4b50-9564-ca03f18deb5d None admin] PATH_INFO: `/v3/services` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:10.817359 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc75b9-1d2c-4b50-9564-ca03f18deb5d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:10.817667 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc75b9-1d2c-4b50-9564-ca03f18deb5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:10.819014 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc75b9-1d2c-4b50-9564-ca03f18deb5d None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:10.823857 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 378/754] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Aug 8 02:06:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:10.824600 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc75b9-1d2c-4b50-9564-ca03f18deb5d None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:10.840554 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077bc8ce-b5e6-4d0d-bab0-9c8837d5ad9d None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:10.859556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:10.873276 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1b717-fc40-44d1-b7ff-b3335a8d8a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:10.874159 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1b717-fc40-44d1-b7ff-b3335a8d8a9c None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:10.874438 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1b717-fc40-44d1-b7ff-b3335a8d8a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:10.874711 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1b717-fc40-44d1-b7ff-b3335a8d8a9c None admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:10.875417 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1b717-fc40-44d1-b7ff-b3335a8d8a9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:10.875723 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1b717-fc40-44d1-b7ff-b3335a8d8a9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:10.877132 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1b717-fc40-44d1-b7ff-b3335a8d8a9c None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:10.889009 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 377/755] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 02:06:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:10.889769 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1b717-fc40-44d1-b7ff-b3335a8d8a9c None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:10.926658 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc75b9-1d2c-4b50-9564-ca03f18deb5d None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:10.954718 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:10.960829 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f33906-7892-44bf-b2f4-db0599824cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:10.962029 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f33906-7892-44bf-b2f4-db0599824cde None admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:10.962381 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f33906-7892-44bf-b2f4-db0599824cde None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:10.962650 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f33906-7892-44bf-b2f4-db0599824cde None admin] PATH_INFO: `/v3/services` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:10.963443 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f33906-7892-44bf-b2f4-db0599824cde None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:10.964776 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f33906-7892-44bf-b2f4-db0599824cde None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:10.985646 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1b717-fc40-44d1-b7ff-b3335a8d8a9c None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:11.018393 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b0a93-9816-490c-82f7-b863e8bbaf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:11.019000 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b0a93-9816-490c-82f7-b863e8bbaf6b None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:11.019283 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b0a93-9816-490c-82f7-b863e8bbaf6b None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:11.019586 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b0a93-9816-490c-82f7-b863e8bbaf6b None admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:11.020219 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b0a93-9816-490c-82f7-b863e8bbaf6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:11.020524 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b0a93-9816-490c-82f7-b863e8bbaf6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:11.021877 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b0a93-9816-490c-82f7-b863e8bbaf6b None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:11.032743 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 378/756] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:11.033447 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b0a93-9816-490c-82f7-b863e8bbaf6b None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:11.072509 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 379/757] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Aug 8 02:06:10 2022] POST /identity/v3/services => generated 240 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:06:11.073375 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f33906-7892-44bf-b2f4-db0599824cde None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:11.073488 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:11.142577 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b0a93-9816-490c-82f7-b863e8bbaf6b None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:11.185168 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf90b84-ef89-4d32-b4d4-abd05c60a12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:11.185804 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf90b84-ef89-4d32-b4d4-abd05c60a12a None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:11.186082 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf90b84-ef89-4d32-b4d4-abd05c60a12a None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:11.186356 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf90b84-ef89-4d32-b4d4-abd05c60a12a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:11.198255 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf90b84-ef89-4d32-b4d4-abd05c60a12a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:11.199841 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf90b84-ef89-4d32-b4d4-abd05c60a12a None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:11.203567 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f33906-7892-44bf-b2f4-db0599824cde None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:11.214963 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-bbf90b84-ef89-4d32-b4d4-abd05c60a12a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:11.214963 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:11.214963 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:11.214963 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:11.214963 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:11.214963 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:11.214963 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:11.214963 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:11.214963 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:11.214963 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:11.214963 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:11.214963 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:11.214963 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:11.214963 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:11.214963 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:11.214963 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:11.216536 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:11.216536 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:11.216536 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:11.216536 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:11.216536 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:11.216536 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:11.216536 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:11.216536 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:11.216536 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:11.216536 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:11.216536 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:11.216536 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:11.216536 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:11.216536 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:11.216536 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:11.216536 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:11.216536 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:11.217427 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:11.217427 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:11.217427 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:11.219337 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 379/758] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:11.219337 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf90b84-ef89-4d32-b4d4-abd05c60a12a None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:11.244055 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631f813-fe9c-43b0-a8bd-6e18d8f9624d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:11.245072 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631f813-fe9c-43b0-a8bd-6e18d8f9624d None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:11.245858 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631f813-fe9c-43b0-a8bd-6e18d8f9624d None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:11.245858 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631f813-fe9c-43b0-a8bd-6e18d8f9624d None admin] PATH_INFO: `/v3/services` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:11.246255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631f813-fe9c-43b0-a8bd-6e18d8f9624d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:11.246563 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631f813-fe9c-43b0-a8bd-6e18d8f9624d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:11.248016 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631f813-fe9c-43b0-a8bd-6e18d8f9624d None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:11.254738 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 380/759] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Aug 8 02:06:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:11.255778 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631f813-fe9c-43b0-a8bd-6e18d8f9624d None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:11.316404 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:11.316592 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:11.328519 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf90b84-ef89-4d32-b4d4-abd05c60a12a None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:11.361602 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631f813-fe9c-43b0-a8bd-6e18d8f9624d None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:11.363041 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a602d2-b1cb-45d8-82b5-376c9a9cd87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:11.363673 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a602d2-b1cb-45d8-82b5-376c9a9cd87d None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:11.363951 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a602d2-b1cb-45d8-82b5-376c9a9cd87d None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:11.364222 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a602d2-b1cb-45d8-82b5-376c9a9cd87d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:11.364939 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a602d2-b1cb-45d8-82b5-376c9a9cd87d None admin] RBAC: Adding query filter params (role.id=84da65a75e544d1191ec53cb6b05aa73, scope.project.id=ebe178f5bce64a009bf690031676c89f, user.id=6c212009b6a44e1bad92769630116408) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:11.365244 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a602d2-b1cb-45d8-82b5-376c9a9cd87d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:11.366667 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a602d2-b1cb-45d8-82b5-376c9a9cd87d None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:11.383562 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 380/760] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:06:11 2022] GET /identity/v3/role_assignments?user.id=6c212009b6a44e1bad92769630116408&scope.project.id=ebe178f5bce64a009bf690031676c89f&role.id=84da65a75e544d1191ec53cb6b05aa73 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:11.383562 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a602d2-b1cb-45d8-82b5-376c9a9cd87d None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:11.417541 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa1c10-612a-478f-9775-00d65f046db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:11.418464 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa1c10-612a-478f-9775-00d65f046db3 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:11.418745 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa1c10-612a-478f-9775-00d65f046db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:11.419024 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa1c10-612a-478f-9775-00d65f046db3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:11.430563 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa1c10-612a-478f-9775-00d65f046db3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:11.432329 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa1c10-612a-478f-9775-00d65f046db3 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:11.448493 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-2cfa1c10-612a-478f-9775-00d65f046db3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:06:11.448493 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:11.448493 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:11.448493 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:11.448493 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:11.448493 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:11.448493 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:11.448493 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:11.448493 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:11.448493 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:11.448493 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:11.448493 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:11.448493 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:06:11.448493 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:06:11.448493 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:06:11.448493 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:06:11.449510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:11.449510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:11.449510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:06:11.449510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:11.449510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:06:11.449510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:11.449510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:11.449510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:11.449510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:11.449510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:11.449510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:11.449510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:11.449510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:11.449510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:11.449510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:11.449510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:11.449510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:11.449510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:11.450436 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:11.450436 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:11.450436 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:06:11.450436 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:06:11.450436 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:06:11.450436 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:06:11.450436 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:06:11.450436 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:06:11.450436 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:06:11.450436 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:11.451796 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 381/761] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Aug 8 02:06:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:11.452859 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa1c10-612a-478f-9775-00d65f046db3 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:11.510294 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a602d2-b1cb-45d8-82b5-376c9a9cd87d None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:11.559102 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5bd193-bf12-4b3f-9f82-4a5134d9f6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:11.559763 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5bd193-bf12-4b3f-9f82-4a5134d9f6ec None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:11.560048 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5bd193-bf12-4b3f-9f82-4a5134d9f6ec None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:11.560325 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5bd193-bf12-4b3f-9f82-4a5134d9f6ec None admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:11.560978 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5bd193-bf12-4b3f-9f82-4a5134d9f6ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:11.561460 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5bd193-bf12-4b3f-9f82-4a5134d9f6ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:11.562868 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5bd193-bf12-4b3f-9f82-4a5134d9f6ec None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:11.587253 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 381/762] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:11.588126 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5bd193-bf12-4b3f-9f82-4a5134d9f6ec None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:11.592645 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa1c10-612a-478f-9775-00d65f046db3 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:11.606512 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:11.607522 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:11.636569 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bde222-877b-41ca-ab39-2f389a3efe05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:11.637505 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bde222-877b-41ca-ab39-2f389a3efe05 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:11.637937 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bde222-877b-41ca-ab39-2f389a3efe05 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:11.638357 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bde222-877b-41ca-ab39-2f389a3efe05 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:11.639255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bde222-877b-41ca-ab39-2f389a3efe05 None admin] RBAC: Adding query filter params (interface=public, service_id=979e041b3023451eb1d2e8ceca5895d9, region_id=RegionOne) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:11.639774 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bde222-877b-41ca-ab39-2f389a3efe05 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:11.643438 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bde222-877b-41ca-ab39-2f389a3efe05 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:11.656309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 382/763] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Aug 8 02:06:11 2022] GET /identity/v3/endpoints?service_id=979e041b3023451eb1d2e8ceca5895d9&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:11.657517 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bde222-877b-41ca-ab39-2f389a3efe05 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:11.699771 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5bd193-bf12-4b3f-9f82-4a5134d9f6ec None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:11.735518 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a54ebe-2e02-4068-a8ca-9c310cbfbe33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:11.736135 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a54ebe-2e02-4068-a8ca-9c310cbfbe33 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:11.736421 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a54ebe-2e02-4068-a8ca-9c310cbfbe33 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:11.736701 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a54ebe-2e02-4068-a8ca-9c310cbfbe33 None admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:11.737432 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a54ebe-2e02-4068-a8ca-9c310cbfbe33 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:11.737743 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a54ebe-2e02-4068-a8ca-9c310cbfbe33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:11.739313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a54ebe-2e02-4068-a8ca-9c310cbfbe33 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:11.762435 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 382/764] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Aug 8 02:06:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:11.762435 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a54ebe-2e02-4068-a8ca-9c310cbfbe33 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:11.771289 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bde222-877b-41ca-ab39-2f389a3efe05 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:11.809346 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed5372-3ed0-4f98-bdda-ee6c37a0bf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:11.810261 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed5372-3ed0-4f98-bdda-ee6c37a0bf31 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:11.810693 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed5372-3ed0-4f98-bdda-ee6c37a0bf31 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:11.811148 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed5372-3ed0-4f98-bdda-ee6c37a0bf31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:11.818830 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed5372-3ed0-4f98-bdda-ee6c37a0bf31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:11.820669 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed5372-3ed0-4f98-bdda-ee6c37a0bf31 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:11.831922 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:11.833633 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-0aed5372-3ed0-4f98-bdda-ee6c37a0bf31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:11.833633 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:11.833633 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:11.833633 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:11.833633 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:11.833633 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:11.833633 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:11.833633 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:11.833633 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:11.833633 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:11.833633 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:11.833633 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:11.833633 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:06:11.833633 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:06:11.833633 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:06:11.834694 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:06:11.834694 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:11.834694 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:11.834694 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:11.834694 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:11.834694 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:11.834694 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:11.834694 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:11.834694 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:11.834694 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:11.834694 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:11.834694 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:11.834694 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:11.834694 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:11.834694 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:11.834694 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:11.834694 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:11.835814 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:06:11.835814 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:06:11.835814 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:06:11.835814 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:06:11.835814 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:06:11.835814 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:06:11.835814 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:11.835814 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:11.838387 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 383/765] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:06:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:11.839316 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed5372-3ed0-4f98-bdda-ee6c37a0bf31 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:11.870638 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a54ebe-2e02-4068-a8ca-9c310cbfbe33 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:11.895722 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:11.914602 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ae0e3-c758-4050-ba95-e472b9b934f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:11.915825 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ae0e3-c758-4050-ba95-e472b9b934f1 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:11.916216 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ae0e3-c758-4050-ba95-e472b9b934f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:11.916633 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ae0e3-c758-4050-ba95-e472b9b934f1 None admin] PATH_INFO: `/v3/services` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:11.917369 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ae0e3-c758-4050-ba95-e472b9b934f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:11.919559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ae0e3-c758-4050-ba95-e472b9b934f1 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:11.926656 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 383/766] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Aug 8 02:06:11 2022] GET /identity/v3/services => generated 772 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:11.927879 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ae0e3-c758-4050-ba95-e472b9b934f1 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:11.995951 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed5372-3ed0-4f98-bdda-ee6c37a0bf31 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:12.079810 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412cd31-1f97-43f2-a8b7-74bcc424c3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:12.082805 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412cd31-1f97-43f2-a8b7-74bcc424c3c3 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:12.083393 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412cd31-1f97-43f2-a8b7-74bcc424c3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:12.084015 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412cd31-1f97-43f2-a8b7-74bcc424c3c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:12.091117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ae0e3-c758-4050-ba95-e472b9b934f1 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:12.113258 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8412cd31-1f97-43f2-a8b7-74bcc424c3c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:12.115050 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8412cd31-1f97-43f2-a8b7-74bcc424c3c3 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:12.136503 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-8412cd31-1f97-43f2-a8b7-74bcc424c3c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:12.136503 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:12.136503 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:12.136503 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:12.136503 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:12.136503 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:12.136503 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:12.136503 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:12.136503 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:12.136503 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:12.136503 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:12.136503 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:12.136503 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:12.136503 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:12.136503 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:12.136503 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:12.137510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:12.137510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:12.137510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:12.137510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:12.137510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:12.137510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:12.137510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:12.137510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:12.137510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:12.137510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:12.137510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:12.137510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:12.137510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:12.137510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:12.137510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:12.137510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:12.137510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:12.138446 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:12.138446 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:12.138446 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:12.140607 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 384/767] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:12.148870 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412cd31-1f97-43f2-a8b7-74bcc424c3c3 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:12.156064 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004033d1-f4c2-4c43-877f-7cf0feb4e356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:12.156699 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004033d1-f4c2-4c43-877f-7cf0feb4e356 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:12.156987 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004033d1-f4c2-4c43-877f-7cf0feb4e356 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:12.157267 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004033d1-f4c2-4c43-877f-7cf0feb4e356 None admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:12.161205 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004033d1-f4c2-4c43-877f-7cf0feb4e356 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:12.161205 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004033d1-f4c2-4c43-877f-7cf0feb4e356 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:12.161205 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004033d1-f4c2-4c43-877f-7cf0feb4e356 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:12.163024 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:12.180068 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 384/768] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 02:06:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:12.183883 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004033d1-f4c2-4c43-877f-7cf0feb4e356 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:12.255496 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:12.277964 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412cd31-1f97-43f2-a8b7-74bcc424c3c3 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:12.313660 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c008649-c0f4-4672-88aa-27a1211cace3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:12.314272 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c008649-c0f4-4672-88aa-27a1211cace3 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:12.314552 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c008649-c0f4-4672-88aa-27a1211cace3 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:12.314824 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c008649-c0f4-4672-88aa-27a1211cace3 None admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:12.315506 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c008649-c0f4-4672-88aa-27a1211cace3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:12.315814 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c008649-c0f4-4672-88aa-27a1211cace3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:12.317177 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c008649-c0f4-4672-88aa-27a1211cace3 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:12.329623 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 385/769] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:12.335040 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c008649-c0f4-4672-88aa-27a1211cace3 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:12.385295 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004033d1-f4c2-4c43-877f-7cf0feb4e356 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:12.457886 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c008649-c0f4-4672-88aa-27a1211cace3 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:12.459842 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff80ec6-c09e-4de1-9178-a5cf5b9fa231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:12.460451 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff80ec6-c09e-4de1-9178-a5cf5b9fa231 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:12.460728 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff80ec6-c09e-4de1-9178-a5cf5b9fa231 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:12.460997 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff80ec6-c09e-4de1-9178-a5cf5b9fa231 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:12.462247 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff80ec6-c09e-4de1-9178-a5cf5b9fa231 None admin] RBAC: Adding query filter params (role.id=071080f2ecc948319b313f2379ea2b97, scope.project.id=ebe178f5bce64a009bf690031676c89f, user.id=1d39439278814d4faac4cfb1e71aa4fc) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:12.462551 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff80ec6-c09e-4de1-9178-a5cf5b9fa231 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:12.463995 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff80ec6-c09e-4de1-9178-a5cf5b9fa231 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:12.476162 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 385/770] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:06:12 2022] GET /identity/v3/role_assignments?user.id=1d39439278814d4faac4cfb1e71aa4fc&scope.project.id=ebe178f5bce64a009bf690031676c89f&role.id=071080f2ecc948319b313f2379ea2b97 => generated 259 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:12.518235 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168db3a-bf8a-4b5b-9d9b-b946370bae3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:12.518886 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168db3a-bf8a-4b5b-9d9b-b946370bae3d None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:12.519163 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168db3a-bf8a-4b5b-9d9b-b946370bae3d None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:12.519459 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168db3a-bf8a-4b5b-9d9b-b946370bae3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:12.536807 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168db3a-bf8a-4b5b-9d9b-b946370bae3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:12.538282 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168db3a-bf8a-4b5b-9d9b-b946370bae3d None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:12.561711 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-5168db3a-bf8a-4b5b-9d9b-b946370bae3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:12.561711 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:12.561711 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:12.561711 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:12.561711 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:12.561711 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:12.561711 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:12.561711 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:12.561711 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:12.561711 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:12.561711 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:12.561711 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:12.561711 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:06:12.561711 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:06:12.561711 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:06:12.562676 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:06:12.562676 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:12.562676 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:12.562676 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:12.562676 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:12.562676 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:12.562676 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:12.562676 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:12.562676 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:12.562676 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:12.562676 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:12.562676 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:12.562676 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:12.562676 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:12.562676 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:12.562676 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:12.562676 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:12.563588 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:06:12.563588 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:06:12.563588 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:06:12.563588 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:06:12.563588 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:06:12.563588 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:06:12.563588 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:12.563588 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:12.564031 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 386/771] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:06:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:06:12.568695 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff80ec6-c09e-4de1-9178-a5cf5b9fa231 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:12.651653 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:12.699244 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff80ec6-c09e-4de1-9178-a5cf5b9fa231 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:12.743326 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafe690-feb0-4215-913f-7e2f4fbeccb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:12.743962 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafe690-feb0-4215-913f-7e2f4fbeccb2 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:12.744238 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafe690-feb0-4215-913f-7e2f4fbeccb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:12.744506 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafe690-feb0-4215-913f-7e2f4fbeccb2 None admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:12.745201 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bafe690-feb0-4215-913f-7e2f4fbeccb2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:12.745505 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bafe690-feb0-4215-913f-7e2f4fbeccb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:12.746922 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bafe690-feb0-4215-913f-7e2f4fbeccb2 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:12.763921 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 386/772] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 02:06:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:12.765324 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168db3a-bf8a-4b5b-9d9b-b946370bae3d None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:12.781753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:12.896715 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168db3a-bf8a-4b5b-9d9b-b946370bae3d None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:12.934840 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15d8d7-d67f-4bb1-8f4c-d65da21f31b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:12.935522 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15d8d7-d67f-4bb1-8f4c-d65da21f31b0 None admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:12.935801 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15d8d7-d67f-4bb1-8f4c-d65da21f31b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:12.936085 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15d8d7-d67f-4bb1-8f4c-d65da21f31b0 None admin] PATH_INFO: `/v3/projects/ebe178f5bce64a009bf690031676c89f/users/5d89e0c7d62444e4b75d3f4da49b2bc4/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:12.940480 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15d8d7-d67f-4bb1-8f4c-d65da21f31b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebe178f5bce64a009bf690031676c89f, user_id=5d89e0c7d62444e4b75d3f4da49b2bc4, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:12.941884 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15d8d7-d67f-4bb1-8f4c-d65da21f31b0 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:13.044514 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 387/773] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 02:06:12 2022] PUT /identity/v3/projects/ebe178f5bce64a009bf690031676c89f/users/5d89e0c7d62444e4b75d3f4da49b2bc4/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:06:13.209911 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6245f0-84ec-46ca-a67a-ba087936ea28 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:13.210584 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6245f0-84ec-46ca-a67a-ba087936ea28 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:13.211822 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6245f0-84ec-46ca-a67a-ba087936ea28 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:13.213763 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 387/774] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:13.219592 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc32fe-5cf1-4e46-a01e-82bd79a64de9 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:13.220461 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc32fe-5cf1-4e46-a01e-82bd79a64de9 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:13.220973 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc32fe-5cf1-4e46-a01e-82bd79a64de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:13.241910 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-dddc32fe-5cf1-4e46-a01e-82bd79a64de9 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:13.244090 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-dddc32fe-5cf1-4e46-a01e-82bd79a64de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:13.314130 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:13.319314 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 388/775] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:13.345028 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6245f0-84ec-46ca-a67a-ba087936ea28 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:13.479973 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6245f0-84ec-46ca-a67a-ba087936ea28 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:13.517984 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:13.532943 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7914336-8679-4c15-b421-da734a56a283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:13.533585 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7914336-8679-4c15-b421-da734a56a283 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:13.533872 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7914336-8679-4c15-b421-da734a56a283 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:13.534149 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7914336-8679-4c15-b421-da734a56a283 None admin] PATH_INFO: `/v3/services/network` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:13.534736 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7914336-8679-4c15-b421-da734a56a283 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:13.536242 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7914336-8679-4c15-b421-da734a56a283 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:13.547053 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-d7914336-8679-4c15-b421-da734a56a283 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 02:06:13.547053 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:13.547053 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:06:13.547053 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:06:13.547053 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:06:13.547053 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:06:13.547053 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:06:13.547053 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:13.547053 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 02:06:13.547053 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:13.547053 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:06:13.547053 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:13.547053 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:13.547053 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:13.547053 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:13.547053 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:13.547053 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:13.548085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:13.548085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:13.548085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:13.548085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:13.548085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:13.548085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:13.548085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:06:13.548085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:06:13.548085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:06:13.548085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:06:13.548085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:13.548085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:13.548085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:13.548085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:13.548085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:13.548085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:13.548947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:13.548947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:13.548947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:13.548947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:13.548947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:13.548947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:13.548947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:13.548947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:13.548947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:13.548947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:13.548947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:06:13.548947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:13.548947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 02:06:13.548947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:13.548947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 388/776] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:06:13 2022] GET /identity/v3/services/network => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:13.554462 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc32fe-5cf1-4e46-a01e-82bd79a64de9 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:13.677339 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc32fe-5cf1-4e46-a01e-82bd79a64de9 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:13.713114 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8b132-d9de-4c33-aa0d-1377eaea9cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:13.713719 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8b132-d9de-4c33-aa0d-1377eaea9cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:13.714003 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8b132-d9de-4c33-aa0d-1377eaea9cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:13.714280 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8b132-d9de-4c33-aa0d-1377eaea9cd4 None admin] PATH_INFO: `/v3/services` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:13.714913 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8b132-d9de-4c33-aa0d-1377eaea9cd4 None admin] RBAC: Adding query filter params (name=network) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:13.715219 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8b132-d9de-4c33-aa0d-1377eaea9cd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:13.716607 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8b132-d9de-4c33-aa0d-1377eaea9cd4 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:13.725224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 389/777] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Aug 8 02:06:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:13.731077 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7914336-8679-4c15-b421-da734a56a283 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:13.850667 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7914336-8679-4c15-b421-da734a56a283 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:13.873648 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e05069-ff2d-446f-bdb9-fdde1b22c61f None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:13.873968 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e05069-ff2d-446f-bdb9-fdde1b22c61f None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:13.874208 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e05069-ff2d-446f-bdb9-fdde1b22c61f None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:13.875770 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 390/778] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:06:13.890944 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89858d71-ed86-4436-92cf-5a4556b02e5c None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:13.891220 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89858d71-ed86-4436-92cf-5a4556b02e5c None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:13.891517 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89858d71-ed86-4436-92cf-5a4556b02e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:13.912837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c0a6f-703a-4e24-a605-4aeeb1221fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:13.913793 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c0a6f-703a-4e24-a605-4aeeb1221fcf None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:13.914780 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c0a6f-703a-4e24-a605-4aeeb1221fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:13.915253 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c0a6f-703a-4e24-a605-4aeeb1221fcf None admin] PATH_INFO: `/v3/services` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:13.916173 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c0a6f-703a-4e24-a605-4aeeb1221fcf None admin] RBAC: Adding query filter params (type=network) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:13.916684 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c0a6f-703a-4e24-a605-4aeeb1221fcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:13.918314 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c0a6f-703a-4e24-a605-4aeeb1221fcf None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:13.923469 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-89858d71-ed86-4436-92cf-5a4556b02e5c None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:13.924676 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-89858d71-ed86-4436-92cf-5a4556b02e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:13.926038 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 389/779] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Aug 8 02:06:13 2022] GET /identity/v3/services?type=network => generated 350 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:13.932518 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c0a6f-703a-4e24-a605-4aeeb1221fcf None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:13.995851 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:14.057503 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:14.072311 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 391/780] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:14.076554 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c0a6f-703a-4e24-a605-4aeeb1221fcf None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:14.096290 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89858d71-ed86-4436-92cf-5a4556b02e5c None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:14.147980 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3e2f4-d0ca-48e1-8dd6-3dfcb9672cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:14.149024 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3e2f4-d0ca-48e1-8dd6-3dfcb9672cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:14.149512 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3e2f4-d0ca-48e1-8dd6-3dfcb9672cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:14.150016 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3e2f4-d0ca-48e1-8dd6-3dfcb9672cd7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:14.150924 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c3e2f4-d0ca-48e1-8dd6-3dfcb9672cd7 None admin] RBAC: Adding query filter params (interface=public, service_id=7a683a1f0be44daeb4d0deedb5043abd, region_id=RegionOne) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:14.151586 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c3e2f4-d0ca-48e1-8dd6-3dfcb9672cd7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:14.153303 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c3e2f4-d0ca-48e1-8dd6-3dfcb9672cd7 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:14.162108 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 390/781] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Aug 8 02:06:13 2022] GET /identity/v3/endpoints?service_id=7a683a1f0be44daeb4d0deedb5043abd&interface=public®ion_id=RegionOne => generated 194 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:06:14.169292 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3e2f4-d0ca-48e1-8dd6-3dfcb9672cd7 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:14.274773 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89858d71-ed86-4436-92cf-5a4556b02e5c None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:14.348459 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3e2f4-d0ca-48e1-8dd6-3dfcb9672cd7 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:14.360051 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff7a7f-739f-4476-ad06-8683806d5af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:14.360697 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff7a7f-739f-4476-ad06-8683806d5af9 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:14.360985 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff7a7f-739f-4476-ad06-8683806d5af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:14.361248 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:14.361356 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff7a7f-739f-4476-ad06-8683806d5af9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:14.390393 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff7a7f-739f-4476-ad06-8683806d5af9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:06:14.395011 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-68ff7a7f-739f-4476-ad06-8683806d5af9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:06:14.395011 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:14.395011 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:14.395011 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:14.395011 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:14.395011 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:14.395011 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:14.395011 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:14.395011 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:14.395011 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:14.395011 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:14.395011 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:14.395011 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:06:14.395011 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:06:14.395011 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:06:14.395011 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:06:14.395964 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:06:14.395964 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:06:14.395964 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:06:14.395964 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:06:14.395964 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:14.395964 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:14.395964 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:14.395964 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:14.395964 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:14.395964 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:14.395964 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:14.395964 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:14.395964 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:14.395964 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:14.395964 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:14.395964 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:14.396806 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:14.396806 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:14.396806 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:14.396806 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:14.396806 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:06:14.396806 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:06:14.396806 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:06:14.396806 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:06:14.396806 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:06:14.396806 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:06:14.396806 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:06:14.396806 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:14.399669 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b175b4-ca84-44ac-9b47-a52d45ef7a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:14.400495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b175b4-ca84-44ac-9b47-a52d45ef7a86 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:14.400957 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b175b4-ca84-44ac-9b47-a52d45ef7a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:14.401436 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b175b4-ca84-44ac-9b47-a52d45ef7a86 None admin] PATH_INFO: `/v3/services` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:14.401740 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 392/782] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 02:06:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:06:14.402546 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b175b4-ca84-44ac-9b47-a52d45ef7a86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:14.403000 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff7a7f-739f-4476-ad06-8683806d5af9 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:14.404474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b175b4-ca84-44ac-9b47-a52d45ef7a86 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:14.410609 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 391/783] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Aug 8 02:06:14 2022] GET /identity/v3/services => generated 772 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:14.501445 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:14.549032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff7a7f-739f-4476-ad06-8683806d5af9 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:14.585629 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc683969-1c2a-43b7-b7a4-4bba781950a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:14.586307 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc683969-1c2a-43b7-b7a4-4bba781950a9 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:14.586586 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc683969-1c2a-43b7-b7a4-4bba781950a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:14.586862 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc683969-1c2a-43b7-b7a4-4bba781950a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:14.587554 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc683969-1c2a-43b7-b7a4-4bba781950a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:14.587859 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc683969-1c2a-43b7-b7a4-4bba781950a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:14.589220 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc683969-1c2a-43b7-b7a4-4bba781950a9 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:14.598294 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 393/784] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:06:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:14.604414 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b175b4-ca84-44ac-9b47-a52d45ef7a86 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:14.684155 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e696c-e794-4025-972c-2ba69b7f2468 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:14.684501 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e696c-e794-4025-972c-2ba69b7f2468 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:14.684769 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e696c-e794-4025-972c-2ba69b7f2468 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:14.686119 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 394/785] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:06:14.691422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34bab7-5714-4678-9ebe-84dd4d235a09 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:14.691827 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34bab7-5714-4678-9ebe-84dd4d235a09 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:14.692094 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34bab7-5714-4678-9ebe-84dd4d235a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:14.717179 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-7c34bab7-5714-4678-9ebe-84dd4d235a09 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:14.718600 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-7c34bab7-5714-4678-9ebe-84dd4d235a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:14.735648 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b175b4-ca84-44ac-9b47-a52d45ef7a86 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:14.782666 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12070ee-87f3-4908-b209-0f2458e54f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:14.783846 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12070ee-87f3-4908-b209-0f2458e54f4b None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:14.784400 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12070ee-87f3-4908-b209-0f2458e54f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:14.784880 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12070ee-87f3-4908-b209-0f2458e54f4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:14.803999 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 395/786] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:06:14.812050 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12070ee-87f3-4908-b209-0f2458e54f4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:14.813736 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12070ee-87f3-4908-b209-0f2458e54f4b None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:14.822660 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34bab7-5714-4678-9ebe-84dd4d235a09 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:14.840202 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-a12070ee-87f3-4908-b209-0f2458e54f4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:14.840202 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:14.840202 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:14.840202 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:14.840202 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:14.840202 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:14.840202 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:14.840202 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:14.840202 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:14.840202 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:14.840202 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:14.840202 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:14.840202 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:14.840202 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:14.840202 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:14.840202 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:14.841195 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:14.841195 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:14.841195 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:14.841195 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:14.841195 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:14.841195 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:14.841195 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:14.841195 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:14.841195 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:14.841195 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:14.841195 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:14.841195 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:14.841195 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:14.841195 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:14.841195 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:14.841195 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:14.841195 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:14.842109 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:14.842109 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:14.842109 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:14.851729 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 392/787] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:14.853136 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12070ee-87f3-4908-b209-0f2458e54f4b None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:14.873323 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:14.902406 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:14.932904 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34bab7-5714-4678-9ebe-84dd4d235a09 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:14.970999 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4a404c-352c-42a9-8c4d-0218a7f204bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:14.971896 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a404c-352c-42a9-8c4d-0218a7f204bf None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:14.972178 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a404c-352c-42a9-8c4d-0218a7f204bf None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:14.972451 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a404c-352c-42a9-8c4d-0218a7f204bf None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:14.973038 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4a404c-352c-42a9-8c4d-0218a7f204bf None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:14.974570 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4a404c-352c-42a9-8c4d-0218a7f204bf None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:14.984675 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-ea4a404c-352c-42a9-8c4d-0218a7f204bf None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 02:06:14.984675 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:14.984675 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:06:14.984675 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:06:14.984675 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:06:14.984675 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:06:14.984675 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:06:14.984675 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:14.984675 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 02:06:14.984675 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:14.984675 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:06:14.984675 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:14.984675 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:14.984675 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:14.984675 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:14.984675 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:14.984675 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:14.985685 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:14.985685 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:14.985685 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:14.985685 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:14.985685 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:14.985685 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:14.985685 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:06:14.985685 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:06:14.985685 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:06:14.985685 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:06:14.985685 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:14.985685 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:14.985685 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:14.985685 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:14.985685 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:14.985685 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:14.986491 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:14.986491 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:14.986491 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:14.986491 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:14.986491 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:14.986491 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:14.986491 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:14.986491 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:14.986491 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:14.986491 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:14.986491 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:06:14.986491 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:14.986491 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 02:06:14.986491 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:14.990784 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 396/788] 10.222.0.23 () {56 vars in 1129 bytes} [Mon Aug 8 02:06:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:14.992153 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4a404c-352c-42a9-8c4d-0218a7f204bf None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:15.054425 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12070ee-87f3-4908-b209-0f2458e54f4b None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:15.091200 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e617e-1001-41f0-bea7-ee3dc62ed187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:15.092233 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e617e-1001-41f0-bea7-ee3dc62ed187 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:15.092736 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e617e-1001-41f0-bea7-ee3dc62ed187 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:15.093218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e617e-1001-41f0-bea7-ee3dc62ed187 None admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:15.094466 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312e617e-1001-41f0-bea7-ee3dc62ed187 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:15.095045 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312e617e-1001-41f0-bea7-ee3dc62ed187 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:15.096907 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312e617e-1001-41f0-bea7-ee3dc62ed187 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:15.110342 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4a404c-352c-42a9-8c4d-0218a7f204bf None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:15.115155 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 393/789] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:15.116746 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa17ef-8ddd-43d5-9d3f-6f345d235911 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:15.117498 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa17ef-8ddd-43d5-9d3f-6f345d235911 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:15.117954 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa17ef-8ddd-43d5-9d3f-6f345d235911 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:15.123721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 394/790] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:15.124656 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa17ef-8ddd-43d5-9d3f-6f345d235911 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:15.140459 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:15.149836 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a99abbf-258f-4100-af7c-41b196eba519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:15.150487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99abbf-258f-4100-af7c-41b196eba519 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:15.155116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99abbf-258f-4100-af7c-41b196eba519 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:15.155116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99abbf-258f-4100-af7c-41b196eba519 None admin] PATH_INFO: `/v3/services` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:15.155116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a99abbf-258f-4100-af7c-41b196eba519 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:15.155116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a99abbf-258f-4100-af7c-41b196eba519 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:15.155116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a99abbf-258f-4100-af7c-41b196eba519 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:15.159054 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 397/791] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Aug 8 02:06:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:15.160460 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6d37f-674d-48df-806f-aa6aaab50adf None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:15.160889 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6d37f-674d-48df-806f-aa6aaab50adf None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:15.161309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6d37f-674d-48df-806f-aa6aaab50adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:15.182351 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-daf6d37f-674d-48df-806f-aa6aaab50adf None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:15.183916 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-daf6d37f-674d-48df-806f-aa6aaab50adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:15.240295 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:15.256467 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa17ef-8ddd-43d5-9d3f-6f345d235911 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:15.270309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 398/792] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:15.270309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf6d37f-674d-48df-806f-aa6aaab50adf None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:15.318469 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c9d13-be35-41d4-b9e8-4ddc8e621950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:15.319026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c9d13-be35-41d4-b9e8-4ddc8e621950 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:15.319338 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c9d13-be35-41d4-b9e8-4ddc8e621950 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:15.320068 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c9d13-be35-41d4-b9e8-4ddc8e621950 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:15.329928 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c9d13-be35-41d4-b9e8-4ddc8e621950 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:15.331506 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c9d13-be35-41d4-b9e8-4ddc8e621950 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:15.347746 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-036c9d13-be35-41d4-b9e8-4ddc8e621950 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 08 02:06:15.347746 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:15.347746 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:15.347746 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:15.347746 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:15.347746 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:15.347746 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:15.347746 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:15.347746 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:15.347746 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:15.347746 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:15.347746 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:15.347746 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:06:15.347746 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:06:15.347746 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:06:15.347746 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:06:15.348925 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:15.348925 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:15.348925 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:06:15.348925 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:15.348925 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:06:15.348925 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:15.348925 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:15.348925 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:15.348925 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:15.348925 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:15.348925 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:15.348925 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:15.348925 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:15.348925 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:15.348925 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:15.348925 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:15.348925 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:15.348925 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:15.349976 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:15.349976 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:15.349976 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:06:15.349976 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:06:15.349976 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:06:15.349976 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:06:15.349976 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:06:15.349976 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:06:15.349976 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 08 02:06:15.349976 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:15.349976 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 395/793] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 02:06:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:15.349976 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c9d13-be35-41d4-b9e8-4ddc8e621950 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:15.392390 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf6d37f-674d-48df-806f-aa6aaab50adf None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:15.396644 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:15.429526 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d20f05-5ffd-430b-8fce-28ed727139d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:15.430536 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d20f05-5ffd-430b-8fce-28ed727139d1 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:15.431347 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d20f05-5ffd-430b-8fce-28ed727139d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:15.431850 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d20f05-5ffd-430b-8fce-28ed727139d1 None admin] PATH_INFO: `/v3/services` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:15.432731 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d20f05-5ffd-430b-8fce-28ed727139d1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:15.433387 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d20f05-5ffd-430b-8fce-28ed727139d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:15.434941 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d20f05-5ffd-430b-8fce-28ed727139d1 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:15.441282 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 399/794] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Aug 8 02:06:15 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:15.442289 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d20f05-5ffd-430b-8fce-28ed727139d1 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:15.474113 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c9d13-be35-41d4-b9e8-4ddc8e621950 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:15.513157 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9cb76-0e4f-43fd-a2c1-b26e1ced3b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:15.514167 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9cb76-0e4f-43fd-a2c1-b26e1ced3b93 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:15.515733 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9cb76-0e4f-43fd-a2c1-b26e1ced3b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:15.516016 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9cb76-0e4f-43fd-a2c1-b26e1ced3b93 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:15.530323 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec9cb76-0e4f-43fd-a2c1-b26e1ced3b93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:06:15.537708 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-0ec9cb76-0e4f-43fd-a2c1-b26e1ced3b93 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:06:15.537708 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:15.537708 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:15.537708 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:15.537708 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:15.537708 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:15.537708 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:15.537708 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:15.537708 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:15.537708 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:15.537708 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:15.537708 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:15.537708 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:06:15.537708 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:06:15.537708 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:06:15.537708 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:06:15.538637 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:06:15.538637 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:06:15.538637 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:06:15.538637 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:06:15.538637 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:15.538637 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:15.538637 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:15.538637 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:15.538637 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:15.538637 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:15.538637 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:15.538637 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:15.538637 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:15.538637 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:15.538637 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:15.538637 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:15.540097 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:15.540097 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:15.540097 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:15.540097 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:15.540097 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:06:15.540097 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:06:15.540097 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:06:15.540097 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:06:15.540097 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:06:15.540097 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:06:15.540097 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:06:15.540097 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:15.540097 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 396/795] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 02:06:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:15.540799 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9cb76-0e4f-43fd-a2c1-b26e1ced3b93 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:15.549311 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:15.578015 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d20f05-5ffd-430b-8fce-28ed727139d1 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:15.617230 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97e515-12bb-469e-9f6f-e368a4aedf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:15.618388 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97e515-12bb-469e-9f6f-e368a4aedf96 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:15.618681 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97e515-12bb-469e-9f6f-e368a4aedf96 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:15.618961 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97e515-12bb-469e-9f6f-e368a4aedf96 None admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:15.619790 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc97e515-12bb-469e-9f6f-e368a4aedf96 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:15.620108 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc97e515-12bb-469e-9f6f-e368a4aedf96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:15.621570 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc97e515-12bb-469e-9f6f-e368a4aedf96 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:15.643834 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 400/796] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Aug 8 02:06:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:15.643834 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97e515-12bb-469e-9f6f-e368a4aedf96 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:15.649707 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9cb76-0e4f-43fd-a2c1-b26e1ced3b93 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:15.677570 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:15.692388 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c4c85-d773-4f2a-845b-9b9a79882d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:15.693004 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c4c85-d773-4f2a-845b-9b9a79882d55 None admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:15.693289 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c4c85-d773-4f2a-845b-9b9a79882d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:15.693568 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c4c85-d773-4f2a-845b-9b9a79882d55 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:15.694235 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c4c85-d773-4f2a-845b-9b9a79882d55 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:15.696229 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c4c85-d773-4f2a-845b-9b9a79882d55 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:15.757581 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97e515-12bb-469e-9f6f-e368a4aedf96 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:15.794468 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da07a9e-7449-456b-bfd7-8bb16c400718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:15.795076 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da07a9e-7449-456b-bfd7-8bb16c400718 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:15.795349 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da07a9e-7449-456b-bfd7-8bb16c400718 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:15.795654 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da07a9e-7449-456b-bfd7-8bb16c400718 None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:15.796315 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da07a9e-7449-456b-bfd7-8bb16c400718 None admin] RBAC: Adding query filter params (name=service) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:15.796617 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da07a9e-7449-456b-bfd7-8bb16c400718 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:15.797970 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da07a9e-7449-456b-bfd7-8bb16c400718 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:15.803781 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 397/797] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:06:15 2022] POST /identity/v3/endpoints => generated 346 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:06:15.805742 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62159e74-ab59-4b62-b1a4-7e39347123a7 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:15.806293 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62159e74-ab59-4b62-b1a4-7e39347123a7 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:15.806583 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62159e74-ab59-4b62-b1a4-7e39347123a7 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:15.813671 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 401/798] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 8 02:06:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:15.813671 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da07a9e-7449-456b-bfd7-8bb16c400718 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:15.820110 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 398/799] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:15 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:15.821586 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62159e74-ab59-4b62-b1a4-7e39347123a7 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:15.904178 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:15.942342 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:15.957206 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da07a9e-7449-456b-bfd7-8bb16c400718 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:15.963730 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62159e74-ab59-4b62-b1a4-7e39347123a7 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:15.999552 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530401f3-06e9-4988-8ffe-ddc60b380528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:16.000279 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530401f3-06e9-4988-8ffe-ddc60b380528 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:16.000560 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530401f3-06e9-4988-8ffe-ddc60b380528 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:16.000831 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530401f3-06e9-4988-8ffe-ddc60b380528 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:16.001933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6b371-1de7-4397-a5b2-06b8a7d4bb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:16.002871 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6b371-1de7-4397-a5b2-06b8a7d4bb0c None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:16.003161 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6b371-1de7-4397-a5b2-06b8a7d4bb0c None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:16.003786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6b371-1de7-4397-a5b2-06b8a7d4bb0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:16.012368 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530401f3-06e9-4988-8ffe-ddc60b380528 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:16.013981 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530401f3-06e9-4988-8ffe-ddc60b380528 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:16.016784 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e6b371-1de7-4397-a5b2-06b8a7d4bb0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:16.017071 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e6b371-1de7-4397-a5b2-06b8a7d4bb0c None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:16.033828 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-31e6b371-1de7-4397-a5b2-06b8a7d4bb0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:16.033828 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:16.033828 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:16.033828 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:16.033828 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:16.033828 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:16.033828 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:16.033828 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:16.033828 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:16.033828 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:16.033828 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:16.033828 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:16.033828 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:16.033828 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:16.033828 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:16.033828 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:16.038398 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:16.038398 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:16.038398 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:16.038398 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:16.038398 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:16.038398 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:16.038398 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:16.038398 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:16.038398 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:16.038398 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:16.038398 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:16.038398 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:16.038398 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:16.038398 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:16.038398 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:16.038398 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:16.038398 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:16.039961 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:16.039961 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:16.039961 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:16.040133 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-530401f3-06e9-4988-8ffe-ddc60b380528 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:16.040133 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:16.040133 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:16.040133 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:16.040133 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:16.040133 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:16.040133 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:16.040133 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:16.040133 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:16.040133 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:16.040133 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:16.040133 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:16.040133 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:16.040133 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:16.040133 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:16.040133 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:16.041069 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:16.041069 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:16.041069 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:16.041069 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:16.041069 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:16.041069 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:16.041069 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:16.041069 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:16.041069 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:16.041069 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:16.041069 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:16.041069 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:16.041069 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:16.041069 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:16.041069 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:16.041069 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:16.041069 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:16.042222 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:16.042222 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:16.042222 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:16.042414 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 399/800] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:16.042482 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 402/801] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:16.042549 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096de2b5-f267-47d3-bc15-5d46f4ed5c7d None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:16.042549 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096de2b5-f267-47d3-bc15-5d46f4ed5c7d None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:16.042549 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096de2b5-f267-47d3-bc15-5d46f4ed5c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:16.047221 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530401f3-06e9-4988-8ffe-ddc60b380528 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:16.058039 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-096de2b5-f267-47d3-bc15-5d46f4ed5c7d None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:16.059428 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-096de2b5-f267-47d3-bc15-5d46f4ed5c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:16.148358 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 400/802] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:16.149704 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096de2b5-f267-47d3-bc15-5d46f4ed5c7d None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:16.155382 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530401f3-06e9-4988-8ffe-ddc60b380528 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:16.198715 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5d66c-5e3c-433b-b4d2-8758cc7b0757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:16.200002 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5d66c-5e3c-433b-b4d2-8758cc7b0757 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:16.200292 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5d66c-5e3c-433b-b4d2-8758cc7b0757 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:16.200766 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5d66c-5e3c-433b-b4d2-8758cc7b0757 None admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:16.201459 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e5d66c-5e3c-433b-b4d2-8758cc7b0757 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:16.201769 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e5d66c-5e3c-433b-b4d2-8758cc7b0757 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:16.203141 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e5d66c-5e3c-433b-b4d2-8758cc7b0757 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:16.206035 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:16.212707 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:16.217016 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 403/803] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:06:16.222297 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5d66c-5e3c-433b-b4d2-8758cc7b0757 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:16.280886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096de2b5-f267-47d3-bc15-5d46f4ed5c7d None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:16.328079 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0adca-0dd1-42c0-8471-9e62c0313550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:16.328710 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0adca-0dd1-42c0-8471-9e62c0313550 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:16.328977 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0adca-0dd1-42c0-8471-9e62c0313550 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:16.329253 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0adca-0dd1-42c0-8471-9e62c0313550 None admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:16.330502 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec0adca-0dd1-42c0-8471-9e62c0313550 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:16.330810 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec0adca-0dd1-42c0-8471-9e62c0313550 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:16.332382 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec0adca-0dd1-42c0-8471-9e62c0313550 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:16.336748 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5d66c-5e3c-433b-b4d2-8758cc7b0757 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:16.345020 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 401/804] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:16.345916 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0adca-0dd1-42c0-8471-9e62c0313550 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:16.381256 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9064c3f3-1d3f-4d5c-b8d1-9b6e1479060c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:16.382415 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064c3f3-1d3f-4d5c-b8d1-9b6e1479060c None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:16.383449 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064c3f3-1d3f-4d5c-b8d1-9b6e1479060c None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:16.383939 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064c3f3-1d3f-4d5c-b8d1-9b6e1479060c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:16.397248 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9064c3f3-1d3f-4d5c-b8d1-9b6e1479060c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:06:16.404224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-9064c3f3-1d3f-4d5c-b8d1-9b6e1479060c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:06:16.404224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:16.404224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:16.404224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:16.404224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:16.404224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:16.404224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:16.404224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:16.404224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:16.404224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:16.404224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:16.404224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:16.404224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:06:16.404224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:06:16.404224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:06:16.404224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:06:16.405141 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:06:16.405141 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:06:16.405141 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:06:16.405141 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:06:16.405141 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:16.405141 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:16.405141 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:16.405141 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:16.405141 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:16.405141 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:16.405141 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:16.405141 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:16.405141 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:16.405141 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:16.405141 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:16.405141 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:16.406062 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:16.406062 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:16.406062 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:16.406062 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:16.406062 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:06:16.406062 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:06:16.406062 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:06:16.406062 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:06:16.406062 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:06:16.406062 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:06:16.406062 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:06:16.406062 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:16.409225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 404/805] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 02:06:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:16.410476 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9064c3f3-1d3f-4d5c-b8d1-9b6e1479060c None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:16.473213 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:16.476367 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0adca-0dd1-42c0-8471-9e62c0313550 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:16.503243 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:16.515241 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739eaa72-a85a-494d-953d-9a835611b549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:16.516183 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739eaa72-a85a-494d-953d-9a835611b549 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:16.516679 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739eaa72-a85a-494d-953d-9a835611b549 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:16.517122 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739eaa72-a85a-494d-953d-9a835611b549 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:16.525938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739eaa72-a85a-494d-953d-9a835611b549 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:16.527733 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739eaa72-a85a-494d-953d-9a835611b549 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:16.541125 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-739eaa72-a85a-494d-953d-9a835611b549 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:16.541125 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:16.541125 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:16.541125 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:16.541125 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:16.541125 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:16.541125 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:16.541125 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:16.541125 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:16.541125 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:16.541125 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:16.541125 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:16.541125 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:06:16.541125 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:06:16.541125 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:06:16.542042 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:06:16.542042 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:16.542042 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:16.542042 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:16.542042 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:16.542042 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:16.542042 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:16.542042 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:16.542042 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:16.542042 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:16.542042 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:16.542042 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:16.542042 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:16.542042 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:16.542042 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:16.542042 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:16.542042 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:16.542975 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:06:16.542975 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:06:16.542975 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:06:16.542975 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:06:16.542975 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:06:16.542975 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:06:16.542975 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:16.542975 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:16.550472 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 402/806] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:06:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:16.551068 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9064c3f3-1d3f-4d5c-b8d1-9b6e1479060c None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:16.551898 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739eaa72-a85a-494d-953d-9a835611b549 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:16.596520 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff72a63-dc02-497b-a75b-04ed904e6f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:16.597160 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff72a63-dc02-497b-a75b-04ed904e6f65 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:16.597445 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff72a63-dc02-497b-a75b-04ed904e6f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:16.597720 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff72a63-dc02-497b-a75b-04ed904e6f65 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:16.608513 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff72a63-dc02-497b-a75b-04ed904e6f65 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:16.609977 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff72a63-dc02-497b-a75b-04ed904e6f65 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:16.626553 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-eff72a63-dc02-497b-a75b-04ed904e6f65 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 02:06:16.626553 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:16.626553 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:16.626553 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:16.626553 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:16.626553 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:16.626553 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:16.626553 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:16.626553 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:16.626553 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:16.626553 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:16.626553 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:16.626553 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:06:16.626553 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:06:16.626553 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:06:16.626553 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:06:16.627570 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:16.627570 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:16.627570 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:06:16.627570 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:16.627570 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:06:16.627570 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:16.627570 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:16.627570 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:16.627570 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:16.627570 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:16.627570 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:16.627570 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:16.627570 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:16.627570 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:16.627570 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:16.627570 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:16.627570 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:16.627570 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:16.628547 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:16.628547 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:16.628547 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:06:16.628547 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:06:16.628547 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:06:16.628547 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:06:16.628547 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:06:16.628547 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:06:16.628547 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 02:06:16.628547 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:16.629071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 405/807] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Aug 8 02:06:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:16.629667 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff72a63-dc02-497b-a75b-04ed904e6f65 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:16.676224 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739eaa72-a85a-494d-953d-9a835611b549 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:16.711182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e6661f-5554-430d-9bcd-13d513f2fd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:16.711825 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6661f-5554-430d-9bcd-13d513f2fd5c None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:16.712111 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6661f-5554-430d-9bcd-13d513f2fd5c None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:16.712387 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6661f-5554-430d-9bcd-13d513f2fd5c None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:16.713049 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e6661f-5554-430d-9bcd-13d513f2fd5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:16.713354 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e6661f-5554-430d-9bcd-13d513f2fd5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:16.714714 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e6661f-5554-430d-9bcd-13d513f2fd5c None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:16.728051 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 403/808] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:06:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:16.728051 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e6661f-5554-430d-9bcd-13d513f2fd5c None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:16.745766 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff72a63-dc02-497b-a75b-04ed904e6f65 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:16.754938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:16.767002 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:16.781314 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864da93f-6eed-4168-8a9a-3233ed719bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:16.782107 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864da93f-6eed-4168-8a9a-3233ed719bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:16.782485 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864da93f-6eed-4168-8a9a-3233ed719bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:16.782859 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864da93f-6eed-4168-8a9a-3233ed719bd0 None admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:16.783685 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864da93f-6eed-4168-8a9a-3233ed719bd0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:16.784094 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864da93f-6eed-4168-8a9a-3233ed719bd0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:16.785677 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864da93f-6eed-4168-8a9a-3233ed719bd0 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:16.803037 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 406/809] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 02:06:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:16.803037 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205459b5-8a31-4385-9e3c-a8e16f789e29 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:16.803037 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205459b5-8a31-4385-9e3c-a8e16f789e29 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:16.803037 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205459b5-8a31-4385-9e3c-a8e16f789e29 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:16.806708 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 407/810] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:16.807528 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205459b5-8a31-4385-9e3c-a8e16f789e29 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:16.838634 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e6661f-5554-430d-9bcd-13d513f2fd5c None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:16.875927 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed301e5-70e8-471c-9755-03da8a536cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:16.876741 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed301e5-70e8-471c-9755-03da8a536cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:16.877170 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed301e5-70e8-471c-9755-03da8a536cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:16.877593 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed301e5-70e8-471c-9755-03da8a536cb7 None admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:16.878576 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed301e5-70e8-471c-9755-03da8a536cb7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:16.878886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed301e5-70e8-471c-9755-03da8a536cb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:16.880334 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed301e5-70e8-471c-9755-03da8a536cb7 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:16.898480 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 404/811] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Aug 8 02:06:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:16.899702 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed301e5-70e8-471c-9755-03da8a536cb7 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:16.916694 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205459b5-8a31-4385-9e3c-a8e16f789e29 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:16.951722 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ee5d0-0be0-4eb6-a9ee-52884d5b61b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:16.952409 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ee5d0-0be0-4eb6-a9ee-52884d5b61b9 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:16.952783 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ee5d0-0be0-4eb6-a9ee-52884d5b61b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:16.953136 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ee5d0-0be0-4eb6-a9ee-52884d5b61b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:16.963577 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ee5d0-0be0-4eb6-a9ee-52884d5b61b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:16.965259 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ee5d0-0be0-4eb6-a9ee-52884d5b61b9 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:16.980803 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-7f5ee5d0-0be0-4eb6-a9ee-52884d5b61b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:16.980803 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:16.980803 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:16.980803 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:16.980803 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:16.980803 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:16.980803 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:16.980803 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:16.980803 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:16.980803 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:16.980803 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:16.980803 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:16.980803 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:16.980803 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:16.980803 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:16.980803 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:16.981792 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:16.981792 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:16.981792 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:16.981792 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:16.981792 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:16.981792 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:16.981792 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:16.981792 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:16.981792 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:16.981792 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:16.981792 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:16.981792 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:16.981792 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:16.981792 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:16.981792 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:16.981792 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:16.981792 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:16.982658 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:16.982658 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:16.982658 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:16.982658 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 408/812] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:16.983168 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b960eb-33c1-4643-b09d-7c1487d2fc57 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:16.983329 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b960eb-33c1-4643-b09d-7c1487d2fc57 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:16.983633 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b960eb-33c1-4643-b09d-7c1487d2fc57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:16.989919 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:17.001990 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-79b960eb-33c1-4643-b09d-7c1487d2fc57 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:17.007501 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-79b960eb-33c1-4643-b09d-7c1487d2fc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:17.013222 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed301e5-70e8-471c-9755-03da8a536cb7 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:17.032250 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:17.052842 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e6947-2278-4497-9589-1af0d37f833c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:17.053600 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e6947-2278-4497-9589-1af0d37f833c None admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:17.053997 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e6947-2278-4497-9589-1af0d37f833c None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:17.054331 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e6947-2278-4497-9589-1af0d37f833c None admin] PATH_INFO: `/v3/projects/ebe178f5bce64a009bf690031676c89f/users/6c212009b6a44e1bad92769630116408/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:17.057126 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244e6947-2278-4497-9589-1af0d37f833c None admin] RBAC: Authorizing `identity:create_grant(project_id=ebe178f5bce64a009bf690031676c89f, user_id=6c212009b6a44e1bad92769630116408, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:17.058617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244e6947-2278-4497-9589-1af0d37f833c None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:17.075260 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 409/813] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:17.076128 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b960eb-33c1-4643-b09d-7c1487d2fc57 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:17.125741 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 405/814] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 02:06:16 2022] PUT /identity/v3/projects/ebe178f5bce64a009bf690031676c89f/users/6c212009b6a44e1bad92769630116408/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:06:17.126914 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e6947-2278-4497-9589-1af0d37f833c None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:17.202837 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b960eb-33c1-4643-b09d-7c1487d2fc57 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:17.242029 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e6947-2278-4497-9589-1af0d37f833c None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:17.250826 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c48f1-ad51-4085-8ef9-6b9097cef872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:17.252177 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c48f1-ad51-4085-8ef9-6b9097cef872 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:17.252526 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c48f1-ad51-4085-8ef9-6b9097cef872 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:17.252868 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c48f1-ad51-4085-8ef9-6b9097cef872 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:17.266306 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c48f1-ad51-4085-8ef9-6b9097cef872 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:17.268075 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c48f1-ad51-4085-8ef9-6b9097cef872 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:17.288852 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-889c48f1-ad51-4085-8ef9-6b9097cef872 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:17.288852 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:17.288852 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:17.288852 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:17.288852 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:17.288852 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:17.288852 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:17.288852 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:17.288852 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:17.288852 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:17.288852 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:17.288852 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:17.288852 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:17.288852 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:17.288852 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:17.288852 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:17.290544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:17.290544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:17.290544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:17.290544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:17.290544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:17.290544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:17.290544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:17.290544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:17.290544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:17.290544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:17.290544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:17.290544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:17.290544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:17.290544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:17.290544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:17.290544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:17.290544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:17.291532 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:17.291532 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:17.291532 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:17.295383 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 410/815] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:17.295383 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c48f1-ad51-4085-8ef9-6b9097cef872 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:17.299701 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df8c7c-b465-4b45-bd77-17501bbdf5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:17.300328 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df8c7c-b465-4b45-bd77-17501bbdf5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:17.300608 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df8c7c-b465-4b45-bd77-17501bbdf5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:17.300884 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df8c7c-b465-4b45-bd77-17501bbdf5b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:17.301533 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2df8c7c-b465-4b45-bd77-17501bbdf5b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:17.301841 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2df8c7c-b465-4b45-bd77-17501bbdf5b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:17.303206 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2df8c7c-b465-4b45-bd77-17501bbdf5b1 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:17.313721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:17.316643 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:17.318597 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 406/816] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:17.319584 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df8c7c-b465-4b45-bd77-17501bbdf5b1 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:17.436230 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df8c7c-b465-4b45-bd77-17501bbdf5b1 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:17.446010 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c48f1-ad51-4085-8ef9-6b9097cef872 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:17.479147 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a88aaa-f6f8-4257-8163-7f32766c0ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:17.480126 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a88aaa-f6f8-4257-8163-7f32766c0ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:17.480513 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a88aaa-f6f8-4257-8163-7f32766c0ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:17.481306 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a88aaa-f6f8-4257-8163-7f32766c0ca2 None admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:17.482337 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a88aaa-f6f8-4257-8163-7f32766c0ca2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:17.482842 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a88aaa-f6f8-4257-8163-7f32766c0ca2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:17.484339 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a88aaa-f6f8-4257-8163-7f32766c0ca2 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:17.486259 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3f596-7666-49c4-9329-0d1087c9c2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:17.487038 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3f596-7666-49c4-9329-0d1087c9c2b2 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:17.487531 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3f596-7666-49c4-9329-0d1087c9c2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:17.488000 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3f596-7666-49c4-9329-0d1087c9c2b2 None admin] PATH_INFO: `/v3/services/network` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:17.488745 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec3f596-7666-49c4-9329-0d1087c9c2b2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:17.490247 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec3f596-7666-49c4-9329-0d1087c9c2b2 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:17.500016 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 407/817] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:17.500016 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a88aaa-f6f8-4257-8163-7f32766c0ca2 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:17.504642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-fec3f596-7666-49c4-9329-0d1087c9c2b2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 02:06:17.504642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:17.504642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:06:17.504642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:06:17.504642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:06:17.504642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:06:17.504642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:06:17.504642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:17.504642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 02:06:17.504642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:17.504642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:06:17.504642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:17.504642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:17.504642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:17.504642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:17.504642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:17.504642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:17.505850 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:17.505850 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:17.505850 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:17.505850 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:17.505850 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:17.505850 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:17.505850 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:06:17.505850 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:06:17.505850 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:06:17.505850 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:06:17.505850 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:17.505850 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:17.505850 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:17.505850 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:17.505850 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:17.505850 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:17.506892 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:17.506892 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:17.506892 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:17.506892 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:17.506892 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:17.506892 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:17.506892 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:17.506892 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:17.506892 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:17.506892 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:17.506892 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:06:17.506892 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:17.506892 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 02:06:17.506892 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:17.508889 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 411/818] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:06:17 2022] GET /identity/v3/services/network => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:17.509812 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3f596-7666-49c4-9329-0d1087c9c2b2 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:17.567169 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:17.619057 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:17.621590 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a88aaa-f6f8-4257-8163-7f32766c0ca2 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:17.641853 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3f596-7666-49c4-9329-0d1087c9c2b2 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:17.667903 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a39243-92ce-485c-abff-1cf0861fa025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:17.668547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a39243-92ce-485c-abff-1cf0861fa025 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:17.668830 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a39243-92ce-485c-abff-1cf0861fa025 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:17.669194 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a39243-92ce-485c-abff-1cf0861fa025 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:17.683776 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a39243-92ce-485c-abff-1cf0861fa025 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:17.688141 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a39243-92ce-485c-abff-1cf0861fa025 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:17.693750 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de4345-5328-4cae-8df1-689ebfaf3a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:17.695181 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de4345-5328-4cae-8df1-689ebfaf3a6c None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:17.696524 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de4345-5328-4cae-8df1-689ebfaf3a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:17.697321 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de4345-5328-4cae-8df1-689ebfaf3a6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:17.704743 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-71a39243-92ce-485c-abff-1cf0861fa025 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:06:17.704743 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:17.704743 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:17.704743 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:17.704743 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:17.704743 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:17.704743 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:17.704743 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:17.704743 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:17.704743 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:17.704743 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:17.704743 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:17.704743 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:06:17.704743 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:06:17.704743 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:06:17.704743 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:06:17.705760 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:17.705760 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:17.705760 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:06:17.705760 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:17.705760 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:06:17.705760 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:17.705760 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:17.705760 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:17.705760 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:17.705760 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:17.705760 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:17.705760 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:17.705760 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:17.705760 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:17.705760 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:17.705760 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:17.705760 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:17.705760 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:17.706786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:17.706786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:17.706786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:06:17.706786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:06:17.706786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:06:17.706786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:06:17.706786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:06:17.706786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:06:17.706786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:06:17.706786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:17.706786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 408/819] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Aug 8 02:06:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:17.707396 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a39243-92ce-485c-abff-1cf0861fa025 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:17.708982 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de4345-5328-4cae-8df1-689ebfaf3a6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:17.710648 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de4345-5328-4cae-8df1-689ebfaf3a6c None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:17.723271 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-47de4345-5328-4cae-8df1-689ebfaf3a6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:17.723271 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:17.723271 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:17.723271 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:17.723271 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:17.723271 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:17.723271 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:17.723271 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:17.723271 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:17.723271 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:17.723271 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:17.723271 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:17.723271 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:06:17.723271 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:06:17.723271 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:06:17.724199 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:06:17.724199 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:17.724199 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:17.724199 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:17.724199 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:17.724199 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:17.724199 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:17.724199 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:17.724199 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:17.724199 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:17.724199 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:17.724199 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:17.724199 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:17.724199 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:17.724199 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:17.724199 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:17.724199 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:17.725078 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:06:17.725078 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:06:17.725078 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:06:17.725078 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:06:17.725078 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:06:17.725078 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:06:17.725078 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:17.725078 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:17.727439 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 412/820] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:06:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:17.728419 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de4345-5328-4cae-8df1-689ebfaf3a6c None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:17.822393 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a39243-92ce-485c-abff-1cf0861fa025 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:17.833148 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de4345-5328-4cae-8df1-689ebfaf3a6c None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:17.844025 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:17.859665 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c821580-9710-47f6-9a67-497394b19c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:17.865586 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c821580-9710-47f6-9a67-497394b19c7c None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:17.865586 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c821580-9710-47f6-9a67-497394b19c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:17.865586 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c821580-9710-47f6-9a67-497394b19c7c None admin] PATH_INFO: `/v3/services` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:17.865586 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c821580-9710-47f6-9a67-497394b19c7c None admin] RBAC: Adding query filter params (name=network) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:17.865586 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c821580-9710-47f6-9a67-497394b19c7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:17.865586 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c821580-9710-47f6-9a67-497394b19c7c None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:17.869026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 409/821] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Aug 8 02:06:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:17.869876 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c821580-9710-47f6-9a67-497394b19c7c None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:17.870885 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38a923-43b0-4e31-8f89-355536b80e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:17.871768 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38a923-43b0-4e31-8f89-355536b80e29 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:17.872253 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38a923-43b0-4e31-8f89-355536b80e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:17.872729 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38a923-43b0-4e31-8f89-355536b80e29 None admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:17.873914 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38a923-43b0-4e31-8f89-355536b80e29 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:17.874447 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38a923-43b0-4e31-8f89-355536b80e29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:17.876118 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38a923-43b0-4e31-8f89-355536b80e29 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:17.885311 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:17.896281 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 413/822] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Aug 8 02:06:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:17.897386 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38a923-43b0-4e31-8f89-355536b80e29 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:17.981225 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c821580-9710-47f6-9a67-497394b19c7c None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:18.005942 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38a923-43b0-4e31-8f89-355536b80e29 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:18.017263 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81515ed-b20d-4b5a-a740-d9b7da66311e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:18.017866 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81515ed-b20d-4b5a-a740-d9b7da66311e None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:18.018297 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81515ed-b20d-4b5a-a740-d9b7da66311e None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:18.018517 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81515ed-b20d-4b5a-a740-d9b7da66311e None admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:18.019201 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81515ed-b20d-4b5a-a740-d9b7da66311e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:18.019614 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81515ed-b20d-4b5a-a740-d9b7da66311e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:18.021036 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81515ed-b20d-4b5a-a740-d9b7da66311e None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:18.035523 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 410/823] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 02:06:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:18.035523 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81515ed-b20d-4b5a-a740-d9b7da66311e None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:18.045287 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8817e2-2109-424d-b413-f1fa72627a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:18.045897 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8817e2-2109-424d-b413-f1fa72627a5d None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:18.046178 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8817e2-2109-424d-b413-f1fa72627a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:18.046456 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8817e2-2109-424d-b413-f1fa72627a5d None admin] PATH_INFO: `/v3/services` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:18.047092 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8817e2-2109-424d-b413-f1fa72627a5d None admin] RBAC: Adding query filter params (type=network) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:18.047423 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8817e2-2109-424d-b413-f1fa72627a5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:18.048778 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8817e2-2109-424d-b413-f1fa72627a5d None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:18.058640 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 414/824] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Aug 8 02:06:17 2022] GET /identity/v3/services?type=network => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:18.059913 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb6215-9e86-43c3-8613-02b1d5e5d28c None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:18.060202 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb6215-9e86-43c3-8613-02b1d5e5d28c None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:18.060485 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb6215-9e86-43c3-8613-02b1d5e5d28c None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:18.061760 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 415/825] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:18.062436 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb6215-9e86-43c3-8613-02b1d5e5d28c None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:18.087802 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:18.124253 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:18.149850 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81515ed-b20d-4b5a-a740-d9b7da66311e None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:18.166230 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb6215-9e86-43c3-8613-02b1d5e5d28c None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:18.185342 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82da062-18e5-4fd1-9af8-bdff7b363504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:18.185947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82da062-18e5-4fd1-9af8-bdff7b363504 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:18.186228 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82da062-18e5-4fd1-9af8-bdff7b363504 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:18.186502 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82da062-18e5-4fd1-9af8-bdff7b363504 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:18.202580 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47728763-905c-41bc-8417-1c14cfb05c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:18.203312 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47728763-905c-41bc-8417-1c14cfb05c6c None admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:18.203626 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47728763-905c-41bc-8417-1c14cfb05c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:18.203905 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47728763-905c-41bc-8417-1c14cfb05c6c None admin] PATH_INFO: `/v3/projects/ebe178f5bce64a009bf690031676c89f/users/1d39439278814d4faac4cfb1e71aa4fc/roles/071080f2ecc948319b313f2379ea2b97` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:18.219269 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47728763-905c-41bc-8417-1c14cfb05c6c None admin] RBAC: Authorizing `identity:create_grant(project_id=ebe178f5bce64a009bf690031676c89f, user_id=1d39439278814d4faac4cfb1e71aa4fc, role_id=071080f2ecc948319b313f2379ea2b97)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:18.220907 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47728763-905c-41bc-8417-1c14cfb05c6c None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:18.253107 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82da062-18e5-4fd1-9af8-bdff7b363504 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:18.254546 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82da062-18e5-4fd1-9af8-bdff7b363504 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:18.299764 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 416/826] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 02:06:18 2022] PUT /identity/v3/projects/ebe178f5bce64a009bf690031676c89f/users/1d39439278814d4faac4cfb1e71aa4fc/roles/071080f2ecc948319b313f2379ea2b97 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:06:18.300186 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:18.300695 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47728763-905c-41bc-8417-1c14cfb05c6c None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:18.381391 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 411/827] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:06:18 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:06:18.384226 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357d5bf-eca6-4d6d-b902-5d0bb8db7bfe None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:18.384734 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357d5bf-eca6-4d6d-b902-5d0bb8db7bfe None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:18.385206 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357d5bf-eca6-4d6d-b902-5d0bb8db7bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:18.410376 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-5357d5bf-eca6-4d6d-b902-5d0bb8db7bfe None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:18.412009 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-5357d5bf-eca6-4d6d-b902-5d0bb8db7bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:18.425255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47728763-905c-41bc-8417-1c14cfb05c6c None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:18.437597 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:18.464225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd74889-5372-48ba-b226-5607848d2532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:18.464930 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd74889-5372-48ba-b226-5607848d2532 None admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:18.465166 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd74889-5372-48ba-b226-5607848d2532 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:18.465383 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd74889-5372-48ba-b226-5607848d2532 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:18.466155 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd74889-5372-48ba-b226-5607848d2532 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:18.468290 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd74889-5372-48ba-b226-5607848d2532 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:18.496574 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 412/828] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:18.497724 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357d5bf-eca6-4d6d-b902-5d0bb8db7bfe None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:18.567014 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 417/829] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:06:18 2022] POST /identity/v3/endpoints => generated 337 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:06:18.572991 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd74889-5372-48ba-b226-5607848d2532 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:18.587140 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:18.649258 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357d5bf-eca6-4d6d-b902-5d0bb8db7bfe None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:18.729738 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd74889-5372-48ba-b226-5607848d2532 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:18.736193 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48764304-85b3-406b-9e6b-0ab48d3e2d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:18.736851 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48764304-85b3-406b-9e6b-0ab48d3e2d20 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:18.737142 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48764304-85b3-406b-9e6b-0ab48d3e2d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:18.737425 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48764304-85b3-406b-9e6b-0ab48d3e2d20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:18.752917 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48764304-85b3-406b-9e6b-0ab48d3e2d20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:18.754724 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48764304-85b3-406b-9e6b-0ab48d3e2d20 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:18.770020 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed974e-92cf-4d31-b723-796548e4a5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:18.771110 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed974e-92cf-4d31-b723-796548e4a5de None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:18.771681 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed974e-92cf-4d31-b723-796548e4a5de None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:18.772211 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed974e-92cf-4d31-b723-796548e4a5de None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:18.773094 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed974e-92cf-4d31-b723-796548e4a5de None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:18.775230 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed974e-92cf-4d31-b723-796548e4a5de None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:18.790831 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-48764304-85b3-406b-9e6b-0ab48d3e2d20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:18.790831 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:18.790831 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:18.790831 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:18.790831 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:18.790831 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:18.790831 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:18.790831 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:18.790831 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:18.790831 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:18.790831 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:18.790831 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:18.790831 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:18.790831 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:18.790831 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:18.790831 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:18.791885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:18.791885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:18.791885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:18.791885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:18.791885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:18.791885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:18.791885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:18.791885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:18.791885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:18.791885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:18.791885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:18.791885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:18.791885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:18.791885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:18.791885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:18.791885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:18.791885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:18.792753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:18.792753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:18.792753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:18.798737 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 413/830] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:18.799659 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-75ed974e-92cf-4d31-b723-796548e4a5de None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 02:06:18.799659 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:18.799659 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:06:18.799659 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:06:18.799659 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:06:18.799659 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:06:18.799659 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:06:18.799659 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:18.799659 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 02:06:18.799659 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:18.799659 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:06:18.799659 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:18.799659 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:18.799659 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:18.799659 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:18.799659 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:18.799659 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:18.800608 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:18.800608 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:18.800608 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:18.800608 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:18.800608 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:18.800608 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:18.800608 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:06:18.800608 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:06:18.800608 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:06:18.800608 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:06:18.800608 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:18.800608 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:18.800608 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:18.800608 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:18.800608 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:18.800608 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:18.801507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:18.801507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:18.801507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:18.801507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:18.801507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:18.801507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:18.801507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:18.801507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:18.801507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:18.801507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:18.801507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:06:18.801507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:18.801507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 02:06:18.801507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:18.804372 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48764304-85b3-406b-9e6b-0ab48d3e2d20 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:18.807022 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 418/831] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 02:06:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:18.812562 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed974e-92cf-4d31-b723-796548e4a5de None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:18.857739 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:18.927993 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48764304-85b3-406b-9e6b-0ab48d3e2d20 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:18.940703 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed974e-92cf-4d31-b723-796548e4a5de None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:18.963915 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:18.983015 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e17c2d-7075-47aa-9fb4-2135726180fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:18.984265 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e17c2d-7075-47aa-9fb4-2135726180fd None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:18.985208 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e17c2d-7075-47aa-9fb4-2135726180fd None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:18.986243 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e17c2d-7075-47aa-9fb4-2135726180fd None admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:18.986935 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e17c2d-7075-47aa-9fb4-2135726180fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:18.987877 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e17c2d-7075-47aa-9fb4-2135726180fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:18.989490 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e17c2d-7075-47aa-9fb4-2135726180fd None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:18.995603 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315fdd1-9267-413d-9f6e-293c8a08e89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:18.996597 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315fdd1-9267-413d-9f6e-293c8a08e89c None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:18.997074 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315fdd1-9267-413d-9f6e-293c8a08e89c None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:18.997554 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315fdd1-9267-413d-9f6e-293c8a08e89c None admin] PATH_INFO: `/v3/services` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:18.998373 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315fdd1-9267-413d-9f6e-293c8a08e89c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:18.999453 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315fdd1-9267-413d-9f6e-293c8a08e89c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:19.001471 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315fdd1-9267-413d-9f6e-293c8a08e89c None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:19.004282 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 414/832] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:19.007144 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 419/833] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 02:06:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:19.012423 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e17c2d-7075-47aa-9fb4-2135726180fd None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:19.014767 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315fdd1-9267-413d-9f6e-293c8a08e89c None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:19.114910 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:19.121989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315fdd1-9267-413d-9f6e-293c8a08e89c None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:19.122794 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e17c2d-7075-47aa-9fb4-2135726180fd None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:19.160690 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b1678a-ec1f-43aa-adaf-b2e8648f6eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:19.161525 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1678a-ec1f-43aa-adaf-b2e8648f6eea None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:19.161977 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1678a-ec1f-43aa-adaf-b2e8648f6eea None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:19.162396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1678a-ec1f-43aa-adaf-b2e8648f6eea None admin] PATH_INFO: `/v3/services` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:19.163160 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b1678a-ec1f-43aa-adaf-b2e8648f6eea None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:19.163630 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b1678a-ec1f-43aa-adaf-b2e8648f6eea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:19.165623 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b1678a-ec1f-43aa-adaf-b2e8648f6eea None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:19.167433 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e1644-62cf-488a-bd84-b03e23857f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:19.168555 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e1644-62cf-488a-bd84-b03e23857f4d None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:19.169046 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e1644-62cf-488a-bd84-b03e23857f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:19.169565 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e1644-62cf-488a-bd84-b03e23857f4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:19.171298 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 420/834] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 02:06:19 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:06:19.181909 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88e1644-62cf-488a-bd84-b03e23857f4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:19.183867 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88e1644-62cf-488a-bd84-b03e23857f4d None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:19.197399 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-b88e1644-62cf-488a-bd84-b03e23857f4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:19.197399 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:19.197399 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:19.197399 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:19.197399 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:19.197399 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:19.197399 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:19.197399 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:19.197399 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:19.197399 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:19.197399 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:19.197399 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:19.197399 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:06:19.197399 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:06:19.197399 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:06:19.198528 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:06:19.198528 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:19.198528 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:19.198528 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:19.198528 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:19.198528 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:19.198528 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:19.198528 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:19.198528 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:19.198528 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:19.198528 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:19.198528 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:19.198528 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:19.198528 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:19.198528 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:19.198528 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:19.198528 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:19.199632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:06:19.199632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:06:19.199632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:06:19.199632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:06:19.199632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:06:19.199632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:06:19.199632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:19.199632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:19.201745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 415/835] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:06:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:19.207810 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b1678a-ec1f-43aa-adaf-b2e8648f6eea None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:19.321841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b1678a-ec1f-43aa-adaf-b2e8648f6eea None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:19.356060 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348b312-cdcb-4f9a-8205-f353559c5cce None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:19.356679 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348b312-cdcb-4f9a-8205-f353559c5cce None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:19.357100 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348b312-cdcb-4f9a-8205-f353559c5cce None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:19.358576 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 416/836] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:19.359913 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e329a4c-2cbf-4a18-bd2c-a73a7a89a1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:19.360511 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e329a4c-2cbf-4a18-bd2c-a73a7a89a1b2 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:19.360789 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e329a4c-2cbf-4a18-bd2c-a73a7a89a1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:19.361085 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e329a4c-2cbf-4a18-bd2c-a73a7a89a1b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:19.361767 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e329a4c-2cbf-4a18-bd2c-a73a7a89a1b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:19.362069 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e329a4c-2cbf-4a18-bd2c-a73a7a89a1b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:19.363574 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e329a4c-2cbf-4a18-bd2c-a73a7a89a1b2 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:19.364422 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d5c85-b145-47ba-b7ce-6235aef34a36 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:19.364848 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d5c85-b145-47ba-b7ce-6235aef34a36 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:19.365560 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d5c85-b145-47ba-b7ce-6235aef34a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:19.376831 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 421/837] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 02:06:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:19.384981 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e329a4c-2cbf-4a18-bd2c-a73a7a89a1b2 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:19.399152 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-f35d5c85-b145-47ba-b7ce-6235aef34a36 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:19.400486 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-f35d5c85-b145-47ba-b7ce-6235aef34a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:19.406517 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:19.444339 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:19.485572 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 417/838] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:19 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:19.500954 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e329a4c-2cbf-4a18-bd2c-a73a7a89a1b2 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:19.504851 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d5c85-b145-47ba-b7ce-6235aef34a36 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:19.539067 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d30f0-769a-4896-9b08-77d0be42f22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:19.539732 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d30f0-769a-4896-9b08-77d0be42f22f None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:19.540013 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d30f0-769a-4896-9b08-77d0be42f22f None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:19.540284 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d30f0-769a-4896-9b08-77d0be42f22f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:19.541002 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d30f0-769a-4896-9b08-77d0be42f22f None admin] RBAC: Adding query filter params (role.id=84da65a75e544d1191ec53cb6b05aa73, scope.project.id=ebe178f5bce64a009bf690031676c89f, user.id=5d89e0c7d62444e4b75d3f4da49b2bc4) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:19.541307 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d30f0-769a-4896-9b08-77d0be42f22f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:19.542716 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d30f0-769a-4896-9b08-77d0be42f22f None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:19.549370 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 422/839] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:06:19 2022] GET /identity/v3/role_assignments?user.id=5d89e0c7d62444e4b75d3f4da49b2bc4&scope.project.id=ebe178f5bce64a009bf690031676c89f&role.id=84da65a75e544d1191ec53cb6b05aa73 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:19.623145 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d5c85-b145-47ba-b7ce-6235aef34a36 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:19.661502 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f5343-e6bb-4edc-b7ac-8d3d612fb00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:19.662515 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f5343-e6bb-4edc-b7ac-8d3d612fb00c None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:19.662999 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f5343-e6bb-4edc-b7ac-8d3d612fb00c None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:19.663521 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f5343-e6bb-4edc-b7ac-8d3d612fb00c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:19.676210 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f5343-e6bb-4edc-b7ac-8d3d612fb00c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:06:19.681858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-6c7f5343-e6bb-4edc-b7ac-8d3d612fb00c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:06:19.681858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:19.681858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:19.681858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:19.681858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:19.681858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:19.681858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:19.681858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:19.681858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:19.681858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:19.681858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:19.681858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:19.681858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:06:19.681858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:06:19.681858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:06:19.681858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:06:19.682840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:06:19.682840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:06:19.682840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:06:19.682840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:06:19.682840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:19.682840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:19.682840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:19.682840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:19.682840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:19.682840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:19.682840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:19.682840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:19.682840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:19.682840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:19.682840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:19.682840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:19.683688 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:19.683688 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:19.683688 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:19.683688 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:19.683688 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:06:19.683688 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:06:19.683688 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:06:19.683688 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:06:19.683688 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:06:19.683688 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:06:19.683688 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:06:19.683688 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:19.686555 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 418/840] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 02:06:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:06:19.696425 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d30f0-769a-4896-9b08-77d0be42f22f None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:19.791507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:19.810763 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d30f0-769a-4896-9b08-77d0be42f22f None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:19.846126 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91e56b-e570-4601-81dc-526fcbf823c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:19.846834 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91e56b-e570-4601-81dc-526fcbf823c6 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:19.847230 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91e56b-e570-4601-81dc-526fcbf823c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:19.847591 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91e56b-e570-4601-81dc-526fcbf823c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:19.848331 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f91e56b-e570-4601-81dc-526fcbf823c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:19.848706 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f91e56b-e570-4601-81dc-526fcbf823c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:19.850126 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f91e56b-e570-4601-81dc-526fcbf823c6 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:19.859800 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 423/841] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:06:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:19.865583 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f5343-e6bb-4edc-b7ac-8d3d612fb00c None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:19.898776 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:19.971694 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f5343-e6bb-4edc-b7ac-8d3d612fb00c None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:20.007126 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77c254-e266-4382-809c-dde51be08802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:20.007878 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77c254-e266-4382-809c-dde51be08802 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:20.008335 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77c254-e266-4382-809c-dde51be08802 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:20.008678 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77c254-e266-4382-809c-dde51be08802 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:20.019061 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77c254-e266-4382-809c-dde51be08802 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:20.020618 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77c254-e266-4382-809c-dde51be08802 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:20.035858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-2c77c254-e266-4382-809c-dde51be08802 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:20.035858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:20.035858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:20.035858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:20.035858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:20.035858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:20.035858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:20.035858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:20.035858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:20.035858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:20.035858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:20.035858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:20.035858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:20.035858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:20.035858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:20.035858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:20.036881 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:20.036881 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:20.036881 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:20.036881 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:20.036881 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:20.036881 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:20.036881 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:20.036881 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:20.036881 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:20.036881 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:20.036881 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:20.036881 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:20.036881 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:20.036881 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:20.036881 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:20.036881 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:20.036881 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:20.037749 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:20.037749 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:20.037749 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:20.037749 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 419/842] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:20.043060 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91e56b-e570-4601-81dc-526fcbf823c6 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:20.149537 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91e56b-e570-4601-81dc-526fcbf823c6 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:20.184878 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba27b0-31b7-4ee1-9c94-d61831b0301c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:20.185817 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba27b0-31b7-4ee1-9c94-d61831b0301c None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:20.186278 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba27b0-31b7-4ee1-9c94-d61831b0301c None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:20.186730 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba27b0-31b7-4ee1-9c94-d61831b0301c None admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:20.187614 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba27b0-31b7-4ee1-9c94-d61831b0301c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:20.188176 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba27b0-31b7-4ee1-9c94-d61831b0301c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:20.189886 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba27b0-31b7-4ee1-9c94-d61831b0301c None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:20.206845 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 424/843] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:20.212829 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77c254-e266-4382-809c-dde51be08802 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:20.299464 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:20.316009 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77c254-e266-4382-809c-dde51be08802 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:20.353324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09b40b-6e14-4f86-891e-511f5c05ac99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:20.353960 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09b40b-6e14-4f86-891e-511f5c05ac99 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:20.354239 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09b40b-6e14-4f86-891e-511f5c05ac99 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:20.354515 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09b40b-6e14-4f86-891e-511f5c05ac99 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:20.361899 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09b40b-6e14-4f86-891e-511f5c05ac99 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:20.363339 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09b40b-6e14-4f86-891e-511f5c05ac99 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:20.374938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-1c09b40b-6e14-4f86-891e-511f5c05ac99 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 08 02:06:20.374938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:20.374938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:20.374938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:20.374938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:20.374938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:20.374938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:20.374938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:20.374938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:20.374938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:20.374938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:20.374938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:20.374938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:06:20.374938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:06:20.374938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:06:20.374938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:06:20.376120 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:20.376120 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:20.376120 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:06:20.376120 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:20.376120 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:06:20.376120 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:20.376120 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:20.376120 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:20.376120 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:20.376120 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:20.376120 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:20.376120 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:20.376120 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:20.376120 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:20.376120 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:20.376120 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:20.376120 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:20.376120 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:20.377245 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:20.377245 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:20.377245 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:06:20.377245 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:06:20.377245 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:06:20.377245 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:06:20.377245 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:06:20.377245 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:06:20.377245 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 08 02:06:20.377245 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:20.377245 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 420/844] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 02:06:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:20.384707 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba27b0-31b7-4ee1-9c94-d61831b0301c None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:20.387038 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:20.420902 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c64c7f-b854-4673-9314-0b2104bd9b91 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:20.421187 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c64c7f-b854-4673-9314-0b2104bd9b91 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:20.421468 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c64c7f-b854-4673-9314-0b2104bd9b91 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:20.424108 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 421/845] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:20.428227 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084134b-da15-46ae-85f3-7197c1d4f3a6 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:20.428518 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084134b-da15-46ae-85f3-7197c1d4f3a6 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:20.428801 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084134b-da15-46ae-85f3-7197c1d4f3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:20.451859 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-d084134b-da15-46ae-85f3-7197c1d4f3a6 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:20.453078 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-d084134b-da15-46ae-85f3-7197c1d4f3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:20.498737 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba27b0-31b7-4ee1-9c94-d61831b0301c None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:20.531484 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 422/846] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:20 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:06:20.539809 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d077b-1ad5-4eb3-b34e-5d4ae3a66722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:20.540484 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d077b-1ad5-4eb3-b34e-5d4ae3a66722 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:20.540836 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d077b-1ad5-4eb3-b34e-5d4ae3a66722 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:20.541180 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d077b-1ad5-4eb3-b34e-5d4ae3a66722 None admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:20.541967 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d077b-1ad5-4eb3-b34e-5d4ae3a66722 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:20.542340 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d077b-1ad5-4eb3-b34e-5d4ae3a66722 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:20.543833 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d077b-1ad5-4eb3-b34e-5d4ae3a66722 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:20.549694 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084134b-da15-46ae-85f3-7197c1d4f3a6 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:20.564822 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 425/847] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Aug 8 02:06:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:20.570257 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d077b-1ad5-4eb3-b34e-5d4ae3a66722 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:20.628221 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:20.648992 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:20.653800 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084134b-da15-46ae-85f3-7197c1d4f3a6 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:20.676259 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d077b-1ad5-4eb3-b34e-5d4ae3a66722 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:20.689834 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4c82c-a416-4762-9233-b17a4280b5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:20.690529 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4c82c-a416-4762-9233-b17a4280b5ac None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:20.690885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4c82c-a416-4762-9233-b17a4280b5ac None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:20.691259 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4c82c-a416-4762-9233-b17a4280b5ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:20.702694 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4c82c-a416-4762-9233-b17a4280b5ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:06:20.707617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-90f4c82c-a416-4762-9233-b17a4280b5ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:06:20.707617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:20.707617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:20.707617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:20.707617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:20.707617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:20.707617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:20.707617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:20.707617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:20.707617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:20.707617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:20.707617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:20.707617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:06:20.707617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:06:20.707617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:06:20.707617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:06:20.708802 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:06:20.708802 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:06:20.708802 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:06:20.708802 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:06:20.708802 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:20.708802 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:20.708802 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:20.708802 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:20.708802 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:20.708802 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:20.708802 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:20.708802 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:20.708802 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:20.708802 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:20.708802 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:20.708802 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:20.709646 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:20.709646 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:20.709646 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:20.709646 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:20.709646 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:06:20.709646 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:06:20.709646 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:06:20.709646 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:06:20.709646 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:06:20.709646 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:06:20.709646 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:06:20.709646 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:20.714816 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 423/848] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 02:06:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:20.716165 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4c82c-a416-4762-9233-b17a4280b5ac None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:20.718604 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ec733-bd62-4ca4-986b-795d43f50982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:20.719543 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ec733-bd62-4ca4-986b-795d43f50982 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:20.719992 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ec733-bd62-4ca4-986b-795d43f50982 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:20.720482 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ec733-bd62-4ca4-986b-795d43f50982 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:20.802384 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2ec733-bd62-4ca4-986b-795d43f50982 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:20.804150 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2ec733-bd62-4ca4-986b-795d43f50982 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:20.852768 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4c82c-a416-4762-9233-b17a4280b5ac None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:20.871647 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:20.888879 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba59191-936c-49c0-bb49-468e28266300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:20.889507 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba59191-936c-49c0-bb49-468e28266300 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:20.889775 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba59191-936c-49c0-bb49-468e28266300 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:20.890055 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba59191-936c-49c0-bb49-468e28266300 None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:20.890729 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba59191-936c-49c0-bb49-468e28266300 None admin] RBAC: Adding query filter params (name=service) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:20.891036 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba59191-936c-49c0-bb49-468e28266300 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:20.892432 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba59191-936c-49c0-bb49-468e28266300 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:20.893849 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:20.906255 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 424/849] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 8 02:06:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:06:20.907588 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba59191-936c-49c0-bb49-468e28266300 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:20.924520 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 426/850] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:06:20 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 08 02:06:20.925651 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ec733-bd62-4ca4-986b-795d43f50982 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:21.022049 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba59191-936c-49c0-bb49-468e28266300 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:21.033391 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ec733-bd62-4ca4-986b-795d43f50982 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:21.064020 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2128e1-c273-46a5-a6aa-eeb48473b53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:21.065050 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2128e1-c273-46a5-a6aa-eeb48473b53e None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:21.065519 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2128e1-c273-46a5-a6aa-eeb48473b53e None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:21.066269 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2128e1-c273-46a5-a6aa-eeb48473b53e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:21.074005 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db132f-8c47-4ae0-a5a0-3a2350c6417d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:21.074715 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db132f-8c47-4ae0-a5a0-3a2350c6417d None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:21.075060 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db132f-8c47-4ae0-a5a0-3a2350c6417d None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:21.075471 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db132f-8c47-4ae0-a5a0-3a2350c6417d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:21.079985 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2128e1-c273-46a5-a6aa-eeb48473b53e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:21.081617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2128e1-c273-46a5-a6aa-eeb48473b53e None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:21.087433 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db132f-8c47-4ae0-a5a0-3a2350c6417d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:21.088925 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db132f-8c47-4ae0-a5a0-3a2350c6417d None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:21.098001 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-6e2128e1-c273-46a5-a6aa-eeb48473b53e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:21.098001 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:21.098001 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:21.098001 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:21.098001 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:21.098001 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:21.098001 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:21.098001 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:21.098001 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:21.098001 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:21.098001 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:21.098001 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:21.098001 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:21.098001 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:21.098001 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:21.098001 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:21.098939 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:21.098939 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:21.098939 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:21.098939 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:21.098939 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:21.098939 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:21.098939 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:21.098939 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:21.098939 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:21.098939 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:21.098939 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:21.098939 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:21.098939 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:21.098939 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:21.098939 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:21.098939 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:21.098939 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:21.099922 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:21.099922 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:21.099922 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:21.102285 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 425/851] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:21.107309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-d0db132f-8c47-4ae0-a5a0-3a2350c6417d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:21.107309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:21.107309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:21.107309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:21.107309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:21.107309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:21.107309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:21.107309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:21.107309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:21.107309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:21.107309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:21.107309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:21.107309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:21.107309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:21.107309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:21.107309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:21.108291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:21.108291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:21.108291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:21.108291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:21.108291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:21.108291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:21.108291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:21.108291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:21.108291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:21.108291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:21.108291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:21.108291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:21.108291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:21.108291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:21.108291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:21.108291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:21.108291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:21.109162 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:21.109162 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:21.109162 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:21.109859 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2128e1-c273-46a5-a6aa-eeb48473b53e None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:21.109946 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 427/852] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:21.113610 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db132f-8c47-4ae0-a5a0-3a2350c6417d None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:21.145369 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:21.189833 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:21.233006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db132f-8c47-4ae0-a5a0-3a2350c6417d None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:21.248044 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2128e1-c273-46a5-a6aa-eeb48473b53e None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:21.270116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07e855-d1e9-4213-b89a-9547e63f6945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:21.270718 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07e855-d1e9-4213-b89a-9547e63f6945 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:21.271000 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07e855-d1e9-4213-b89a-9547e63f6945 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:21.271275 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07e855-d1e9-4213-b89a-9547e63f6945 None admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:21.272088 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07e855-d1e9-4213-b89a-9547e63f6945 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:21.272266 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07e855-d1e9-4213-b89a-9547e63f6945 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:21.273648 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07e855-d1e9-4213-b89a-9547e63f6945 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:21.290700 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 428/853] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:06:21.293122 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07e855-d1e9-4213-b89a-9547e63f6945 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:21.296563 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ef09f-8dc0-47cf-ab55-1fc5fc41f733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:21.297197 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ef09f-8dc0-47cf-ab55-1fc5fc41f733 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:21.297499 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ef09f-8dc0-47cf-ab55-1fc5fc41f733 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:21.297780 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ef09f-8dc0-47cf-ab55-1fc5fc41f733 None admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:21.298798 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ef09f-8dc0-47cf-ab55-1fc5fc41f733 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:21.298798 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ef09f-8dc0-47cf-ab55-1fc5fc41f733 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:21.300094 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ef09f-8dc0-47cf-ab55-1fc5fc41f733 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:21.312210 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 426/854] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:21.313558 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f95b9-d34b-4543-9b95-2e5f9aad06cf None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:21.313843 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f95b9-d34b-4543-9b95-2e5f9aad06cf None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:21.314169 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f95b9-d34b-4543-9b95-2e5f9aad06cf None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:21.315587 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 427/855] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:21.317874 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f95b9-d34b-4543-9b95-2e5f9aad06cf None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:21.395074 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:21.420270 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07e855-d1e9-4213-b89a-9547e63f6945 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:21.428454 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f95b9-d34b-4543-9b95-2e5f9aad06cf None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:21.439968 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:21.458240 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e392ea4-cb6c-401b-9f4e-867bd483f752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:21.458861 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e392ea4-cb6c-401b-9f4e-867bd483f752 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:21.459138 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e392ea4-cb6c-401b-9f4e-867bd483f752 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:21.459690 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e392ea4-cb6c-401b-9f4e-867bd483f752 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:21.466530 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e392ea4-cb6c-401b-9f4e-867bd483f752 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:21.467999 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e392ea4-cb6c-401b-9f4e-867bd483f752 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:21.468685 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc6bfa8-f244-4cf1-b6e0-d384f4eca976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:21.469868 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6bfa8-f244-4cf1-b6e0-d384f4eca976 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:21.470351 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6bfa8-f244-4cf1-b6e0-d384f4eca976 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:21.471218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6bfa8-f244-4cf1-b6e0-d384f4eca976 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:21.479251 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc6bfa8-f244-4cf1-b6e0-d384f4eca976 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:21.479821 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-8e392ea4-cb6c-401b-9f4e-867bd483f752 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:21.479821 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:21.479821 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:21.479821 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:21.479821 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:21.479821 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:21.479821 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:21.479821 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:21.479821 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:21.479821 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:21.479821 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:21.479821 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:21.479821 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:06:21.479821 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:06:21.479821 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:06:21.480696 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:06:21.480696 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:21.480696 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:21.480696 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:21.480696 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:21.480696 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:21.480696 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:21.480696 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:21.480696 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:21.480696 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:21.480696 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:21.480696 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:21.480696 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:21.480696 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:21.480696 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:21.480696 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:21.480696 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:21.481541 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:06:21.481541 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:06:21.481541 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:06:21.481541 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:06:21.481541 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:06:21.481541 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:06:21.481541 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:21.481541 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:21.481956 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc6bfa8-f244-4cf1-b6e0-d384f4eca976 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:21.482024 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 429/856] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:06:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:06:21.482555 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f286c-9370-4186-98b9-1b3ca2345f0f None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:21.482801 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f286c-9370-4186-98b9-1b3ca2345f0f None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:21.483083 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f286c-9370-4186-98b9-1b3ca2345f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:21.497427 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-4fc6bfa8-f244-4cf1-b6e0-d384f4eca976 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 02:06:21.497427 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:21.497427 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:21.497427 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:21.497427 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:21.497427 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:21.497427 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:21.497427 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:21.497427 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:21.497427 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:21.497427 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:21.497427 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:21.497427 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:06:21.497427 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:06:21.497427 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:06:21.497427 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:06:21.498392 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:21.498392 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:21.498392 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:06:21.498392 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:21.498392 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:06:21.498392 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:21.498392 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:21.498392 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:21.498392 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:21.498392 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:21.498392 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:21.498392 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:21.498392 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:21.498392 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:21.498392 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:21.498392 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:21.498392 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:21.498392 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:21.499340 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:21.499340 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:21.499340 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:06:21.499340 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:06:21.499340 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:06:21.499340 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:06:21.499340 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:06:21.499340 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:06:21.499340 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 02:06:21.499340 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:21.499340 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 428/857] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Aug 8 02:06:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:06:21.499340 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc6bfa8-f244-4cf1-b6e0-d384f4eca976 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:21.508617 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-2f0f286c-9370-4186-98b9-1b3ca2345f0f None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:21.509842 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-2f0f286c-9370-4186-98b9-1b3ca2345f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:21.578679 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 430/858] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:21 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:21.579600 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f286c-9370-4186-98b9-1b3ca2345f0f None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:21.608578 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc6bfa8-f244-4cf1-b6e0-d384f4eca976 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:21.644641 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1cef04-40a2-4291-9beb-c9dd14f8d184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:21.645323 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cef04-40a2-4291-9beb-c9dd14f8d184 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:21.645504 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cef04-40a2-4291-9beb-c9dd14f8d184 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:21.645778 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cef04-40a2-4291-9beb-c9dd14f8d184 None admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:21.646460 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1cef04-40a2-4291-9beb-c9dd14f8d184 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:21.646764 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1cef04-40a2-4291-9beb-c9dd14f8d184 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:21.648201 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1cef04-40a2-4291-9beb-c9dd14f8d184 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:21.656014 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:21.661094 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 429/859] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 02:06:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:21.664440 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1cef04-40a2-4291-9beb-c9dd14f8d184 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:21.694836 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:21.696714 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f286c-9370-4186-98b9-1b3ca2345f0f None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:21.736269 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89013538-bb13-4ded-85d5-17f0449d67d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:21.737721 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89013538-bb13-4ded-85d5-17f0449d67d7 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:21.738525 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89013538-bb13-4ded-85d5-17f0449d67d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:21.739299 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89013538-bb13-4ded-85d5-17f0449d67d7 None admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:21.740991 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89013538-bb13-4ded-85d5-17f0449d67d7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:21.741555 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89013538-bb13-4ded-85d5-17f0449d67d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:21.744884 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89013538-bb13-4ded-85d5-17f0449d67d7 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:21.763986 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 431/860] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Aug 8 02:06:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:21.764811 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89013538-bb13-4ded-85d5-17f0449d67d7 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:21.775654 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1cef04-40a2-4291-9beb-c9dd14f8d184 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:21.809623 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b331b1-ca58-485d-9161-64cf3a650e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:21.810221 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b331b1-ca58-485d-9161-64cf3a650e45 None admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:21.810500 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b331b1-ca58-485d-9161-64cf3a650e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:21.810770 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b331b1-ca58-485d-9161-64cf3a650e45 None admin] PATH_INFO: `/v3/services` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:21.811421 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b331b1-ca58-485d-9161-64cf3a650e45 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:21.812770 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b331b1-ca58-485d-9161-64cf3a650e45 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:21.861868 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89013538-bb13-4ded-85d5-17f0449d67d7 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:21.871818 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 430/861] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Aug 8 02:06:21 2022] POST /identity/v3/services => generated 251 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:06:21.873006 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba724ddc-c9c0-4b4d-8710-cdf474eadc82 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:21.873292 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba724ddc-c9c0-4b4d-8710-cdf474eadc82 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:21.873565 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba724ddc-c9c0-4b4d-8710-cdf474eadc82 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:21.875088 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 431/862] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:21.875873 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba724ddc-c9c0-4b4d-8710-cdf474eadc82 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:21.887408 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:21.912968 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c774ae0-c7a8-45b0-860b-247479b948c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:21.913586 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c774ae0-c7a8-45b0-860b-247479b948c6 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:21.913861 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c774ae0-c7a8-45b0-860b-247479b948c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:21.914275 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c774ae0-c7a8-45b0-860b-247479b948c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:21.915244 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c774ae0-c7a8-45b0-860b-247479b948c6 None admin] RBAC: Adding query filter params (role.id=84da65a75e544d1191ec53cb6b05aa73, scope.project.id=ebe178f5bce64a009bf690031676c89f, user.id=6c212009b6a44e1bad92769630116408) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:21.915452 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c774ae0-c7a8-45b0-860b-247479b948c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:21.916939 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c774ae0-c7a8-45b0-860b-247479b948c6 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:21.935395 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 432/863] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:06:21 2022] GET /identity/v3/role_assignments?user.id=6c212009b6a44e1bad92769630116408&scope.project.id=ebe178f5bce64a009bf690031676c89f&role.id=84da65a75e544d1191ec53cb6b05aa73 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:21.935395 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980a18f-8956-4c57-bf1a-e47216b2d1f2 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:21.935395 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980a18f-8956-4c57-bf1a-e47216b2d1f2 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:21.935395 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980a18f-8956-4c57-bf1a-e47216b2d1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:21.958977 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-e980a18f-8956-4c57-bf1a-e47216b2d1f2 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:21.960737 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-e980a18f-8956-4c57-bf1a-e47216b2d1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:22.006063 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:22.022333 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba724ddc-c9c0-4b4d-8710-cdf474eadc82 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:22.065871 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c4ddaa-8d99-46b5-a09f-337f5c423eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:22.066540 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 433/864] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:21 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:22.066652 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4ddaa-8d99-46b5-a09f-337f5c423eae None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:22.066810 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4ddaa-8d99-46b5-a09f-337f5c423eae None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:22.067038 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4ddaa-8d99-46b5-a09f-337f5c423eae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:22.095303 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980a18f-8956-4c57-bf1a-e47216b2d1f2 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:22.149946 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c4ddaa-8d99-46b5-a09f-337f5c423eae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:22.151827 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c4ddaa-8d99-46b5-a09f-337f5c423eae None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:22.212035 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980a18f-8956-4c57-bf1a-e47216b2d1f2 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:22.225703 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:22.246986 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae9e35-c811-4798-b5aa-cc40ebb1f410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:22.247764 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae9e35-c811-4798-b5aa-cc40ebb1f410 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:22.248115 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae9e35-c811-4798-b5aa-cc40ebb1f410 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:22.248461 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae9e35-c811-4798-b5aa-cc40ebb1f410 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:22.249124 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae9e35-c811-4798-b5aa-cc40ebb1f410 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:22.250564 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae9e35-c811-4798-b5aa-cc40ebb1f410 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:22.260773 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-f0ae9e35-c811-4798-b5aa-cc40ebb1f410 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 02:06:22.260773 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:22.260773 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:06:22.260773 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:06:22.260773 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:06:22.260773 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:06:22.260773 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:06:22.260773 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:22.260773 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 02:06:22.260773 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:22.260773 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:06:22.260773 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:22.260773 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:22.260773 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:22.260773 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:22.260773 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:22.261798 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:22.261798 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:22.261798 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:22.261798 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:22.261798 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:22.261798 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:22.261798 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:22.261798 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:06:22.261798 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:06:22.261798 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:06:22.261798 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:06:22.261798 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:22.261798 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:22.261798 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:22.261798 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:22.261798 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:22.261798 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:22.262642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:22.262642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:22.262642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:22.262642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:22.262642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:22.262642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:22.262642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:22.262642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:22.262642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:22.262642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:22.262642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:06:22.262642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:22.262642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 02:06:22.262642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:22.263385 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 434/865] 10.222.0.23 () {56 vars in 1132 bytes} [Mon Aug 8 02:06:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:06:22.265224 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:22.272416 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae9e35-c811-4798-b5aa-cc40ebb1f410 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:22.285062 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 432/866] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:06:21 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:06:22.290292 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c4ddaa-8d99-46b5-a09f-337f5c423eae None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:22.379622 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae9e35-c811-4798-b5aa-cc40ebb1f410 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:22.418866 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4528e0-9d32-423b-bcb3-44a2d63cb070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:22.419809 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4528e0-9d32-423b-bcb3-44a2d63cb070 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:22.420279 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4528e0-9d32-423b-bcb3-44a2d63cb070 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:22.420631 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4528e0-9d32-423b-bcb3-44a2d63cb070 None admin] PATH_INFO: `/v3/services` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:22.421314 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4528e0-9d32-423b-bcb3-44a2d63cb070 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:22.421699 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4528e0-9d32-423b-bcb3-44a2d63cb070 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:22.423118 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4528e0-9d32-423b-bcb3-44a2d63cb070 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:22.428001 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 435/867] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Aug 8 02:06:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:22.434144 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4528e0-9d32-423b-bcb3-44a2d63cb070 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:22.434457 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c4ddaa-8d99-46b5-a09f-337f5c423eae None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:22.478734 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:22.487751 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26035326-5d3c-4e48-884c-a33b7b9e2c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:22.488639 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26035326-5d3c-4e48-884c-a33b7b9e2c93 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:22.489140 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26035326-5d3c-4e48-884c-a33b7b9e2c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:22.489619 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26035326-5d3c-4e48-884c-a33b7b9e2c93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:22.506600 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26035326-5d3c-4e48-884c-a33b7b9e2c93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:22.509272 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26035326-5d3c-4e48-884c-a33b7b9e2c93 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:22.529615 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-26035326-5d3c-4e48-884c-a33b7b9e2c93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:22.529615 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:22.529615 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:22.529615 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:22.529615 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:22.529615 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:22.529615 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:22.529615 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:22.529615 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:22.529615 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:22.529615 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:22.529615 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:22.529615 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:22.529615 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:22.529615 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:22.529615 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:22.530638 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:22.530638 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:22.530638 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:22.530638 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:22.530638 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:22.530638 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:22.530638 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:22.530638 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:22.530638 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:22.530638 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:22.530638 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:22.530638 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:22.530638 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:22.530638 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:22.530638 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:22.530638 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:22.530638 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:22.531536 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:22.531536 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:22.531536 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:22.537111 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 433/868] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:22.537837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26035326-5d3c-4e48-884c-a33b7b9e2c93 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:22.549502 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4528e0-9d32-423b-bcb3-44a2d63cb070 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:22.588704 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f4b8b-11f8-47a1-ab83-19a44be3f8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:22.589368 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f4b8b-11f8-47a1-ab83-19a44be3f8c1 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:22.589597 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f4b8b-11f8-47a1-ab83-19a44be3f8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:22.589774 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f4b8b-11f8-47a1-ab83-19a44be3f8c1 None admin] PATH_INFO: `/v3/services` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:22.590391 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f4b8b-11f8-47a1-ab83-19a44be3f8c1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:22.590692 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f4b8b-11f8-47a1-ab83-19a44be3f8c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:22.592137 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f4b8b-11f8-47a1-ab83-19a44be3f8c1 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:22.600306 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:22.603920 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 436/869] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Aug 8 02:06:22 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:06:22.671199 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26035326-5d3c-4e48-884c-a33b7b9e2c93 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:22.710477 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7265aa4-9c5c-410b-b4ce-0d9ac0988092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:22.711672 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7265aa4-9c5c-410b-b4ce-0d9ac0988092 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:22.712160 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7265aa4-9c5c-410b-b4ce-0d9ac0988092 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:22.712635 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7265aa4-9c5c-410b-b4ce-0d9ac0988092 None admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:22.713495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7265aa4-9c5c-410b-b4ce-0d9ac0988092 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:22.714027 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7265aa4-9c5c-410b-b4ce-0d9ac0988092 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:22.715659 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7265aa4-9c5c-410b-b4ce-0d9ac0988092 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:22.730407 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 434/870] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:22.736415 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f4b8b-11f8-47a1-ab83-19a44be3f8c1 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:22.848233 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f4b8b-11f8-47a1-ab83-19a44be3f8c1 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:22.850927 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:22.884855 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d407f-4a99-4ba3-925c-1d7214832700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:22.885846 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d407f-4a99-4ba3-925c-1d7214832700 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:22.886329 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d407f-4a99-4ba3-925c-1d7214832700 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:22.886867 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d407f-4a99-4ba3-925c-1d7214832700 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:22.893742 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d407f-4a99-4ba3-925c-1d7214832700 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:22.895415 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d407f-4a99-4ba3-925c-1d7214832700 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:22.906757 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-d02d407f-4a99-4ba3-925c-1d7214832700 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:22.906757 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:22.906757 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:22.906757 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:22.906757 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:22.906757 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:22.906757 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:22.906757 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:22.906757 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:22.906757 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:22.906757 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:22.906757 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:22.906757 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:06:22.906757 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:06:22.906757 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:06:22.907645 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:06:22.907645 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:22.907645 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:22.907645 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:22.907645 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:22.907645 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:22.907645 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:22.907645 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:22.907645 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:22.907645 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:22.907645 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:22.907645 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:22.907645 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:22.907645 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:22.907645 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:22.907645 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:22.907645 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:22.908539 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:06:22.908539 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:06:22.908539 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:06:22.908539 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:06:22.908539 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:06:22.908539 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:06:22.908539 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:22.908539 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:22.910807 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 437/871] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:06:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:22.917248 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7265aa4-9c5c-410b-b4ce-0d9ac0988092 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:23.021696 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:23.026384 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7265aa4-9c5c-410b-b4ce-0d9ac0988092 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:23.062565 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbdccb6-2d31-494f-9f19-4ea6a25680c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:23.063639 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdccb6-2d31-494f-9f19-4ea6a25680c1 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:23.064144 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdccb6-2d31-494f-9f19-4ea6a25680c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:23.064645 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdccb6-2d31-494f-9f19-4ea6a25680c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:23.065572 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbdccb6-2d31-494f-9f19-4ea6a25680c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:23.066092 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbdccb6-2d31-494f-9f19-4ea6a25680c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:23.067909 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbdccb6-2d31-494f-9f19-4ea6a25680c1 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:23.081362 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 435/872] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 02:06:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:23.088109 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d407f-4a99-4ba3-925c-1d7214832700 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:23.208016 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d407f-4a99-4ba3-925c-1d7214832700 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:23.244044 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24be79c-867d-4cc9-a53e-0872942ebfe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:23.245012 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24be79c-867d-4cc9-a53e-0872942ebfe1 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:23.245523 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24be79c-867d-4cc9-a53e-0872942ebfe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:23.245996 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24be79c-867d-4cc9-a53e-0872942ebfe1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:23.246920 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24be79c-867d-4cc9-a53e-0872942ebfe1 None admin] RBAC: Adding query filter params (role.id=071080f2ecc948319b313f2379ea2b97, scope.project.id=ebe178f5bce64a009bf690031676c89f, user.id=1d39439278814d4faac4cfb1e71aa4fc) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:23.247449 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24be79c-867d-4cc9-a53e-0872942ebfe1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:23.249074 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24be79c-867d-4cc9-a53e-0872942ebfe1 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:23.255578 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 438/873] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:06:23 2022] GET /identity/v3/role_assignments?user.id=1d39439278814d4faac4cfb1e71aa4fc&scope.project.id=ebe178f5bce64a009bf690031676c89f&role.id=071080f2ecc948319b313f2379ea2b97 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:23.973874 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8333f6-6133-43bd-b6f1-5ffc5b4cd6f9 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:23.974256 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8333f6-6133-43bd-b6f1-5ffc5b4cd6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:23.974456 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8333f6-6133-43bd-b6f1-5ffc5b4cd6f9 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:23.975943 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 436/874] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:23.981369 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65723142-32d5-4693-8a9d-97a5f53c64bf None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:23.982214 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65723142-32d5-4693-8a9d-97a5f53c64bf None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:23.982696 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65723142-32d5-4693-8a9d-97a5f53c64bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:24.001689 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-65723142-32d5-4693-8a9d-97a5f53c64bf None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:24.003204 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-65723142-32d5-4693-8a9d-97a5f53c64bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:24.027122 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:24.075521 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 439/875] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:23 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:24.094119 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8333f6-6133-43bd-b6f1-5ffc5b4cd6f9 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:24.109810 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242dbba-a4ce-41a5-8304-64a297e04398 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:24.110158 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242dbba-a4ce-41a5-8304-64a297e04398 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:24.110438 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242dbba-a4ce-41a5-8304-64a297e04398 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:24.112166 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 440/876] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:06:24.120569 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74889ff-c138-45a1-8b6f-cd6baf3a1bfd None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:24.121072 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74889ff-c138-45a1-8b6f-cd6baf3a1bfd None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:24.121516 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74889ff-c138-45a1-8b6f-cd6baf3a1bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:24.144092 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-a74889ff-c138-45a1-8b6f-cd6baf3a1bfd None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:24.145590 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-a74889ff-c138-45a1-8b6f-cd6baf3a1bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:24.212500 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8333f6-6133-43bd-b6f1-5ffc5b4cd6f9 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:24.239763 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 441/877] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:24 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:24.249085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a125f-9249-45ce-ab9f-70746e11dcd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:24.249855 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a125f-9249-45ce-ab9f-70746e11dcd2 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:24.250269 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a125f-9249-45ce-ab9f-70746e11dcd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:24.250648 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a125f-9249-45ce-ab9f-70746e11dcd2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:24.251380 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a125f-9249-45ce-ab9f-70746e11dcd2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:24.252922 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a125f-9249-45ce-ab9f-70746e11dcd2 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:24.257704 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74889ff-c138-45a1-8b6f-cd6baf3a1bfd None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:24.263314 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-0a8a125f-9249-45ce-ab9f-70746e11dcd2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 02:06:24.263314 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:24.263314 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:06:24.263314 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:06:24.263314 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:06:24.263314 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:06:24.263314 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:06:24.263314 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:24.263314 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 02:06:24.263314 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:24.263314 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:06:24.263314 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:24.263314 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:24.263314 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:24.263314 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:24.263314 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:24.263314 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:24.264454 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:24.264454 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:24.264454 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:24.264454 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:24.264454 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:24.264454 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:24.264454 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:06:24.264454 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:06:24.264454 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:06:24.264454 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:06:24.264454 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:24.264454 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:24.264454 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:24.264454 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:24.264454 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:24.264454 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:24.265258 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:24.265258 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:24.265258 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:24.265258 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:24.265258 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:24.265258 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:24.265258 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:24.265258 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:24.265258 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:24.265258 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:24.265258 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:06:24.265258 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:24.265258 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 02:06:24.265258 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:24.270039 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 437/878] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 02:06:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:24.271192 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a125f-9249-45ce-ab9f-70746e11dcd2 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:24.297777 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:24.356784 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:24.370221 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74889ff-c138-45a1-8b6f-cd6baf3a1bfd None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:24.383897 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a125f-9249-45ce-ab9f-70746e11dcd2 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:24.412408 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608dfe1-56c2-46ac-add2-07ba210b8432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:24.413439 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608dfe1-56c2-46ac-add2-07ba210b8432 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:24.414037 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608dfe1-56c2-46ac-add2-07ba210b8432 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:24.415276 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608dfe1-56c2-46ac-add2-07ba210b8432 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:24.416072 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5608dfe1-56c2-46ac-add2-07ba210b8432 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:24.417851 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5608dfe1-56c2-46ac-add2-07ba210b8432 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:24.422729 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd705f9-0139-469d-9e2c-7c1564a6e8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:24.423427 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd705f9-0139-469d-9e2c-7c1564a6e8aa None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:24.423718 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd705f9-0139-469d-9e2c-7c1564a6e8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:24.423998 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd705f9-0139-469d-9e2c-7c1564a6e8aa None admin] PATH_INFO: `/v3/services` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:24.424682 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd705f9-0139-469d-9e2c-7c1564a6e8aa None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:24.424997 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd705f9-0139-469d-9e2c-7c1564a6e8aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:24.426349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd705f9-0139-469d-9e2c-7c1564a6e8aa None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:24.429026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-5608dfe1-56c2-46ac-add2-07ba210b8432 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:06:24.429026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:24.429026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:06:24.429026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:06:24.429026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:06:24.429026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:06:24.429026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:06:24.429026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:24.429026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:06:24.429026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:24.429026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:06:24.429026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:24.429026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:24.429026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:24.429026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:24.429026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:24.429026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:24.430046 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:24.430046 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:24.430046 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:24.430046 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:24.430046 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:24.430046 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:24.430046 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:06:24.430046 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:06:24.430046 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:06:24.430046 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:06:24.430046 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:24.430046 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:24.430046 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:24.430046 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:24.430046 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:24.430046 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:24.430872 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:24.430872 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:24.430872 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:24.430872 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:24.430872 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:24.430872 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:24.430872 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:24.430872 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:24.430872 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:24.430872 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:24.430872 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:06:24.430872 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:24.430872 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:06:24.430872 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:24.438409 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 438/880] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 02:06:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:06:24.438409 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd705f9-0139-469d-9e2c-7c1564a6e8aa None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:24.438801 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 442/880] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Aug 8 02:06:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:24.440111 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608dfe1-56c2-46ac-add2-07ba210b8432 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:24.534390 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:24.547249 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd705f9-0139-469d-9e2c-7c1564a6e8aa None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:24.561443 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608dfe1-56c2-46ac-add2-07ba210b8432 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:24.583073 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076cda38-4e10-46bc-8e07-574fc6f39419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:24.583736 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076cda38-4e10-46bc-8e07-574fc6f39419 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:24.584023 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076cda38-4e10-46bc-8e07-574fc6f39419 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:24.584298 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076cda38-4e10-46bc-8e07-574fc6f39419 None admin] PATH_INFO: `/v3/services` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:24.584928 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076cda38-4e10-46bc-8e07-574fc6f39419 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:24.585239 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076cda38-4e10-46bc-8e07-574fc6f39419 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:24.587222 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076cda38-4e10-46bc-8e07-574fc6f39419 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:24.597382 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 439/881] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 02:06:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:24.598659 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076cda38-4e10-46bc-8e07-574fc6f39419 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:24.601951 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6800ec-e49f-41cc-a477-81b8e36ba1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:24.602881 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6800ec-e49f-41cc-a477-81b8e36ba1fe None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:24.603391 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6800ec-e49f-41cc-a477-81b8e36ba1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:24.603883 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6800ec-e49f-41cc-a477-81b8e36ba1fe None admin] PATH_INFO: `/v3/services` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:24.604729 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6800ec-e49f-41cc-a477-81b8e36ba1fe None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:24.605227 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6800ec-e49f-41cc-a477-81b8e36ba1fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:24.606794 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6800ec-e49f-41cc-a477-81b8e36ba1fe None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:24.612210 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 443/882] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Aug 8 02:06:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:24.618831 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6800ec-e49f-41cc-a477-81b8e36ba1fe None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:24.639965 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:24.713464 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076cda38-4e10-46bc-8e07-574fc6f39419 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:24.725716 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6800ec-e49f-41cc-a477-81b8e36ba1fe None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:24.747563 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096c8f1-f804-4a42-bb1d-4286936a1854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:24.748167 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096c8f1-f804-4a42-bb1d-4286936a1854 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:24.748444 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096c8f1-f804-4a42-bb1d-4286936a1854 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:24.748715 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096c8f1-f804-4a42-bb1d-4286936a1854 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:24.749397 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096c8f1-f804-4a42-bb1d-4286936a1854 None admin] RBAC: Adding query filter params (interface=public, service_id=facac9b5e8e84716a8d5934c3d846e17, region_id=RegionOne) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:24.749708 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096c8f1-f804-4a42-bb1d-4286936a1854 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:24.751048 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096c8f1-f804-4a42-bb1d-4286936a1854 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:24.756337 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 440/883] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Aug 8 02:06:24 2022] GET /identity/v3/endpoints?service_id=facac9b5e8e84716a8d5934c3d846e17&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:24.757275 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de49cc4-9709-4e40-ba6e-ef1f3303401e None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:24.757554 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de49cc4-9709-4e40-ba6e-ef1f3303401e None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:24.757825 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de49cc4-9709-4e40-ba6e-ef1f3303401e None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:24.759407 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 441/884] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:24.761663 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de49cc4-9709-4e40-ba6e-ef1f3303401e None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:24.768186 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb4256-6cfe-4497-92cf-484e31ccd137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:24.768801 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb4256-6cfe-4497-92cf-484e31ccd137 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:24.769084 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb4256-6cfe-4497-92cf-484e31ccd137 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:24.769359 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb4256-6cfe-4497-92cf-484e31ccd137 None admin] PATH_INFO: `/v3/services` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:24.769983 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb4256-6cfe-4497-92cf-484e31ccd137 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:24.770296 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb4256-6cfe-4497-92cf-484e31ccd137 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:24.771674 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb4256-6cfe-4497-92cf-484e31ccd137 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:24.777202 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 444/885] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Aug 8 02:06:24 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:24.780389 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:24.782239 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26243567-0fe2-4ab2-8b59-4ae422bdff2b None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:24.782744 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26243567-0fe2-4ab2-8b59-4ae422bdff2b None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:24.783218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26243567-0fe2-4ab2-8b59-4ae422bdff2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:24.811149 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-26243567-0fe2-4ab2-8b59-4ae422bdff2b None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:24.812794 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-26243567-0fe2-4ab2-8b59-4ae422bdff2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:24.875277 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de49cc4-9709-4e40-ba6e-ef1f3303401e None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:24.903931 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 445/886] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:24 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:24.912453 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b0f584-eb89-4e86-98b5-4350e84a2b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:24.913078 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0f584-eb89-4e86-98b5-4350e84a2b98 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:24.913353 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0f584-eb89-4e86-98b5-4350e84a2b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:24.913623 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0f584-eb89-4e86-98b5-4350e84a2b98 None admin] PATH_INFO: `/v3/services` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:24.914805 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b0f584-eb89-4e86-98b5-4350e84a2b98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:24.916216 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b0f584-eb89-4e86-98b5-4350e84a2b98 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:24.922394 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26243567-0fe2-4ab2-8b59-4ae422bdff2b None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:24.922804 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 442/887] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Aug 8 02:06:24 2022] GET /identity/v3/services => generated 1011 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:06:24.937414 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:25.052706 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26243567-0fe2-4ab2-8b59-4ae422bdff2b None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:25.092263 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c3f3b-ceb4-495a-b393-abe88284e059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:25.092799 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c3f3b-ceb4-495a-b393-abe88284e059 None admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:25.093098 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c3f3b-ceb4-495a-b393-abe88284e059 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:25.093365 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c3f3b-ceb4-495a-b393-abe88284e059 None admin] PATH_INFO: `/v3/services` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:25.094029 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c3f3b-ceb4-495a-b393-abe88284e059 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:25.095464 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c3f3b-ceb4-495a-b393-abe88284e059 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:25.160090 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 446/888] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Aug 8 02:06:24 2022] POST /identity/v3/services => generated 269 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:06:25.446897 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c32ca-01d6-4cda-b9e6-3c7bc79755e3 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:25.447460 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c32ca-01d6-4cda-b9e6-3c7bc79755e3 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:25.447460 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c32ca-01d6-4cda-b9e6-3c7bc79755e3 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:25.449032 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 443/889] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:25.454166 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c6e45-9671-4c6e-9b5b-04073a313de3 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:25.454451 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c6e45-9671-4c6e-9b5b-04073a313de3 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:25.454733 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c6e45-9671-4c6e-9b5b-04073a313de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:25.473547 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-217c6e45-9671-4c6e-9b5b-04073a313de3 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:25.474717 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-217c6e45-9671-4c6e-9b5b-04073a313de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:25.547516 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:25.557888 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 447/890] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:25 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:25.581715 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c32ca-01d6-4cda-b9e6-3c7bc79755e3 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:25.667733 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:25.687818 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c32ca-01d6-4cda-b9e6-3c7bc79755e3 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:25.722882 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437afb1-4405-44bb-8e4a-7ceb7b195861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:25.723530 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437afb1-4405-44bb-8e4a-7ceb7b195861 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:25.723810 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437afb1-4405-44bb-8e4a-7ceb7b195861 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:25.724084 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437afb1-4405-44bb-8e4a-7ceb7b195861 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:25.734789 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437afb1-4405-44bb-8e4a-7ceb7b195861 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:06:25.739506 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-e437afb1-4405-44bb-8e4a-7ceb7b195861 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 02:06:25.739506 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:25.739506 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:25.739506 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:25.739506 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:25.739506 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:25.739506 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:25.739506 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:25.739506 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:25.739506 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:25.739506 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:25.739506 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:25.739506 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:06:25.739506 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:06:25.739506 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:06:25.739506 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:06:25.740405 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:06:25.740405 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:06:25.740405 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:06:25.740405 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:06:25.740405 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:25.740405 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:25.740405 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:25.740405 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:25.740405 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:25.740405 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:25.740405 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:25.740405 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:25.740405 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:25.740405 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:25.740405 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:25.740405 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:25.741244 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:25.741244 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:25.741244 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:25.741244 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:25.741244 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:06:25.741244 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:06:25.741244 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:06:25.741244 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:06:25.741244 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:06:25.741244 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:06:25.741244 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 02:06:25.741244 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:25.741244 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 444/891] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Aug 8 02:06:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:25.746885 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c6e45-9671-4c6e-9b5b-04073a313de3 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:25.857016 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c6e45-9671-4c6e-9b5b-04073a313de3 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:25.891309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973b851-c206-4c86-a9fe-0a71f91c363a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:25.892014 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973b851-c206-4c86-a9fe-0a71f91c363a None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:25.892292 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973b851-c206-4c86-a9fe-0a71f91c363a None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:25.892561 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973b851-c206-4c86-a9fe-0a71f91c363a None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:25.893217 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8973b851-c206-4c86-a9fe-0a71f91c363a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:25.893517 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8973b851-c206-4c86-a9fe-0a71f91c363a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:25.894857 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8973b851-c206-4c86-a9fe-0a71f91c363a None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:25.903794 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 448/892] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Aug 8 02:06:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:25.909380 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437afb1-4405-44bb-8e4a-7ceb7b195861 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:26.015722 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437afb1-4405-44bb-8e4a-7ceb7b195861 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:26.053418 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74e8cd-852f-455b-8af3-90994e256d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:26.054065 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74e8cd-852f-455b-8af3-90994e256d46 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:26.054345 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74e8cd-852f-455b-8af3-90994e256d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:26.054617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74e8cd-852f-455b-8af3-90994e256d46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:26.065280 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:26.067990 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d74e8cd-852f-455b-8af3-90994e256d46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:26.069536 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d74e8cd-852f-455b-8af3-90994e256d46 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:26.085262 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-3d74e8cd-852f-455b-8af3-90994e256d46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:26.085262 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:26.085262 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:26.085262 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:26.085262 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:26.085262 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:26.085262 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:26.085262 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:26.085262 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:26.085262 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:26.085262 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:26.085262 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:26.085262 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:26.085262 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:26.085262 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:26.085262 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:26.086240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:26.086240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:26.086240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:26.086240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:26.086240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:26.086240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:26.086240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:26.086240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:26.086240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:26.086240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:26.086240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:26.086240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:26.086240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:26.086240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:26.086240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:26.086240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:26.086240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:26.087118 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:26.087118 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:26.087118 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:26.087118 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 445/893] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:26.092319 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973b851-c206-4c86-a9fe-0a71f91c363a None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:26.156168 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:26.194530 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973b851-c206-4c86-a9fe-0a71f91c363a None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:26.228742 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38118e01-3bb9-4adf-9dc0-f0917256c124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:26.229350 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38118e01-3bb9-4adf-9dc0-f0917256c124 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:26.229631 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38118e01-3bb9-4adf-9dc0-f0917256c124 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:26.229909 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38118e01-3bb9-4adf-9dc0-f0917256c124 None admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:26.230541 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38118e01-3bb9-4adf-9dc0-f0917256c124 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:26.230839 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38118e01-3bb9-4adf-9dc0-f0917256c124 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:26.232214 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38118e01-3bb9-4adf-9dc0-f0917256c124 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:26.244874 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 449/894] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:06:26.250446 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74e8cd-852f-455b-8af3-90994e256d46 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:26.356427 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74e8cd-852f-455b-8af3-90994e256d46 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:26.398633 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68537d93-342a-464e-9789-8128014b968f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:26.399274 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68537d93-342a-464e-9789-8128014b968f None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:26.399588 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68537d93-342a-464e-9789-8128014b968f None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:26.399863 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68537d93-342a-464e-9789-8128014b968f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:26.407949 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68537d93-342a-464e-9789-8128014b968f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:26.409403 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68537d93-342a-464e-9789-8128014b968f None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:26.421282 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-68537d93-342a-464e-9789-8128014b968f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 02:06:26.421282 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:26.421282 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:26.421282 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:26.421282 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:26.421282 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:26.421282 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:26.421282 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:26.421282 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:26.421282 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:26.421282 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:26.421282 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:26.421282 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:06:26.421282 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:06:26.421282 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:06:26.421282 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:06:26.422221 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:26.422221 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:26.422221 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:06:26.422221 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:26.422221 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:06:26.422221 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:26.422221 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:26.422221 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:26.422221 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:26.422221 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:26.422221 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:26.422221 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:26.422221 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:26.422221 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:26.422221 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:26.422221 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:26.422221 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:26.422221 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:26.423153 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:26.423153 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:26.423153 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:06:26.423153 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:06:26.423153 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:06:26.423153 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:06:26.423153 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:06:26.423153 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:06:26.423153 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 02:06:26.423153 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:26.423153 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 446/895] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Aug 8 02:06:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:26.429976 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38118e01-3bb9-4adf-9dc0-f0917256c124 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:26.532414 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38118e01-3bb9-4adf-9dc0-f0917256c124 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:26.551675 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:26.568424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73693abd-6ca3-48d0-993e-20a5d8d9110e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:26.574445 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73693abd-6ca3-48d0-993e-20a5d8d9110e None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:26.574445 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73693abd-6ca3-48d0-993e-20a5d8d9110e None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:26.574445 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73693abd-6ca3-48d0-993e-20a5d8d9110e None admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:26.574445 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73693abd-6ca3-48d0-993e-20a5d8d9110e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:26.574445 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73693abd-6ca3-48d0-993e-20a5d8d9110e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:26.574445 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73693abd-6ca3-48d0-993e-20a5d8d9110e None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:26.590421 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 450/896] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Aug 8 02:06:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:26.595986 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68537d93-342a-464e-9789-8128014b968f None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:26.653006 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:26.701823 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68537d93-342a-464e-9789-8128014b968f None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:26.736395 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5ec14-0adc-4036-aa31-60f622bda2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:26.737007 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5ec14-0adc-4036-aa31-60f622bda2aa None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:26.737294 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5ec14-0adc-4036-aa31-60f622bda2aa None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:26.737571 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5ec14-0adc-4036-aa31-60f622bda2aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:26.807854 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5ec14-0adc-4036-aa31-60f622bda2aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:26.809298 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5ec14-0adc-4036-aa31-60f622bda2aa None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:26.868245 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:26.877341 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292554e-4f85-41d2-94da-cb4a493bfb44 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:26.877632 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292554e-4f85-41d2-94da-cb4a493bfb44 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:26.877904 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292554e-4f85-41d2-94da-cb4a493bfb44 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:26.879388 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 451/897] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:06:26.885260 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd514d4-cc3d-4078-b556-5be6627fa703 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:26.885547 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd514d4-cc3d-4078-b556-5be6627fa703 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:26.885825 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd514d4-cc3d-4078-b556-5be6627fa703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:26.904007 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-1cd514d4-cc3d-4078-b556-5be6627fa703 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:26.905114 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-1cd514d4-cc3d-4078-b556-5be6627fa703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:26.919412 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 447/898] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:06:26 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:06:26.929655 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5ec14-0adc-4036-aa31-60f622bda2aa None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:26.995654 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 452/899] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:26 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:06:27.014372 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd514d4-cc3d-4078-b556-5be6627fa703 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:27.042970 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5ec14-0adc-4036-aa31-60f622bda2aa None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:27.079683 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ce672-5890-440e-a400-35018a5aaf71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:27.080662 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ce672-5890-440e-a400-35018a5aaf71 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:27.081089 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ce672-5890-440e-a400-35018a5aaf71 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:27.081504 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ce672-5890-440e-a400-35018a5aaf71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:27.092458 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ce672-5890-440e-a400-35018a5aaf71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:27.093896 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ce672-5890-440e-a400-35018a5aaf71 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:27.109687 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-797ce672-5890-440e-a400-35018a5aaf71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:27.109687 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:27.109687 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:27.109687 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:27.109687 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:27.109687 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:27.109687 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:27.109687 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:27.109687 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:27.109687 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:27.109687 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:27.109687 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:27.109687 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:27.109687 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:27.109687 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:27.109687 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:27.110614 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:27.110614 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:27.110614 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:27.110614 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:27.110614 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:27.110614 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:27.110614 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:27.110614 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:27.110614 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:27.110614 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:27.110614 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:27.110614 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:27.110614 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:27.110614 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:27.110614 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:27.110614 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:27.110614 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:27.111522 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:27.111522 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:27.111522 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:27.111522 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 448/900] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:27.112191 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fdc93-ee71-40c3-960f-4a4830f15ee2 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:27.112367 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fdc93-ee71-40c3-960f-4a4830f15ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:27.112606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fdc93-ee71-40c3-960f-4a4830f15ee2 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:27.115391 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 449/901] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:27.116301 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81fdc93-ee71-40c3-960f-4a4830f15ee2 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:27.120163 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:27.124946 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd514d4-cc3d-4078-b556-5be6627fa703 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:27.132538 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:27.159894 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da8c037-d3cd-4da4-a0ca-299849a69230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:27.160591 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8c037-d3cd-4da4-a0ca-299849a69230 None admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:27.160869 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8c037-d3cd-4da4-a0ca-299849a69230 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:27.161139 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8c037-d3cd-4da4-a0ca-299849a69230 None admin] PATH_INFO: `/v3/services` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:27.161790 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da8c037-d3cd-4da4-a0ca-299849a69230 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:27.163184 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da8c037-d3cd-4da4-a0ca-299849a69230 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:27.220812 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81fdc93-ee71-40c3-960f-4a4830f15ee2 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:27.247408 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 453/902] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Aug 8 02:06:27 2022] POST /identity/v3/services => generated 241 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:06:27.247408 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61d5cc-e799-445d-b175-9599905d23d1 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:27.247408 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61d5cc-e799-445d-b175-9599905d23d1 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:27.247408 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61d5cc-e799-445d-b175-9599905d23d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:27.267768 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-8b61d5cc-e799-445d-b175-9599905d23d1 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:27.269208 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-8b61d5cc-e799-445d-b175-9599905d23d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:27.271400 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0dfb9d-1634-43e3-be53-07d9fdf5c37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:27.272322 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0dfb9d-1634-43e3-be53-07d9fdf5c37d None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:27.273006 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0dfb9d-1634-43e3-be53-07d9fdf5c37d None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:27.273277 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0dfb9d-1634-43e3-be53-07d9fdf5c37d None admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:27.273985 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0dfb9d-1634-43e3-be53-07d9fdf5c37d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:27.274293 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0dfb9d-1634-43e3-be53-07d9fdf5c37d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:27.275723 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0dfb9d-1634-43e3-be53-07d9fdf5c37d None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:27.294571 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 450/903] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:27.295688 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0dfb9d-1634-43e3-be53-07d9fdf5c37d None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:27.351287 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 454/904] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:27.356823 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a81772-d4d1-47b9-9198-18f3bd363ac8 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:27.357115 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a81772-d4d1-47b9-9198-18f3bd363ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:27.357401 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a81772-d4d1-47b9-9198-18f3bd363ac8 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:27.358755 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 455/905] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:27.364782 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9e5ae-9e16-45d6-983f-cfc2c7762acd None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:27.365068 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9e5ae-9e16-45d6-983f-cfc2c7762acd None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:27.365332 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9e5ae-9e16-45d6-983f-cfc2c7762acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:27.374637 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:27.392130 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-d8a9e5ae-9e16-45d6-983f-cfc2c7762acd None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:27.393373 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-d8a9e5ae-9e16-45d6-983f-cfc2c7762acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:27.424749 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0dfb9d-1634-43e3-be53-07d9fdf5c37d None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:27.463273 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62018bd3-5572-4b25-8f3d-1fc2bc6815b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:27.463938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62018bd3-5572-4b25-8f3d-1fc2bc6815b3 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:27.464224 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62018bd3-5572-4b25-8f3d-1fc2bc6815b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:27.464502 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62018bd3-5572-4b25-8f3d-1fc2bc6815b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:27.471898 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62018bd3-5572-4b25-8f3d-1fc2bc6815b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:27.473009 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 456/906] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:27.473350 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62018bd3-5572-4b25-8f3d-1fc2bc6815b3 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:27.473730 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9e5ae-9e16-45d6-983f-cfc2c7762acd None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:27.490308 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-62018bd3-5572-4b25-8f3d-1fc2bc6815b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:27.490308 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:27.490308 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:27.490308 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:27.490308 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:27.490308 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:27.490308 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:27.490308 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:27.490308 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:27.490308 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:27.490308 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:27.490308 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:27.490308 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:06:27.490308 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:06:27.490308 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:06:27.491240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:06:27.491240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:27.491240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:27.491240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:27.491240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:27.491240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:27.491240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:27.491240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:27.491240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:27.491240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:27.491240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:27.491240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:27.491240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:27.491240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:27.491240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:27.491240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:27.491240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:27.492167 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:06:27.492167 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:06:27.492167 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:06:27.492167 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:06:27.492167 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:06:27.492167 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:06:27.492167 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:27.492167 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:27.492167 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 451/907] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:06:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:27.496604 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62018bd3-5572-4b25-8f3d-1fc2bc6815b3 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:27.509267 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:27.591289 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9e5ae-9e16-45d6-983f-cfc2c7762acd None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:27.608927 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62018bd3-5572-4b25-8f3d-1fc2bc6815b3 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:27.630377 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc43243-c3d2-452b-8649-0a5cb2d82003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:27.631089 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc43243-c3d2-452b-8649-0a5cb2d82003 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:27.631301 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc43243-c3d2-452b-8649-0a5cb2d82003 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:27.631611 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc43243-c3d2-452b-8649-0a5cb2d82003 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:27.632021 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:27.632195 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc43243-c3d2-452b-8649-0a5cb2d82003 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:27.633687 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc43243-c3d2-452b-8649-0a5cb2d82003 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:27.642595 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-dcc43243-c3d2-452b-8649-0a5cb2d82003 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 02:06:27.642595 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:27.642595 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:06:27.642595 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:06:27.642595 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:06:27.642595 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:06:27.642595 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:06:27.642595 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:27.642595 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 02:06:27.642595 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:27.642595 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:06:27.642595 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:27.642595 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:27.642595 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:27.642595 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:27.642595 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:27.642595 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:27.650032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:27.650032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:27.650032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:27.650032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:27.650032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:27.650032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:27.650032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:06:27.650032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:06:27.650032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:06:27.650032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:06:27.650032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:27.650032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:27.650032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:27.650032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:27.650032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:27.650032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:27.650898 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:27.650898 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:27.650898 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:27.650898 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:27.650898 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:27.650898 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:27.650898 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:27.650898 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:27.650898 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:27.650898 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:27.650898 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:06:27.650898 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:27.650898 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 02:06:27.650898 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:27.650898 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 457/908] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 02:06:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:27.652407 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc43243-c3d2-452b-8649-0a5cb2d82003 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:27.654198 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ccf2d8-9ff5-46f2-a2fe-b28a132cf79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:27.654880 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ccf2d8-9ff5-46f2-a2fe-b28a132cf79d None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:27.655164 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ccf2d8-9ff5-46f2-a2fe-b28a132cf79d None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:27.655469 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ccf2d8-9ff5-46f2-a2fe-b28a132cf79d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:27.656056 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ccf2d8-9ff5-46f2-a2fe-b28a132cf79d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:27.657415 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ccf2d8-9ff5-46f2-a2fe-b28a132cf79d None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:27.667692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-e3ccf2d8-9ff5-46f2-a2fe-b28a132cf79d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 02:06:27.667692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:27.667692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:06:27.667692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:06:27.667692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:06:27.667692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:06:27.667692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:06:27.667692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:27.667692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 02:06:27.667692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:27.667692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:06:27.667692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:27.667692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:27.667692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:27.667692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:27.667692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:27.668652 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:27.668652 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:27.668652 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:27.668652 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:27.668652 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:27.668652 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:27.668652 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:27.668652 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:06:27.668652 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:06:27.668652 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:06:27.668652 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:06:27.668652 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:27.668652 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:27.668652 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:27.668652 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:27.668652 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:27.668652 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:27.670542 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:27.670542 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:27.670542 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:27.670542 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:27.670542 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:27.670542 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:27.670542 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:27.670542 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:27.670542 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:27.670542 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:27.670542 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:06:27.670542 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:27.670542 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 02:06:27.670542 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:27.670542 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 452/909] 10.222.0.23 () {56 vars in 1132 bytes} [Mon Aug 8 02:06:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:27.672349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ccf2d8-9ff5-46f2-a2fe-b28a132cf79d None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:27.759469 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:27.770133 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc43243-c3d2-452b-8649-0a5cb2d82003 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:27.775092 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ccf2d8-9ff5-46f2-a2fe-b28a132cf79d None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:27.809160 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739cd8a1-3e91-4bfe-bf24-723f9f4e1560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:27.809774 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739cd8a1-3e91-4bfe-bf24-723f9f4e1560 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:27.810063 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739cd8a1-3e91-4bfe-bf24-723f9f4e1560 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:27.810336 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739cd8a1-3e91-4bfe-bf24-723f9f4e1560 None admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:27.811027 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739cd8a1-3e91-4bfe-bf24-723f9f4e1560 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:27.811337 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739cd8a1-3e91-4bfe-bf24-723f9f4e1560 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:27.812824 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739cd8a1-3e91-4bfe-bf24-723f9f4e1560 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:27.815742 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58e9ec-e5a7-47af-9146-67d553ec500e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:27.816519 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58e9ec-e5a7-47af-9146-67d553ec500e None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:27.816945 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58e9ec-e5a7-47af-9146-67d553ec500e None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:27.817390 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58e9ec-e5a7-47af-9146-67d553ec500e None admin] PATH_INFO: `/v3/services` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:27.818162 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b58e9ec-e5a7-47af-9146-67d553ec500e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:27.818615 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b58e9ec-e5a7-47af-9146-67d553ec500e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:27.820218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b58e9ec-e5a7-47af-9146-67d553ec500e None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:27.825694 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 453/910] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 02:06:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:27.826304 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 458/911] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 02:06:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:27.826880 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58e9ec-e5a7-47af-9146-67d553ec500e None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:27.831815 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739cd8a1-3e91-4bfe-bf24-723f9f4e1560 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:27.883289 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:27.937535 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58e9ec-e5a7-47af-9146-67d553ec500e None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:27.937945 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739cd8a1-3e91-4bfe-bf24-723f9f4e1560 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:27.974318 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808011d4-de4a-45f7-bd1f-aa596e6bed73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:27.974652 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee397e4-53c6-4b44-9dde-cd9fa6896931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:27.974939 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808011d4-de4a-45f7-bd1f-aa596e6bed73 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:27.975222 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808011d4-de4a-45f7-bd1f-aa596e6bed73 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:27.975348 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee397e4-53c6-4b44-9dde-cd9fa6896931 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:27.975576 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee397e4-53c6-4b44-9dde-cd9fa6896931 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:27.975650 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808011d4-de4a-45f7-bd1f-aa596e6bed73 None admin] PATH_INFO: `/v3/services` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:27.975804 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee397e4-53c6-4b44-9dde-cd9fa6896931 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:27.976226 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808011d4-de4a-45f7-bd1f-aa596e6bed73 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:27.976532 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee397e4-53c6-4b44-9dde-cd9fa6896931 None admin] RBAC: Adding query filter params (role.id=6078f0a415d84735a3dd5948e5bde324, scope.project.id=ebe178f5bce64a009bf690031676c89f, user.id=1d39439278814d4faac4cfb1e71aa4fc) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:27.977477 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808011d4-de4a-45f7-bd1f-aa596e6bed73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:27.977562 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee397e4-53c6-4b44-9dde-cd9fa6896931 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:27.978470 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808011d4-de4a-45f7-bd1f-aa596e6bed73 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:27.978764 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee397e4-53c6-4b44-9dde-cd9fa6896931 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:27.983581 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 454/912] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Aug 8 02:06:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:27.984379 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808011d4-de4a-45f7-bd1f-aa596e6bed73 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:27.995652 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 459/913] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:06:27 2022] GET /identity/v3/role_assignments?user.id=1d39439278814d4faac4cfb1e71aa4fc&scope.project.id=ebe178f5bce64a009bf690031676c89f&role.id=6078f0a415d84735a3dd5948e5bde324 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:06:27.995652 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee397e4-53c6-4b44-9dde-cd9fa6896931 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:28.011378 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:28.114589 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee397e4-53c6-4b44-9dde-cd9fa6896931 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:28.126503 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808011d4-de4a-45f7-bd1f-aa596e6bed73 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:28.141323 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:28.162376 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3cff1d-8622-4ef3-b507-bf93b452592d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:28.163095 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3cff1d-8622-4ef3-b507-bf93b452592d None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:28.163285 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3cff1d-8622-4ef3-b507-bf93b452592d None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:28.163587 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3cff1d-8622-4ef3-b507-bf93b452592d None admin] PATH_INFO: `/v3/services` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:28.164794 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3cff1d-8622-4ef3-b507-bf93b452592d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:28.165116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3cff1d-8622-4ef3-b507-bf93b452592d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:28.165723 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9fe21-52d3-4768-88be-e971cb83c9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:28.167110 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9fe21-52d3-4768-88be-e971cb83c9a1 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:28.167110 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9fe21-52d3-4768-88be-e971cb83c9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:28.167274 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3cff1d-8622-4ef3-b507-bf93b452592d None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:28.167344 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9fe21-52d3-4768-88be-e971cb83c9a1 None admin] PATH_INFO: `/v3/services` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:28.167344 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9fe21-52d3-4768-88be-e971cb83c9a1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:28.168308 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9fe21-52d3-4768-88be-e971cb83c9a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:28.169673 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9fe21-52d3-4768-88be-e971cb83c9a1 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:28.175450 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 460/914] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Aug 8 02:06:27 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:28.179422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3cff1d-8622-4ef3-b507-bf93b452592d None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:28.180765 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 455/915] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 02:06:27 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:28.186261 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9fe21-52d3-4768-88be-e971cb83c9a1 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:28.275133 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:28.304624 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3cff1d-8622-4ef3-b507-bf93b452592d None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:28.312643 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9fe21-52d3-4768-88be-e971cb83c9a1 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:28.353019 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7482ecc-747a-4f75-b83e-5f3e2250de76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:28.353019 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7482ecc-747a-4f75-b83e-5f3e2250de76 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:28.353019 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7482ecc-747a-4f75-b83e-5f3e2250de76 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:28.353019 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7482ecc-747a-4f75-b83e-5f3e2250de76 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:28.353441 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7482ecc-747a-4f75-b83e-5f3e2250de76 None admin] RBAC: Adding query filter params (interface=public, service_id=229283227d7846f09c7800569ef710f5, region_id=RegionOne) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:28.353441 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7482ecc-747a-4f75-b83e-5f3e2250de76 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:28.353990 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7482ecc-747a-4f75-b83e-5f3e2250de76 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:28.360133 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79645404-d3ae-4998-bccd-06cea78118e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:28.360747 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79645404-d3ae-4998-bccd-06cea78118e0 None admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:28.361158 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79645404-d3ae-4998-bccd-06cea78118e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:28.361366 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 461/916] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Aug 8 02:06:28 2022] GET /identity/v3/endpoints?service_id=229283227d7846f09c7800569ef710f5&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:06:28.363618 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79645404-d3ae-4998-bccd-06cea78118e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:28.364526 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79645404-d3ae-4998-bccd-06cea78118e0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:28.366386 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79645404-d3ae-4998-bccd-06cea78118e0 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:28.366571 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7482ecc-747a-4f75-b83e-5f3e2250de76 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:28.461497 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 456/917] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:06:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:06:28.488060 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7482ecc-747a-4f75-b83e-5f3e2250de76 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:28.538849 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f607d-b848-4d6e-bb9c-78149b49094b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:28.539666 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f607d-b848-4d6e-bb9c-78149b49094b None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:28.540142 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f607d-b848-4d6e-bb9c-78149b49094b None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:28.540664 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f607d-b848-4d6e-bb9c-78149b49094b None admin] PATH_INFO: `/v3/services` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:28.541577 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f607d-b848-4d6e-bb9c-78149b49094b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:28.543223 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f607d-b848-4d6e-bb9c-78149b49094b None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:28.554278 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 462/918] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Aug 8 02:06:28 2022] GET /identity/v3/services => generated 1497 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:06:29.324513 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344451e3-a68d-4bfd-9da9-f2b48a8cfdcc None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:29.325552 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344451e3-a68d-4bfd-9da9-f2b48a8cfdcc None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:29.326061 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344451e3-a68d-4bfd-9da9-f2b48a8cfdcc None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:29.327872 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 457/919] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:29.333075 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49fe3a-bb7b-47b5-82f3-6fb5b042d330 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:29.333852 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49fe3a-bb7b-47b5-82f3-6fb5b042d330 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:29.334348 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49fe3a-bb7b-47b5-82f3-6fb5b042d330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:29.340881 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:29.354156 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-ee49fe3a-bb7b-47b5-82f3-6fb5b042d330 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:29.355689 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-ee49fe3a-bb7b-47b5-82f3-6fb5b042d330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:29.427816 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 463/920] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:29.450898 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344451e3-a68d-4bfd-9da9-f2b48a8cfdcc None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:29.484215 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:29.557637 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344451e3-a68d-4bfd-9da9-f2b48a8cfdcc None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:29.593073 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ff5d3-dd18-485b-b3c4-60ad7ed87ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:29.593619 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ff5d3-dd18-485b-b3c4-60ad7ed87ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:29.593948 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ff5d3-dd18-485b-b3c4-60ad7ed87ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:29.594224 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ff5d3-dd18-485b-b3c4-60ad7ed87ad2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:29.594804 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ff5d3-dd18-485b-b3c4-60ad7ed87ad2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:29.596202 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ff5d3-dd18-485b-b3c4-60ad7ed87ad2 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:29.605839 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-045ff5d3-dd18-485b-b3c4-60ad7ed87ad2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:06:29.605839 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:29.605839 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:06:29.605839 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:06:29.605839 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:06:29.605839 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:06:29.605839 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:06:29.605839 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:29.605839 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:06:29.605839 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:29.605839 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:06:29.605839 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:29.605839 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:29.605839 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:29.605839 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:29.605839 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:29.605839 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:29.606813 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:29.606813 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:29.606813 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:29.606813 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:29.606813 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:29.606813 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:29.606813 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:06:29.606813 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:06:29.606813 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:06:29.606813 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:06:29.606813 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:29.606813 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:29.606813 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:29.606813 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:29.606813 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:29.606813 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:29.607673 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:29.607673 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:29.607673 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:29.607673 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:29.607673 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:29.607673 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:29.607673 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:29.607673 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:29.607673 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:29.607673 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:29.607673 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:06:29.607673 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:29.607673 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:06:29.607673 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:29.607673 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 458/921] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Aug 8 02:06:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:29.613188 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49fe3a-bb7b-47b5-82f3-6fb5b042d330 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:29.721310 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49fe3a-bb7b-47b5-82f3-6fb5b042d330 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:29.751868 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:29.756941 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f748a-80ae-408d-a8b2-0dad1b915d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:29.757544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f748a-80ae-408d-a8b2-0dad1b915d73 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:29.757821 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f748a-80ae-408d-a8b2-0dad1b915d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:29.758196 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f748a-80ae-408d-a8b2-0dad1b915d73 None admin] PATH_INFO: `/v3/services` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:29.758827 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3f748a-80ae-408d-a8b2-0dad1b915d73 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:29.759128 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3f748a-80ae-408d-a8b2-0dad1b915d73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:29.760569 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3f748a-80ae-408d-a8b2-0dad1b915d73 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:29.765476 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 464/922] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Aug 8 02:06:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:29.771002 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ff5d3-dd18-485b-b3c4-60ad7ed87ad2 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:29.875673 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:29.881618 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ff5d3-dd18-485b-b3c4-60ad7ed87ad2 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:29.915554 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd51358-1176-4338-9e72-4c75117dbfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:29.916431 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd51358-1176-4338-9e72-4c75117dbfe9 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:29.916894 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd51358-1176-4338-9e72-4c75117dbfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:29.917525 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd51358-1176-4338-9e72-4c75117dbfe9 None admin] PATH_INFO: `/v3/services` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:29.918157 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd51358-1176-4338-9e72-4c75117dbfe9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:29.918513 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd51358-1176-4338-9e72-4c75117dbfe9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:29.919975 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd51358-1176-4338-9e72-4c75117dbfe9 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:29.925057 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 459/923] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Aug 8 02:06:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:29.931769 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f748a-80ae-408d-a8b2-0dad1b915d73 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:30.033245 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f748a-80ae-408d-a8b2-0dad1b915d73 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:30.055670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e641d-ff46-4e40-bd40-733582d162bc None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:30.055970 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e641d-ff46-4e40-bd40-733582d162bc None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:30.056479 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e641d-ff46-4e40-bd40-733582d162bc None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:30.061566 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 460/924] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:06:30.063102 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520c3b6-ed2e-4254-aab8-a2454b1458eb None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:30.063418 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520c3b6-ed2e-4254-aab8-a2454b1458eb None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:30.063702 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520c3b6-ed2e-4254-aab8-a2454b1458eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:30.068539 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac6bf4-dca5-4e5b-a172-c164596e3845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:30.069140 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac6bf4-dca5-4e5b-a172-c164596e3845 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:30.069419 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac6bf4-dca5-4e5b-a172-c164596e3845 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:30.069689 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac6bf4-dca5-4e5b-a172-c164596e3845 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:30.070434 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac6bf4-dca5-4e5b-a172-c164596e3845 None admin] RBAC: Adding query filter params (interface=public, service_id=7890308b80824a9b86fbd0057b6a5774, region_id=RegionOne) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:30.070743 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac6bf4-dca5-4e5b-a172-c164596e3845 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:30.075394 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac6bf4-dca5-4e5b-a172-c164596e3845 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:30.077607 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 465/925] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Aug 8 02:06:29 2022] GET /identity/v3/endpoints?service_id=7890308b80824a9b86fbd0057b6a5774&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:30.083280 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac6bf4-dca5-4e5b-a172-c164596e3845 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:30.084514 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-c520c3b6-ed2e-4254-aab8-a2454b1458eb None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:30.085694 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-c520c3b6-ed2e-4254-aab8-a2454b1458eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:30.171441 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 461/926] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:30.171638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:30.192225 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520c3b6-ed2e-4254-aab8-a2454b1458eb None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:30.196517 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac6bf4-dca5-4e5b-a172-c164596e3845 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:30.234513 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346997cf-132c-49e3-a7e2-819a812be73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:30.235736 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346997cf-132c-49e3-a7e2-819a812be73a None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:30.236266 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346997cf-132c-49e3-a7e2-819a812be73a None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:30.236757 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346997cf-132c-49e3-a7e2-819a812be73a None admin] PATH_INFO: `/v3/services` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:30.237559 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346997cf-132c-49e3-a7e2-819a812be73a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:30.239332 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346997cf-132c-49e3-a7e2-819a812be73a None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:30.251383 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 466/927] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Aug 8 02:06:30 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:06:30.287611 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:30.297919 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520c3b6-ed2e-4254-aab8-a2454b1458eb None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:30.337360 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b4e59-6631-4811-96b6-1fbbddc90fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:30.338006 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b4e59-6631-4811-96b6-1fbbddc90fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:30.338269 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b4e59-6631-4811-96b6-1fbbddc90fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:30.338543 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b4e59-6631-4811-96b6-1fbbddc90fa6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:30.349999 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0b4e59-6631-4811-96b6-1fbbddc90fa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:06:30.355238 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-af0b4e59-6631-4811-96b6-1fbbddc90fa6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 02:06:30.355238 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:30.355238 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:30.355238 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:30.355238 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:30.355238 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:30.355238 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:30.355238 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:30.355238 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:30.355238 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:30.355238 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:30.355238 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:30.355238 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:06:30.355238 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:06:30.355238 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:06:30.355238 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:06:30.356200 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:06:30.356200 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:06:30.356200 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:06:30.356200 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:06:30.356200 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:30.356200 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:30.356200 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:30.356200 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:30.356200 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:30.356200 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:30.356200 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:30.356200 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:30.356200 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:30.356200 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:30.356200 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:30.356200 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:30.357037 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:30.357037 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:30.357037 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:30.357037 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:30.357037 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:06:30.357037 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:06:30.357037 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:06:30.357037 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:06:30.357037 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:06:30.357037 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:06:30.357037 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 02:06:30.357037 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:30.357037 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 462/928] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Aug 8 02:06:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:06:30.362813 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346997cf-132c-49e3-a7e2-819a812be73a None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:30.484138 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346997cf-132c-49e3-a7e2-819a812be73a None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:30.509688 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:30.520668 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9c4cb-52a9-40d8-9948-0a2adff71793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:30.521270 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9c4cb-52a9-40d8-9948-0a2adff71793 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:30.521548 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9c4cb-52a9-40d8-9948-0a2adff71793 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:30.526883 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9c4cb-52a9-40d8-9948-0a2adff71793 None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:30.526883 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd9c4cb-52a9-40d8-9948-0a2adff71793 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:30.526883 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd9c4cb-52a9-40d8-9948-0a2adff71793 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:30.526883 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd9c4cb-52a9-40d8-9948-0a2adff71793 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:30.533378 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 467/929] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Aug 8 02:06:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:30.538929 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b4e59-6631-4811-96b6-1fbbddc90fa6 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:30.642466 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe97718-13cd-460c-947f-2b3c48dac6f7 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:30.642798 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b4e59-6631-4811-96b6-1fbbddc90fa6 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:30.642903 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe97718-13cd-460c-947f-2b3c48dac6f7 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:30.643056 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe97718-13cd-460c-947f-2b3c48dac6f7 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:30.644523 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 468/930] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:06:30.649369 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707f89e-b7eb-493b-a596-66737dd2bd22 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:30.649656 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707f89e-b7eb-493b-a596-66737dd2bd22 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:30.649926 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707f89e-b7eb-493b-a596-66737dd2bd22 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:30.651299 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 469/931] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:30.652193 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc8e9b-0f38-4b15-b4c7-7a2e457f71fb None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:30.652469 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc8e9b-0f38-4b15-b4c7-7a2e457f71fb None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:30.652743 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc8e9b-0f38-4b15-b4c7-7a2e457f71fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:30.671894 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-76dc8e9b-0f38-4b15-b4c7-7a2e457f71fb None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:30.673177 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-76dc8e9b-0f38-4b15-b4c7-7a2e457f71fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:30.683009 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50734cd-e7bc-444d-97f5-decc95a80a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:30.683668 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50734cd-e7bc-444d-97f5-decc95a80a98 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:30.683948 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50734cd-e7bc-444d-97f5-decc95a80a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:30.684220 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50734cd-e7bc-444d-97f5-decc95a80a98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:30.694313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50734cd-e7bc-444d-97f5-decc95a80a98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:30.695833 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50734cd-e7bc-444d-97f5-decc95a80a98 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:30.709997 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-e50734cd-e7bc-444d-97f5-decc95a80a98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:30.709997 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:30.709997 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:30.709997 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:30.709997 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:30.709997 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:30.709997 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:30.709997 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:30.709997 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:30.709997 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:30.709997 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:30.709997 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:30.709997 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:30.709997 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:30.709997 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:30.709997 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:30.711583 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:30.711583 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:30.711583 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:30.711583 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:30.711583 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:30.711583 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:30.711583 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:30.711583 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:30.711583 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:30.711583 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:30.711583 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:30.711583 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:30.711583 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:30.711583 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:30.711583 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:30.711583 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:30.711583 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:30.712490 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:30.712490 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:30.712490 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:30.712490 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 463/932] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:30.713288 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fd61d-cd66-49f1-be9f-79a561f2b248 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:30.713288 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fd61d-cd66-49f1-be9f-79a561f2b248 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:30.713288 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fd61d-cd66-49f1-be9f-79a561f2b248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:30.719398 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:30.732668 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-c19fd61d-cd66-49f1-be9f-79a561f2b248 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:30.733831 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-c19fd61d-cd66-49f1-be9f-79a561f2b248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:30.762674 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 470/933] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:30.768228 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc8e9b-0f38-4b15-b4c7-7a2e457f71fb None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:30.810817 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 464/934] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:30.811969 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19fd61d-cd66-49f1-be9f-79a561f2b248 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:30.879120 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc8e9b-0f38-4b15-b4c7-7a2e457f71fb None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:30.898914 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:30.919005 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135b2d4-6969-4506-8f2d-d41246260ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:30.919678 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135b2d4-6969-4506-8f2d-d41246260ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:30.919960 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135b2d4-6969-4506-8f2d-d41246260ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:30.920231 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135b2d4-6969-4506-8f2d-d41246260ad7 None admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:30.920863 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135b2d4-6969-4506-8f2d-d41246260ad7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:30.921168 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135b2d4-6969-4506-8f2d-d41246260ad7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:30.922499 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135b2d4-6969-4506-8f2d-d41246260ad7 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:30.928143 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19fd61d-cd66-49f1-be9f-79a561f2b248 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:30.940285 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 471/935] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:30.940285 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135b2d4-6969-4506-8f2d-d41246260ad7 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:30.965032 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:30.970834 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a7420-29b4-45d1-a9e8-867871978fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:30.971541 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a7420-29b4-45d1-a9e8-867871978fd0 None admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:30.971806 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a7420-29b4-45d1-a9e8-867871978fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:30.977352 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a7420-29b4-45d1-a9e8-867871978fd0 None admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:30.977352 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a7420-29b4-45d1-a9e8-867871978fd0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:30.977352 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a7420-29b4-45d1-a9e8-867871978fd0 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:30.977352 dv-cinder-740146-18-smb devstack@keystone.service[80637]: WARNING keystone.server.flask.common [None req-643a7420-29b4-45d1-a9e8-867871978fd0 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 08 02:06:31.020707 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.sql.core [None req-643a7420-29b4-45d1-a9e8-867871978fd0 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 08 02:06:31.020707 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 08 02:06:31.020707 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [parameters: {'id': '7000616deb2a497ba955f50c833bba52', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 08 02:06:31.020707 dv-cinder-740146-18-smb devstack@keystone.service[80637]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80637) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 08 02:06:31.028126 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-643a7420-29b4-45d1-a9e8-867871978fd0 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7000616deb2a497ba955f50c833bba52.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7000616deb2a497ba955f50c833bba52. Aug 08 02:06:31.028126 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:31.028126 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 08 02:06:31.028126 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 08 02:06:31.028126 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 08 02:06:31.028126 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 08 02:06:31.028126 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 08 02:06:31.028126 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application result = self._query(query) Aug 08 02:06:31.028126 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 08 02:06:31.028126 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application conn.query(q) Aug 08 02:06:31.028126 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 08 02:06:31.028126 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 08 02:06:31.028126 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 08 02:06:31.029290 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application result.read() Aug 08 02:06:31.029290 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 08 02:06:31.029290 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 08 02:06:31.029290 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 08 02:06:31.029290 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 08 02:06:31.029290 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 08 02:06:31.029290 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 08 02:06:31.029290 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 08 02:06:31.029290 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 08 02:06:31.029290 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 08 02:06:31.029290 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:31.029290 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 08 02:06:31.029290 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:31.029290 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:31.029290 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 08 02:06:31.029290 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 08 02:06:31.029290 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 08 02:06:31.029290 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 08 02:06:31.030233 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 08 02:06:31.030233 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application next(self.gen) Aug 08 02:06:31.030233 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 08 02:06:31.030233 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application yield resource Aug 08 02:06:31.030233 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 08 02:06:31.030233 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application next(self.gen) Aug 08 02:06:31.030233 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 08 02:06:31.030233 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self.session.rollback() Aug 08 02:06:31.030233 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 08 02:06:31.030233 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self.force_reraise() Aug 08 02:06:31.030233 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 08 02:06:31.030233 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise self.value Aug 08 02:06:31.030233 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 08 02:06:31.030233 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 08 02:06:31.030233 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 08 02:06:31.030233 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application session.commit() Aug 08 02:06:31.030233 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 08 02:06:31.031587 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 08 02:06:31.031587 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 08 02:06:31.031587 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self._prepare_impl() Aug 08 02:06:31.031587 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 08 02:06:31.031587 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self.session.flush() Aug 08 02:06:31.031587 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 08 02:06:31.031587 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self._flush(objects) Aug 08 02:06:31.031587 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 08 02:06:31.031587 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 08 02:06:31.031587 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 08 02:06:31.031587 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application compat.raise_( Aug 08 02:06:31.031587 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 08 02:06:31.031587 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception Aug 08 02:06:31.031587 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 08 02:06:31.031587 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application flush_context.execute() Aug 08 02:06:31.031587 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 08 02:06:31.031587 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rec.execute(self) Aug 08 02:06:31.032715 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 08 02:06:31.032715 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 08 02:06:31.032715 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 08 02:06:31.032715 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 08 02:06:31.032715 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 08 02:06:31.032715 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 08 02:06:31.032715 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 08 02:06:31.032715 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 08 02:06:31.032715 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 08 02:06:31.032715 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 08 02:06:31.032715 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 08 02:06:31.032715 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 08 02:06:31.032715 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 08 02:06:31.032715 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 08 02:06:31.032715 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 08 02:06:31.033699 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 08 02:06:31.033699 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 08 02:06:31.033699 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception Aug 08 02:06:31.033699 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 08 02:06:31.033699 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 08 02:06:31.033699 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 08 02:06:31.033699 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 08 02:06:31.033699 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 08 02:06:31.033699 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application result = self._query(query) Aug 08 02:06:31.033699 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 08 02:06:31.033699 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application conn.query(q) Aug 08 02:06:31.033699 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 08 02:06:31.033699 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 08 02:06:31.033699 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 08 02:06:31.033699 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application result.read() Aug 08 02:06:31.033699 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 08 02:06:31.033699 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 08 02:06:31.034940 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 08 02:06:31.034940 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 08 02:06:31.034940 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 08 02:06:31.034940 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 08 02:06:31.034940 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 08 02:06:31.034940 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 08 02:06:31.034940 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 08 02:06:31.034940 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 08 02:06:31.034940 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [parameters: {'id': '7000616deb2a497ba955f50c833bba52', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 08 02:06:31.034940 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 08 02:06:31.034940 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:31.034940 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:06:31.034940 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:31.034940 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:31.034940 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 08 02:06:31.035988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 08 02:06:31.035988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 08 02:06:31.035988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 08 02:06:31.035988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 08 02:06:31.035988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:31.035988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:06:31.035988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:31.035988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:31.035988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:31.035988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:31.035988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:31.035988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:31.035988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:31.035988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:31.035988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:31.035988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:31.035988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:31.037113 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:31.037113 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 08 02:06:31.037113 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 08 02:06:31.037113 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:31.037113 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:31.037113 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 08 02:06:31.037113 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 08 02:06:31.037113 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7000616deb2a497ba955f50c833bba52. Aug 08 02:06:31.037113 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:31.037113 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 465/936] 10.222.0.23 () {60 vars in 1140 bytes} [Mon Aug 8 02:06:30 2022] POST /identity/v3/projects => generated 262 bytes in 218 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:31.037113 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a7420-29b4-45d1-a9e8-867871978fd0 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:31.051534 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135b2d4-6969-4506-8f2d-d41246260ad7 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:31.091562 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf3e01-d525-43e4-9363-ba384bd02b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:31.092187 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf3e01-d525-43e4-9363-ba384bd02b88 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:31.092463 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf3e01-d525-43e4-9363-ba384bd02b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:31.092735 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf3e01-d525-43e4-9363-ba384bd02b88 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:31.093310 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf3e01-d525-43e4-9363-ba384bd02b88 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:31.094652 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf3e01-d525-43e4-9363-ba384bd02b88 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:31.104071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-dcbf3e01-d525-43e4-9363-ba384bd02b88 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 02:06:31.104071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:31.104071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:06:31.104071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:06:31.104071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:06:31.104071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:06:31.104071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:06:31.104071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:31.104071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 02:06:31.104071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:31.104071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:06:31.104071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:31.104071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:31.104071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:31.104071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:31.104071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:31.105006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:31.105006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:31.105006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:31.105006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:31.105006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:31.105006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:31.105006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:31.105006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:06:31.105006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:06:31.105006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:06:31.105006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:06:31.105006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:31.105006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:31.105006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:31.105006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:31.105006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:31.105006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:31.105870 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:31.105870 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:31.105870 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:31.105870 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:31.105870 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:31.105870 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:31.105870 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:31.105870 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:31.105870 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:31.105870 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:31.105870 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:06:31.105870 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:31.105870 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 02:06:31.105870 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:31.105870 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 472/937] 10.222.0.23 () {56 vars in 1132 bytes} [Mon Aug 8 02:06:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:31.106657 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf3e01-d525-43e4-9363-ba384bd02b88 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:31.144688 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a7420-29b4-45d1-a9e8-867871978fd0 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:31.152562 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:31.180294 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc397f8e-2cc7-4267-a76e-64a397c6d458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:31.180919 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc397f8e-2cc7-4267-a76e-64a397c6d458 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:31.181203 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc397f8e-2cc7-4267-a76e-64a397c6d458 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:31.181734 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc397f8e-2cc7-4267-a76e-64a397c6d458 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:31.189902 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc397f8e-2cc7-4267-a76e-64a397c6d458 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:31.191553 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc397f8e-2cc7-4267-a76e-64a397c6d458 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:31.203384 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-cc397f8e-2cc7-4267-a76e-64a397c6d458 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 02:06:31.203384 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:31.203384 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:31.203384 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:31.203384 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:31.203384 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:31.203384 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:31.203384 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:31.203384 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:31.203384 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:31.203384 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:31.203384 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:31.203384 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:06:31.203384 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:06:31.203384 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:06:31.203384 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:06:31.204495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:31.204495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:31.204495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:06:31.204495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:31.204495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:06:31.204495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:31.204495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:31.204495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:31.204495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:31.204495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:31.204495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:31.204495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:31.204495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:31.204495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:31.204495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:31.204495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:31.204495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:31.204495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:31.205434 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:31.205434 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:31.205434 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:06:31.205434 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:06:31.205434 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:06:31.205434 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:06:31.205434 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:06:31.205434 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:06:31.205434 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 02:06:31.205434 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:31.205434 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 466/938] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Aug 8 02:06:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:31.206015 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc397f8e-2cc7-4267-a76e-64a397c6d458 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:31.219087 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf3e01-d525-43e4-9363-ba384bd02b88 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:31.254608 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbb003-f873-44e0-8185-461c7a3ff0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:31.255235 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbb003-f873-44e0-8185-461c7a3ff0db None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:31.255549 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbb003-f873-44e0-8185-461c7a3ff0db None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:31.255827 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbb003-f873-44e0-8185-461c7a3ff0db None admin] PATH_INFO: `/v3/projects/service` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:31.260550 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:31.262708 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fbb003-f873-44e0-8185-461c7a3ff0db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:31.264165 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fbb003-f873-44e0-8185-461c7a3ff0db None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:31.275768 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-85fbb003-f873-44e0-8185-461c7a3ff0db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:31.275768 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:31.275768 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:31.275768 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:31.275768 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:31.275768 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:31.275768 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:31.275768 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:31.275768 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:31.275768 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:31.275768 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:31.275768 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:31.275768 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:06:31.275768 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:06:31.275768 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:06:31.276638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:06:31.276638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:31.276638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:31.276638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:31.276638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:31.276638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:31.276638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:31.276638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:31.276638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:31.276638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:31.276638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:31.276638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:31.276638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:31.276638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:31.276638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:31.276638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:31.276638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:31.277496 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:06:31.277496 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:06:31.277496 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:06:31.277496 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:06:31.277496 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:06:31.277496 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:06:31.277496 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:31.277496 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:31.277496 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 473/939] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:06:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:31.277967 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbb003-f873-44e0-8185-461c7a3ff0db None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:31.318047 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc397f8e-2cc7-4267-a76e-64a397c6d458 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:31.352869 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383223e4-b6c9-46ee-b165-495c1378b30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:31.353620 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383223e4-b6c9-46ee-b165-495c1378b30e None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:31.353863 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383223e4-b6c9-46ee-b165-495c1378b30e None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:31.354136 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383223e4-b6c9-46ee-b165-495c1378b30e None admin] PATH_INFO: `/v3/services` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:31.354755 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383223e4-b6c9-46ee-b165-495c1378b30e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:31.355053 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383223e4-b6c9-46ee-b165-495c1378b30e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:31.356454 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383223e4-b6c9-46ee-b165-495c1378b30e None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:31.369067 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 467/940] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Aug 8 02:06:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:31.369067 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383223e4-b6c9-46ee-b165-495c1378b30e None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:31.392440 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:31.396079 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbb003-f873-44e0-8185-461c7a3ff0db None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:31.432826 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecc1ee-fa60-42f8-a23f-6a54f77be352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:31.433434 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecc1ee-fa60-42f8-a23f-6a54f77be352 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:31.433774 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecc1ee-fa60-42f8-a23f-6a54f77be352 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:31.434050 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecc1ee-fa60-42f8-a23f-6a54f77be352 None admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:31.434796 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecc1ee-fa60-42f8-a23f-6a54f77be352 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:31.435100 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecc1ee-fa60-42f8-a23f-6a54f77be352 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:31.436540 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecc1ee-fa60-42f8-a23f-6a54f77be352 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:31.453834 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 474/941] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Aug 8 02:06:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:31.454924 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecc1ee-fa60-42f8-a23f-6a54f77be352 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:31.480658 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383223e4-b6c9-46ee-b165-495c1378b30e None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:31.494546 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:31.515349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd8cb8-2f67-43e4-9574-4075751b8d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:31.515983 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd8cb8-2f67-43e4-9574-4075751b8d95 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:31.516267 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd8cb8-2f67-43e4-9574-4075751b8d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:31.516546 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd8cb8-2f67-43e4-9574-4075751b8d95 None admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:31.517206 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd8cb8-2f67-43e4-9574-4075751b8d95 None admin] RBAC: Adding query filter params (name=service) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:31.517515 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd8cb8-2f67-43e4-9574-4075751b8d95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:31.518938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd8cb8-2f67-43e4-9574-4075751b8d95 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:31.543460 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 468/942] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Aug 8 02:06:31 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:31.543460 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd8cb8-2f67-43e4-9574-4075751b8d95 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:31.574187 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecc1ee-fa60-42f8-a23f-6a54f77be352 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:31.624167 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248c58b-bcbb-4963-844e-de87d9946c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:31.624892 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248c58b-bcbb-4963-844e-de87d9946c7b None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:31.625353 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248c58b-bcbb-4963-844e-de87d9946c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:31.625630 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248c58b-bcbb-4963-844e-de87d9946c7b None admin] PATH_INFO: `/v3/services` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:31.627201 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248c58b-bcbb-4963-844e-de87d9946c7b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:31.627546 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248c58b-bcbb-4963-844e-de87d9946c7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:31.628972 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248c58b-bcbb-4963-844e-de87d9946c7b None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:31.636302 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 475/943] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Aug 8 02:06:31 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:31.642444 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248c58b-bcbb-4963-844e-de87d9946c7b None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:31.669625 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd8cb8-2f67-43e4-9574-4075751b8d95 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:31.676765 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:31.710069 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38e2be-dc3b-4ad4-a3d7-9b9c5c0d5ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:31.710705 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38e2be-dc3b-4ad4-a3d7-9b9c5c0d5ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:31.711098 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38e2be-dc3b-4ad4-a3d7-9b9c5c0d5ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:31.711467 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38e2be-dc3b-4ad4-a3d7-9b9c5c0d5ce8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:31.727258 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38e2be-dc3b-4ad4-a3d7-9b9c5c0d5ce8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:31.728774 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38e2be-dc3b-4ad4-a3d7-9b9c5c0d5ce8 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:31.745933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-6b38e2be-dc3b-4ad4-a3d7-9b9c5c0d5ce8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:31.745933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:31.745933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:31.745933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:31.745933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:31.745933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:31.745933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:31.745933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:31.745933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:31.745933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:31.745933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:31.745933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:31.745933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:31.745933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:31.745933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:31.745933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:31.746907 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:31.746907 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:31.746907 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:31.746907 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:31.746907 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:31.746907 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:31.746907 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:31.746907 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:31.746907 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:31.746907 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:31.746907 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:31.746907 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:31.746907 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:31.746907 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:31.746907 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:31.746907 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:31.746907 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:31.747916 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:31.747916 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:31.747916 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:31.747916 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 469/944] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:31.753549 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38e2be-dc3b-4ad4-a3d7-9b9c5c0d5ce8 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:31.776032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248c58b-bcbb-4963-844e-de87d9946c7b None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:31.783833 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:31.820857 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f7baf-bcc6-435c-8cb9-8e4d9fd29d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:31.821393 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f7baf-bcc6-435c-8cb9-8e4d9fd29d6b None admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:31.821672 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f7baf-bcc6-435c-8cb9-8e4d9fd29d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:31.821945 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f7baf-bcc6-435c-8cb9-8e4d9fd29d6b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:31.822616 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f7baf-bcc6-435c-8cb9-8e4d9fd29d6b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:31.824049 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f7baf-bcc6-435c-8cb9-8e4d9fd29d6b None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:31.878948 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38e2be-dc3b-4ad4-a3d7-9b9c5c0d5ce8 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:31.914747 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a79b1-26ec-4dfa-8835-181ecf0e7fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:31.915387 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a79b1-26ec-4dfa-8835-181ecf0e7fae None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:31.915639 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a79b1-26ec-4dfa-8835-181ecf0e7fae None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:31.916113 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a79b1-26ec-4dfa-8835-181ecf0e7fae None admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:31.916316 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 476/945] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:06:31 2022] POST /identity/v3/endpoints => generated 347 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:06:31.916608 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a79b1-26ec-4dfa-8835-181ecf0e7fae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:31.916918 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a79b1-26ec-4dfa-8835-181ecf0e7fae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:31.918288 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a79b1-26ec-4dfa-8835-181ecf0e7fae None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:31.937780 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 470/946] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:31.943119 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f7baf-bcc6-435c-8cb9-8e4d9fd29d6b None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:32.037851 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:32.067755 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f7baf-bcc6-435c-8cb9-8e4d9fd29d6b None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:32.106805 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8048f1-97c5-47fd-8f0f-431331ecc2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:32.109218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8048f1-97c5-47fd-8f0f-431331ecc2d5 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:32.109218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8048f1-97c5-47fd-8f0f-431331ecc2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:32.109218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8048f1-97c5-47fd-8f0f-431331ecc2d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:32.116983 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8048f1-97c5-47fd-8f0f-431331ecc2d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:32.119637 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8048f1-97c5-47fd-8f0f-431331ecc2d5 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:32.131952 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-5d8048f1-97c5-47fd-8f0f-431331ecc2d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:32.131952 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:32.131952 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:32.131952 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:32.131952 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:32.131952 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:32.131952 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:32.131952 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:32.131952 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:32.131952 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:32.131952 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:32.131952 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:32.131952 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:06:32.131952 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:06:32.131952 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:06:32.132904 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:06:32.132904 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:32.132904 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:32.132904 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:32.132904 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:32.132904 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:32.132904 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:32.132904 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:32.132904 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:32.132904 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:32.132904 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:32.132904 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:32.132904 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:32.132904 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:32.132904 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:32.132904 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:32.132904 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:32.133789 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:06:32.133789 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:06:32.133789 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:06:32.133789 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:06:32.133789 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:06:32.133789 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:06:32.133789 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:32.133789 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:32.133789 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 477/947] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:06:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:32.140100 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a79b1-26ec-4dfa-8835-181ecf0e7fae None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:32.239984 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:32.264618 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a79b1-26ec-4dfa-8835-181ecf0e7fae None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:32.299209 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39d93b-c486-4125-befd-1327ccf16c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:32.299856 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39d93b-c486-4125-befd-1327ccf16c30 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:32.300135 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39d93b-c486-4125-befd-1327ccf16c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:32.300409 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39d93b-c486-4125-befd-1327ccf16c30 None admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:32.301087 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39d93b-c486-4125-befd-1327ccf16c30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:32.301394 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39d93b-c486-4125-befd-1327ccf16c30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:32.303001 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39d93b-c486-4125-befd-1327ccf16c30 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:32.316576 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 471/948] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 02:06:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:06:32.322768 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0b031-f52e-43eb-a73b-a01f214d4aff None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:32.323056 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0b031-f52e-43eb-a73b-a01f214d4aff None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:32.323333 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0b031-f52e-43eb-a73b-a01f214d4aff None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:32.324291 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39d93b-c486-4125-befd-1327ccf16c30 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:32.325032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 478/949] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:32.329826 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee52f11-3fcd-4073-a7f9-34d0a8affa85 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:32.330117 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee52f11-3fcd-4073-a7f9-34d0a8affa85 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:32.330429 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee52f11-3fcd-4073-a7f9-34d0a8affa85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:32.351259 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-1ee52f11-3fcd-4073-a7f9-34d0a8affa85 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:32.353084 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-1ee52f11-3fcd-4073-a7f9-34d0a8affa85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:32.440480 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39d93b-c486-4125-befd-1327ccf16c30 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:32.455045 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 479/950] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:06:32.479057 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee52f11-3fcd-4073-a7f9-34d0a8affa85 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:32.486089 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eac0f5-05c1-406a-93b3-3817a1008399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:32.486931 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eac0f5-05c1-406a-93b3-3817a1008399 None admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:32.487793 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eac0f5-05c1-406a-93b3-3817a1008399 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:32.488177 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eac0f5-05c1-406a-93b3-3817a1008399 None admin] PATH_INFO: `/v3/projects/ebe178f5bce64a009bf690031676c89f/users/1d39439278814d4faac4cfb1e71aa4fc/roles/6078f0a415d84735a3dd5948e5bde324` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:32.491183 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eac0f5-05c1-406a-93b3-3817a1008399 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebe178f5bce64a009bf690031676c89f, user_id=1d39439278814d4faac4cfb1e71aa4fc, role_id=6078f0a415d84735a3dd5948e5bde324)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:32.493079 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eac0f5-05c1-406a-93b3-3817a1008399 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:32.543839 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:32.566583 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 472/951] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 02:06:32 2022] PUT /identity/v3/projects/ebe178f5bce64a009bf690031676c89f/users/1d39439278814d4faac4cfb1e71aa4fc/roles/6078f0a415d84735a3dd5948e5bde324 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:06:32.594646 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee52f11-3fcd-4073-a7f9-34d0a8affa85 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:32.633805 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b861745-4f56-4666-8469-34a9908851fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:32.634450 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b861745-4f56-4666-8469-34a9908851fe None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:32.634799 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b861745-4f56-4666-8469-34a9908851fe None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:32.635077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b861745-4f56-4666-8469-34a9908851fe None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:32.635702 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b861745-4f56-4666-8469-34a9908851fe None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:32.637256 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b861745-4f56-4666-8469-34a9908851fe None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:32.646936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-9b861745-4f56-4666-8469-34a9908851fe None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:06:32.646936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:32.646936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:06:32.646936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:06:32.646936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:06:32.646936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:06:32.646936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:06:32.646936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:32.646936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:06:32.646936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:32.646936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:06:32.646936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:32.646936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:32.646936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:32.646936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:32.646936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:32.646936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:32.648301 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:32.648301 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:32.648301 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:32.648301 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:32.648301 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:32.648301 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:32.648301 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:06:32.648301 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:06:32.648301 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:06:32.648301 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:06:32.648301 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:32.648301 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:32.648301 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:32.648301 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:32.648301 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:32.648301 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:32.649284 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:32.649284 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:32.649284 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:32.649284 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:32.649284 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:32.649284 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:32.649284 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:32.649284 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:32.649284 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:32.649284 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:32.649284 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:06:32.649284 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:32.649284 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:06:32.649284 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:32.649284 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 480/952] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Aug 8 02:06:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:06:32.656981 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eac0f5-05c1-406a-93b3-3817a1008399 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:32.674432 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:32.785026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eac0f5-05c1-406a-93b3-3817a1008399 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:32.823897 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67452171-cfb1-43ae-8787-3f7080bb88de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:32.824517 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67452171-cfb1-43ae-8787-3f7080bb88de None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:32.824797 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67452171-cfb1-43ae-8787-3f7080bb88de None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:32.825072 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67452171-cfb1-43ae-8787-3f7080bb88de None admin] PATH_INFO: `/v3/services` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:32.825705 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67452171-cfb1-43ae-8787-3f7080bb88de None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:32.826012 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67452171-cfb1-43ae-8787-3f7080bb88de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:32.827384 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67452171-cfb1-43ae-8787-3f7080bb88de None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:32.832746 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 473/953] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Aug 8 02:06:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:32.839166 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b861745-4f56-4666-8469-34a9908851fe None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:32.946192 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b861745-4f56-4666-8469-34a9908851fe None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:32.973967 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:32.982494 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478fe1a0-3d00-4ea1-a356-d77d998fae48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:32.989866 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fe1a0-3d00-4ea1-a356-d77d998fae48 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:32.989866 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fe1a0-3d00-4ea1-a356-d77d998fae48 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:32.989866 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fe1a0-3d00-4ea1-a356-d77d998fae48 None admin] PATH_INFO: `/v3/services` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:32.989866 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478fe1a0-3d00-4ea1-a356-d77d998fae48 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:32.989866 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478fe1a0-3d00-4ea1-a356-d77d998fae48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:32.989866 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478fe1a0-3d00-4ea1-a356-d77d998fae48 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:32.991154 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 481/954] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Aug 8 02:06:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:32.997502 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67452171-cfb1-43ae-8787-3f7080bb88de None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:33.068634 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:33.105657 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67452171-cfb1-43ae-8787-3f7080bb88de None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:33.146486 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8740ac-572e-444e-9acf-ac52dac12929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:33.147447 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8740ac-572e-444e-9acf-ac52dac12929 None admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:33.148119 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8740ac-572e-444e-9acf-ac52dac12929 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:33.148943 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8740ac-572e-444e-9acf-ac52dac12929 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:33.150268 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8740ac-572e-444e-9acf-ac52dac12929 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:33.152277 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8740ac-572e-444e-9acf-ac52dac12929 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:33.227688 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 474/955] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:06:32 2022] POST /identity/v3/endpoints => generated 349 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:06:33.732122 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490cfff4-268d-4536-b160-70c99ad8d009 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:33.732644 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490cfff4-268d-4536-b160-70c99ad8d009 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:33.732762 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490cfff4-268d-4536-b160-70c99ad8d009 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:33.734318 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 482/956] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:33.739643 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3daa4f-2459-4a3e-824b-599dcb8ef0c6 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:33.740123 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3daa4f-2459-4a3e-824b-599dcb8ef0c6 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:33.740400 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3daa4f-2459-4a3e-824b-599dcb8ef0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:33.760717 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-3d3daa4f-2459-4a3e-824b-599dcb8ef0c6 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:33.762359 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-3d3daa4f-2459-4a3e-824b-599dcb8ef0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:33.846799 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 475/957] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:33.872339 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490cfff4-268d-4536-b160-70c99ad8d009 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:33.982265 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490cfff4-268d-4536-b160-70c99ad8d009 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:34.018511 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639ae52-0610-4e4d-98f7-2690152a7f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:34.019118 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639ae52-0610-4e4d-98f7-2690152a7f33 None admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:34.019427 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639ae52-0610-4e4d-98f7-2690152a7f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:34.019708 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639ae52-0610-4e4d-98f7-2690152a7f33 None admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:34.020357 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d639ae52-0610-4e4d-98f7-2690152a7f33 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:34.021784 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d639ae52-0610-4e4d-98f7-2690152a7f33 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:34.024364 dv-cinder-740146-18-smb devstack@keystone.service[80638]: WARNING keystone.server.flask.common [None req-d639ae52-0610-4e4d-98f7-2690152a7f33 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 08 02:06:34.059921 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b916936-7de7-43fa-b533-045ac9c7b8ee None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:34.060268 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b916936-7de7-43fa-b533-045ac9c7b8ee None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:34.060483 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b916936-7de7-43fa-b533-045ac9c7b8ee None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:34.061844 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 476/958] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:06:34.066850 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b005b8-1752-4872-891d-78e9a0358ecd None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:34.067143 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b005b8-1752-4872-891d-78e9a0358ecd None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:34.067449 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b005b8-1752-4872-891d-78e9a0358ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:34.071922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.sql.core [None req-d639ae52-0610-4e4d-98f7-2690152a7f33 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 08 02:06:34.071922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 08 02:06:34.071922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [parameters: {'user_id': '339873a62e534b3e992b56727bf680e6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 08 02:06:34.071922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80638) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 08 02:06:34.087636 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-d639ae52-0610-4e4d-98f7-2690152a7f33 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 08 02:06:34.087636 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:34.087636 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 08 02:06:34.087636 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 08 02:06:34.087636 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 08 02:06:34.087636 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 08 02:06:34.087636 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 08 02:06:34.087636 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application result = self._query(query) Aug 08 02:06:34.087636 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 08 02:06:34.087636 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application conn.query(q) Aug 08 02:06:34.087636 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 08 02:06:34.087636 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 08 02:06:34.087636 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 08 02:06:34.087636 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application result.read() Aug 08 02:06:34.087636 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 08 02:06:34.088635 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 08 02:06:34.088635 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 08 02:06:34.088635 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 08 02:06:34.088635 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 08 02:06:34.088635 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 08 02:06:34.088635 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 08 02:06:34.088635 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 08 02:06:34.088635 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 08 02:06:34.088635 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:34.088635 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 08 02:06:34.088635 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:34.088635 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:34.088635 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 08 02:06:34.088635 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 08 02:06:34.088635 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 08 02:06:34.088635 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 08 02:06:34.088635 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 08 02:06:34.088635 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application next(self.gen) Aug 08 02:06:34.089621 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 08 02:06:34.089621 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application yield resource Aug 08 02:06:34.089621 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 08 02:06:34.089621 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application next(self.gen) Aug 08 02:06:34.089621 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 08 02:06:34.089621 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application self.session.rollback() Aug 08 02:06:34.089621 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 08 02:06:34.089621 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application self.force_reraise() Aug 08 02:06:34.089621 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 08 02:06:34.089621 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise self.value Aug 08 02:06:34.089621 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 08 02:06:34.089621 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 08 02:06:34.089621 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 08 02:06:34.089621 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application session.commit() Aug 08 02:06:34.089621 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 08 02:06:34.089621 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 08 02:06:34.089621 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 08 02:06:34.090544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application self._prepare_impl() Aug 08 02:06:34.090544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 08 02:06:34.090544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application self.session.flush() Aug 08 02:06:34.090544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 08 02:06:34.090544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application self._flush(objects) Aug 08 02:06:34.090544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 08 02:06:34.090544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 08 02:06:34.090544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 08 02:06:34.090544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application compat.raise_( Aug 08 02:06:34.090544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 08 02:06:34.090544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception Aug 08 02:06:34.090544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 08 02:06:34.090544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application flush_context.execute() Aug 08 02:06:34.090544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 08 02:06:34.090544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rec.execute(self) Aug 08 02:06:34.090544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 08 02:06:34.090544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 08 02:06:34.091562 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 08 02:06:34.091562 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 08 02:06:34.091562 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 08 02:06:34.091562 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 08 02:06:34.091562 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 08 02:06:34.091562 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 08 02:06:34.091562 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 08 02:06:34.091562 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 08 02:06:34.091562 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 08 02:06:34.091562 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 08 02:06:34.091562 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 08 02:06:34.091562 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 08 02:06:34.091562 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 08 02:06:34.091562 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 08 02:06:34.091562 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 08 02:06:34.091562 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception Aug 08 02:06:34.092419 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 08 02:06:34.092419 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 08 02:06:34.092419 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 08 02:06:34.092419 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 08 02:06:34.092419 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 08 02:06:34.092419 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application result = self._query(query) Aug 08 02:06:34.092419 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 08 02:06:34.092419 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application conn.query(q) Aug 08 02:06:34.092419 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 08 02:06:34.092419 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 08 02:06:34.092419 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 08 02:06:34.092419 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application result.read() Aug 08 02:06:34.092419 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 08 02:06:34.092419 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 08 02:06:34.092419 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 08 02:06:34.092419 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 08 02:06:34.093240 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 08 02:06:34.093240 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 08 02:06:34.093240 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 08 02:06:34.093240 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 08 02:06:34.093240 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 08 02:06:34.093240 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 08 02:06:34.093240 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [parameters: {'user_id': '339873a62e534b3e992b56727bf680e6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 08 02:06:34.093240 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 08 02:06:34.093240 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:34.093240 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:06:34.093240 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:34.093240 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:34.093240 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:34.093240 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:34.093240 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:34.094055 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:34.094055 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:34.094055 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:34.094055 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:34.094055 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:34.094055 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:34.094055 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:34.094055 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 08 02:06:34.094055 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 08 02:06:34.094055 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:34.094055 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:34.094055 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:06:34.094055 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:34.094055 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:06:34.094055 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:34.094055 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 08 02:06:34.094055 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 08 02:06:34.097068 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 08 02:06:34.097068 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 08 02:06:34.097068 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 08 02:06:34.097068 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 08 02:06:34.097068 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 08 02:06:34.097068 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:34.097068 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 483/959] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Aug 8 02:06:33 2022] POST /identity/v3/users => generated 160 bytes in 217 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:34.097068 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639ae52-0610-4e4d-98f7-2690152a7f33 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:34.103133 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-69b005b8-1752-4872-891d-78e9a0358ecd None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:34.104623 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-69b005b8-1752-4872-891d-78e9a0358ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:34.155526 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:34.173914 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:34.201660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 477/960] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:06:34.207385 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639ae52-0610-4e4d-98f7-2690152a7f33 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:34.223174 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b005b8-1752-4872-891d-78e9a0358ecd None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:34.241752 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4b546-b13a-4c02-a7e8-67018579912f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:34.242921 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4b546-b13a-4c02-a7e8-67018579912f None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:34.243386 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4b546-b13a-4c02-a7e8-67018579912f None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:34.247123 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4b546-b13a-4c02-a7e8-67018579912f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:34.251735 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4b546-b13a-4c02-a7e8-67018579912f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:34.253513 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4b546-b13a-4c02-a7e8-67018579912f None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:34.265731 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-d4f4b546-b13a-4c02-a7e8-67018579912f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 02:06:34.265731 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:34.265731 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:34.265731 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:34.265731 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:34.265731 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:34.265731 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:34.265731 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:34.265731 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:34.265731 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:34.265731 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:34.265731 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:34.265731 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:06:34.265731 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:06:34.265731 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:06:34.265731 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:06:34.266890 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:34.266890 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:34.266890 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:06:34.266890 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:34.266890 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:06:34.266890 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:34.266890 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:34.266890 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:34.266890 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:34.266890 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:34.266890 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:34.266890 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:34.266890 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:34.266890 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:34.266890 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:34.266890 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:34.266890 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:34.266890 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:34.268132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:34.268132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:34.268132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:06:34.268132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:06:34.268132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:06:34.268132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:06:34.268132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:06:34.268132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:06:34.268132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 02:06:34.268132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:34.273664 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 484/961] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:06:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:34.274923 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4b546-b13a-4c02-a7e8-67018579912f None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:34.334071 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b005b8-1752-4872-891d-78e9a0358ecd None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:34.370345 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4d357-8849-453b-b9cc-a517af906679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:34.371079 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4d357-8849-453b-b9cc-a517af906679 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:34.371537 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4d357-8849-453b-b9cc-a517af906679 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:34.371879 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4d357-8849-453b-b9cc-a517af906679 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:34.372552 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d4d357-8849-453b-b9cc-a517af906679 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:34.373977 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d4d357-8849-453b-b9cc-a517af906679 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:34.383218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-25d4d357-8849-453b-b9cc-a517af906679 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 02:06:34.383218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:34.383218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:06:34.383218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:06:34.383218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:06:34.383218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:06:34.383218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:06:34.383218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:34.383218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 02:06:34.383218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:34.383218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:06:34.383218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:34.383218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:34.383218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:34.383218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:34.383218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:34.383218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:34.384421 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:34.384421 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:34.384421 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:34.384421 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:34.384421 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:34.384421 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:34.384421 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:06:34.384421 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:06:34.384421 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:06:34.384421 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:06:34.384421 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:34.384421 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:34.384421 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:34.384421 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:34.384421 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:34.384421 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:34.385380 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:34.385380 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:34.385380 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:34.385380 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:34.385380 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:34.385380 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:34.385380 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:34.385380 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:34.385380 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:34.385380 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:34.385380 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:06:34.385380 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:34.385380 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 02:06:34.385380 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:34.385380 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 478/962] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:06:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:06:34.390420 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4b546-b13a-4c02-a7e8-67018579912f None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:34.395011 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4d357-8849-453b-b9cc-a517af906679 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:34.414205 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:34.437870 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7b47c-cfda-4518-8469-e29da3ffaeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:34.438915 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7b47c-cfda-4518-8469-e29da3ffaeb6 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:34.439487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7b47c-cfda-4518-8469-e29da3ffaeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:34.440038 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7b47c-cfda-4518-8469-e29da3ffaeb6 None admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:34.441048 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7b47c-cfda-4518-8469-e29da3ffaeb6 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:34.441628 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7b47c-cfda-4518-8469-e29da3ffaeb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:34.443318 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7b47c-cfda-4518-8469-e29da3ffaeb6 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:34.452647 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:34.491531 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 485/963] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 02:06:34 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:34.516055 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4d357-8849-453b-b9cc-a517af906679 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:34.554356 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04f06e-1452-4d79-96c3-64d9c889efa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:34.555531 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04f06e-1452-4d79-96c3-64d9c889efa7 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:34.555816 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04f06e-1452-4d79-96c3-64d9c889efa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:34.556093 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04f06e-1452-4d79-96c3-64d9c889efa7 None admin] PATH_INFO: `/v3/services` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:34.556989 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd04f06e-1452-4d79-96c3-64d9c889efa7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:34.557295 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd04f06e-1452-4d79-96c3-64d9c889efa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:34.558811 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd04f06e-1452-4d79-96c3-64d9c889efa7 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:34.564668 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 479/964] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Aug 8 02:06:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:06:34.570441 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7b47c-cfda-4518-8469-e29da3ffaeb6 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:34.685198 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7b47c-cfda-4518-8469-e29da3ffaeb6 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:34.723981 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989657bb-b54f-4351-a094-db990632c915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:34.724971 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989657bb-b54f-4351-a094-db990632c915 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:34.725456 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989657bb-b54f-4351-a094-db990632c915 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:34.725984 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989657bb-b54f-4351-a094-db990632c915 None admin] PATH_INFO: `/v3/services` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:34.727425 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989657bb-b54f-4351-a094-db990632c915 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:34.728064 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989657bb-b54f-4351-a094-db990632c915 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:34.729620 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989657bb-b54f-4351-a094-db990632c915 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:34.729750 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a8317-1fc2-4cbb-9818-c4a473cf35dd None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:34.729980 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a8317-1fc2-4cbb-9818-c4a473cf35dd None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:34.730257 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a8317-1fc2-4cbb-9818-c4a473cf35dd None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:34.731874 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 480/965] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:34.737114 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198b372-93bb-4e3f-b8f5-55ad9086cb1d None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:34.737408 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198b372-93bb-4e3f-b8f5-55ad9086cb1d None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:34.737691 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198b372-93bb-4e3f-b8f5-55ad9086cb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:34.738340 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 486/966] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Aug 8 02:06:34 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:34.758307 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-2198b372-93bb-4e3f-b8f5-55ad9086cb1d None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:34.759591 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-2198b372-93bb-4e3f-b8f5-55ad9086cb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:34.838077 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 481/967] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:06:34.862034 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989657bb-b54f-4351-a094-db990632c915 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:34.900337 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:34.972016 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989657bb-b54f-4351-a094-db990632c915 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:35.006216 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b9683-0e75-4bdf-a1e9-02b895c9eb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:35.006850 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b9683-0e75-4bdf-a1e9-02b895c9eb2d None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:35.007137 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b9683-0e75-4bdf-a1e9-02b895c9eb2d None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:35.007445 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b9683-0e75-4bdf-a1e9-02b895c9eb2d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:35.017875 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b9683-0e75-4bdf-a1e9-02b895c9eb2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:06:35.022542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-cc8b9683-0e75-4bdf-a1e9-02b895c9eb2d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 02:06:35.022542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:35.022542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:35.022542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:35.022542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:35.022542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:35.022542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:35.022542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:35.022542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:35.022542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:35.022542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:35.022542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:35.022542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:06:35.022542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:06:35.022542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:06:35.022542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:06:35.024060 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:06:35.024060 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:06:35.024060 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:06:35.024060 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:06:35.024060 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:35.024060 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:35.024060 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:35.024060 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:35.024060 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:35.024060 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:35.024060 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:35.024060 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:35.024060 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:35.024060 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:35.024060 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:35.024060 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:35.024907 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:35.024907 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:35.024907 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:35.024907 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:35.024907 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:06:35.024907 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:06:35.024907 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:06:35.024907 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:06:35.024907 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:06:35.024907 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:06:35.024907 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 02:06:35.024907 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:35.026134 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 487/968] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Aug 8 02:06:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:35.030579 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2198b372-93bb-4e3f-b8f5-55ad9086cb1d None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:35.070664 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:35.130749 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2198b372-93bb-4e3f-b8f5-55ad9086cb1d None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:35.165234 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b9fea-8f8f-4e66-a644-ffa6b96f7cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:35.165939 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b9fea-8f8f-4e66-a644-ffa6b96f7cef None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:35.166287 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b9fea-8f8f-4e66-a644-ffa6b96f7cef None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:35.166629 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b9fea-8f8f-4e66-a644-ffa6b96f7cef None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:35.167382 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b9fea-8f8f-4e66-a644-ffa6b96f7cef None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:35.167767 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b9fea-8f8f-4e66-a644-ffa6b96f7cef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:35.169208 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b9fea-8f8f-4e66-a644-ffa6b96f7cef None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:35.183048 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 482/969] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Aug 8 02:06:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:35.184242 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b9683-0e75-4bdf-a1e9-02b895c9eb2d None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:35.281788 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:35.287983 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b9683-0e75-4bdf-a1e9-02b895c9eb2d None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:35.321997 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa324f-745b-4140-93c3-dd256aea3eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:35.322623 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa324f-745b-4140-93c3-dd256aea3eed None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:35.322904 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa324f-745b-4140-93c3-dd256aea3eed None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:35.323180 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa324f-745b-4140-93c3-dd256aea3eed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:35.330948 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8497c39-81ea-4231-a558-ecddc76f8b73 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:35.331231 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8497c39-81ea-4231-a558-ecddc76f8b73 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:35.331533 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8497c39-81ea-4231-a558-ecddc76f8b73 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:35.333036 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 483/970] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:35.335001 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fa324f-745b-4140-93c3-dd256aea3eed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:35.336564 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fa324f-745b-4140-93c3-dd256aea3eed None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:35.337808 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b903f0-ecf8-4823-b573-d7c796ae4d14 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:35.338098 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b903f0-ecf8-4823-b573-d7c796ae4d14 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:35.338382 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b903f0-ecf8-4823-b573-d7c796ae4d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:35.351075 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-85fa324f-745b-4140-93c3-dd256aea3eed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:35.351075 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:35.351075 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:35.351075 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:35.351075 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:35.351075 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:35.351075 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:35.351075 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:35.351075 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:35.351075 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:35.351075 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:35.351075 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:35.351075 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:35.351075 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:35.351075 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:35.351075 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:35.352923 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:35.352923 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:35.352923 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:35.352923 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:35.352923 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:35.352923 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:35.352923 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:35.352923 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:35.352923 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:35.352923 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:35.352923 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:35.352923 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:35.352923 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:35.352923 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:35.352923 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:35.352923 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:35.352923 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:35.354366 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:35.354366 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:35.354366 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:35.354366 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 488/971] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:06:35.357419 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-98b903f0-ecf8-4823-b573-d7c796ae4d14 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:35.358454 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa324f-745b-4140-93c3-dd256aea3eed None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:35.358782 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-98b903f0-ecf8-4823-b573-d7c796ae4d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:35.441584 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 484/972] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:35.463699 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b903f0-ecf8-4823-b573-d7c796ae4d14 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:35.474159 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa324f-745b-4140-93c3-dd256aea3eed None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:35.496534 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:35.510364 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b63df-abe5-4e87-9413-e292f6a412c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:35.510963 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b63df-abe5-4e87-9413-e292f6a412c2 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:35.511295 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b63df-abe5-4e87-9413-e292f6a412c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:35.511600 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b63df-abe5-4e87-9413-e292f6a412c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:35.512282 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b63df-abe5-4e87-9413-e292f6a412c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:35.512588 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b63df-abe5-4e87-9413-e292f6a412c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:35.514032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b63df-abe5-4e87-9413-e292f6a412c2 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:35.527406 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 489/973] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:35.532727 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b63df-abe5-4e87-9413-e292f6a412c2 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:35.543393 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:35.568832 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b903f0-ecf8-4823-b573-d7c796ae4d14 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:35.602459 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d6e3b-7d1d-4dd7-8a65-9410efb779f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:35.603117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d6e3b-7d1d-4dd7-8a65-9410efb779f0 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:35.603419 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d6e3b-7d1d-4dd7-8a65-9410efb779f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:35.603697 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d6e3b-7d1d-4dd7-8a65-9410efb779f0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:35.604273 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d6e3b-7d1d-4dd7-8a65-9410efb779f0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:35.605625 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d6e3b-7d1d-4dd7-8a65-9410efb779f0 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:35.614012 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-3a9d6e3b-7d1d-4dd7-8a65-9410efb779f0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:06:35.614012 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:35.614012 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:06:35.614012 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:06:35.614012 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:06:35.614012 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:06:35.614012 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:06:35.614012 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:35.614012 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:06:35.614012 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:35.614012 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:06:35.614012 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:35.614012 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:35.614012 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:35.614012 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:35.614012 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:35.614012 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:35.614972 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:35.614972 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:35.614972 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:35.614972 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:35.614972 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:35.614972 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:35.614972 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:06:35.614972 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:06:35.614972 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:06:35.614972 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:06:35.614972 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:35.614972 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:35.614972 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:35.614972 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:35.614972 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:35.614972 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:35.615837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:35.615837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:35.615837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:35.615837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:35.615837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:35.615837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:35.615837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:35.615837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:35.615837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:35.615837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:35.615837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:06:35.615837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:35.615837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:06:35.615837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:35.615837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 485/974] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Aug 8 02:06:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:06:35.621573 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d6e3b-7d1d-4dd7-8a65-9410efb779f0 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:35.639614 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b63df-abe5-4e87-9413-e292f6a412c2 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:35.673382 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196d0d1-1a81-49f8-a9a2-376fa78229eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:35.674091 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196d0d1-1a81-49f8-a9a2-376fa78229eb None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:35.674463 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196d0d1-1a81-49f8-a9a2-376fa78229eb None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:35.674809 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196d0d1-1a81-49f8-a9a2-376fa78229eb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:35.684553 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6196d0d1-1a81-49f8-a9a2-376fa78229eb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:35.686664 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6196d0d1-1a81-49f8-a9a2-376fa78229eb None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:35.700116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-6196d0d1-1a81-49f8-a9a2-376fa78229eb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 02:06:35.700116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:35.700116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:35.700116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:35.700116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:35.700116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:35.700116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:35.700116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:35.700116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:35.700116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:35.700116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:35.700116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:35.700116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:06:35.700116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:06:35.700116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:06:35.700116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:06:35.701218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:35.701218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:35.701218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:06:35.701218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:35.701218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:06:35.701218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:35.701218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:35.701218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:35.701218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:35.701218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:35.701218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:35.701218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:35.701218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:35.701218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:35.701218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:35.701218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:35.701218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:35.701218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:35.702383 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:35.702383 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:35.702383 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:06:35.702383 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:06:35.702383 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:06:35.702383 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:06:35.702383 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:06:35.702383 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:06:35.702383 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 02:06:35.702383 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:35.705971 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 490/975] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Aug 8 02:06:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:06:35.706625 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196d0d1-1a81-49f8-a9a2-376fa78229eb None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:35.721681 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:35.728574 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d6e3b-7d1d-4dd7-8a65-9410efb779f0 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:35.764799 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8282c8a-53f5-404a-93d3-e7c0ea66306e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:35.765445 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8282c8a-53f5-404a-93d3-e7c0ea66306e None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:35.765675 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8282c8a-53f5-404a-93d3-e7c0ea66306e None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:35.765939 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8282c8a-53f5-404a-93d3-e7c0ea66306e None admin] PATH_INFO: `/v3/services` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:35.766568 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8282c8a-53f5-404a-93d3-e7c0ea66306e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:35.766877 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8282c8a-53f5-404a-93d3-e7c0ea66306e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:35.768262 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8282c8a-53f5-404a-93d3-e7c0ea66306e None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:35.773246 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 486/976] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Aug 8 02:06:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:06:35.776685 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:35.779211 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8282c8a-53f5-404a-93d3-e7c0ea66306e None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:35.810725 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196d0d1-1a81-49f8-a9a2-376fa78229eb None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:35.845920 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006976b-c17a-403f-8127-320f3089095d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:35.846640 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006976b-c17a-403f-8127-320f3089095d None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:35.846924 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006976b-c17a-403f-8127-320f3089095d None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:35.847216 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006976b-c17a-403f-8127-320f3089095d None admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:35.847963 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006976b-c17a-403f-8127-320f3089095d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:35.848270 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006976b-c17a-403f-8127-320f3089095d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:35.849827 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006976b-c17a-403f-8127-320f3089095d None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:35.872148 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 491/977] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Aug 8 02:06:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:06:35.877561 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006976b-c17a-403f-8127-320f3089095d None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:35.896523 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8282c8a-53f5-404a-93d3-e7c0ea66306e None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:35.935869 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b73825-aa03-4acd-920c-400af30a3ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:35.936492 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b73825-aa03-4acd-920c-400af30a3ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:35.936778 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b73825-aa03-4acd-920c-400af30a3ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:35.937058 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b73825-aa03-4acd-920c-400af30a3ca6 None admin] PATH_INFO: `/v3/services` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:35.937691 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b73825-aa03-4acd-920c-400af30a3ca6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:35.938000 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b73825-aa03-4acd-920c-400af30a3ca6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:35.939696 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b73825-aa03-4acd-920c-400af30a3ca6 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:35.950222 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 487/978] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Aug 8 02:06:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:35.951281 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b73825-aa03-4acd-920c-400af30a3ca6 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:35.981214 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:35.986575 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006976b-c17a-403f-8127-320f3089095d None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:36.012225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:36.020689 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b686e4-bdcc-4604-84ed-6ec72b13af8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:36.021301 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b686e4-bdcc-4604-84ed-6ec72b13af8f None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:36.021583 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b686e4-bdcc-4604-84ed-6ec72b13af8f None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:36.021859 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b686e4-bdcc-4604-84ed-6ec72b13af8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:36.065978 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b73825-aa03-4acd-920c-400af30a3ca6 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:36.093083 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b686e4-bdcc-4604-84ed-6ec72b13af8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:36.094822 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b686e4-bdcc-4604-84ed-6ec72b13af8f None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:36.101127 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ed32c-cca3-4483-ae87-d79cc6ab65a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:36.102255 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ed32c-cca3-4483-ae87-d79cc6ab65a0 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:36.102536 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ed32c-cca3-4483-ae87-d79cc6ab65a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:36.102809 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ed32c-cca3-4483-ae87-d79cc6ab65a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:36.103540 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ed32c-cca3-4483-ae87-d79cc6ab65a0 None admin] RBAC: Adding query filter params (interface=admin, service_id=7890308b80824a9b86fbd0057b6a5774, region_id=RegionOne) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:36.103850 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ed32c-cca3-4483-ae87-d79cc6ab65a0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:36.105191 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ed32c-cca3-4483-ae87-d79cc6ab65a0 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:36.110337 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 488/979] 10.222.0.23 () {56 vars in 1249 bytes} [Mon Aug 8 02:06:35 2022] GET /identity/v3/endpoints?service_id=7890308b80824a9b86fbd0057b6a5774&interface=admin®ion_id=RegionOne => generated 193 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:36.115923 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ed32c-cca3-4483-ae87-d79cc6ab65a0 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:36.202450 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 492/980] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:06:35 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:06:36.207945 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b686e4-bdcc-4604-84ed-6ec72b13af8f None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:36.208212 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:36.223548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ed32c-cca3-4483-ae87-d79cc6ab65a0 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:36.236848 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:36.260860 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495aef97-e7e7-4bf1-98e1-194dfd8804b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:36.261847 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495aef97-e7e7-4bf1-98e1-194dfd8804b2 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:36.262132 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495aef97-e7e7-4bf1-98e1-194dfd8804b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:36.262406 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495aef97-e7e7-4bf1-98e1-194dfd8804b2 None admin] PATH_INFO: `/v3/services` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:36.263012 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495aef97-e7e7-4bf1-98e1-194dfd8804b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:36.264814 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495aef97-e7e7-4bf1-98e1-194dfd8804b2 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:36.270930 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 489/981] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Aug 8 02:06:36 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:06:36.325422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b686e4-bdcc-4604-84ed-6ec72b13af8f None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:36.363479 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c0e60-3e61-46f3-8ed1-8959d64b6417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:36.364123 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c0e60-3e61-46f3-8ed1-8959d64b6417 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:36.364406 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c0e60-3e61-46f3-8ed1-8959d64b6417 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:36.364683 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c0e60-3e61-46f3-8ed1-8959d64b6417 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:36.376716 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c0e60-3e61-46f3-8ed1-8959d64b6417 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:36.380614 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c0e60-3e61-46f3-8ed1-8959d64b6417 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:36.401262 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-f18c0e60-3e61-46f3-8ed1-8959d64b6417 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:36.401262 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:36.401262 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:36.401262 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:36.401262 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:36.401262 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:36.401262 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:36.401262 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:36.401262 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:36.401262 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:36.401262 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:36.401262 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:36.401262 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:36.401262 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:36.401262 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:36.401262 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:36.402487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:36.402487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:36.402487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:36.402487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:36.402487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:36.402487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:36.402487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:36.402487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:36.402487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:36.402487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:36.402487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:36.402487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:36.402487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:36.402487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:36.402487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:36.402487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:36.402487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:36.403793 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:36.403793 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:36.403793 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:36.407762 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 493/982] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:06:36.409428 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495aef97-e7e7-4bf1-98e1-194dfd8804b2 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:36.513767 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495aef97-e7e7-4bf1-98e1-194dfd8804b2 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:36.546463 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dccaab-f1e8-45b4-944b-1a3721358dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:36.547064 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dccaab-f1e8-45b4-944b-1a3721358dbc None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:36.547342 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dccaab-f1e8-45b4-944b-1a3721358dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:36.547640 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dccaab-f1e8-45b4-944b-1a3721358dbc None admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:36.548268 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dccaab-f1e8-45b4-944b-1a3721358dbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:36.548569 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dccaab-f1e8-45b4-944b-1a3721358dbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:36.549925 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dccaab-f1e8-45b4-944b-1a3721358dbc None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:36.562661 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 490/983] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:06:36.568227 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c0e60-3e61-46f3-8ed1-8959d64b6417 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:36.649742 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:36.670126 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c0e60-3e61-46f3-8ed1-8959d64b6417 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:36.704205 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f154863-dc97-4a45-a78c-1d15470b0bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:36.704827 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f154863-dc97-4a45-a78c-1d15470b0bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:36.705107 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f154863-dc97-4a45-a78c-1d15470b0bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:36.705379 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f154863-dc97-4a45-a78c-1d15470b0bb4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:36.711976 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f154863-dc97-4a45-a78c-1d15470b0bb4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:36.713390 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f154863-dc97-4a45-a78c-1d15470b0bb4 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:36.724279 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-9f154863-dc97-4a45-a78c-1d15470b0bb4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:36.724279 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:36.724279 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:36.724279 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:36.724279 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:36.724279 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:36.724279 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:36.724279 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:36.724279 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:36.724279 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:36.724279 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:36.724279 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:36.724279 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:06:36.724279 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:06:36.724279 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:06:36.725183 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:06:36.725183 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:36.725183 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:36.725183 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:36.725183 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:36.725183 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:36.725183 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:36.725183 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:36.725183 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:36.725183 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:36.725183 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:36.725183 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:36.725183 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:36.725183 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:36.725183 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:36.725183 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:36.725183 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:36.726065 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:06:36.726065 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:06:36.726065 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:06:36.726065 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:06:36.726065 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:06:36.726065 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:06:36.726065 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:36.726065 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:36.727428 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 494/984] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:06:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:36.732611 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dccaab-f1e8-45b4-944b-1a3721358dbc None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:36.745582 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:36.833634 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297c9b2-4f4a-46f8-bbf7-366f3a54fb4f None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:36.834129 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297c9b2-4f4a-46f8-bbf7-366f3a54fb4f None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:36.834207 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297c9b2-4f4a-46f8-bbf7-366f3a54fb4f None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:36.834575 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dccaab-f1e8-45b4-944b-1a3721358dbc None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:36.835654 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 495/985] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:06:36.840361 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf904825-3715-42c6-9465-566914490f4e None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:36.840644 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf904825-3715-42c6-9465-566914490f4e None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:36.840915 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf904825-3715-42c6-9465-566914490f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:36.859436 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-cf904825-3715-42c6-9465-566914490f4e None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:36.860945 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-cf904825-3715-42c6-9465-566914490f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:36.870380 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa1bb1-00cf-41b7-b02f-2ee1db518a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:36.871302 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa1bb1-00cf-41b7-b02f-2ee1db518a81 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:36.871756 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa1bb1-00cf-41b7-b02f-2ee1db518a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:36.872293 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa1bb1-00cf-41b7-b02f-2ee1db518a81 None admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:36.872987 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fa1bb1-00cf-41b7-b02f-2ee1db518a81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:36.873292 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fa1bb1-00cf-41b7-b02f-2ee1db518a81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:36.874919 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fa1bb1-00cf-41b7-b02f-2ee1db518a81 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:36.888300 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 491/986] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 02:06:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:36.894051 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa1bb1-00cf-41b7-b02f-2ee1db518a81 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:36.936637 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 496/987] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:06:36.959108 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf904825-3715-42c6-9465-566914490f4e None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:36.976731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:37.022713 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa1bb1-00cf-41b7-b02f-2ee1db518a81 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:37.035015 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:37.057709 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bce25f-947b-4147-8f42-27cf6ac920fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:37.058117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bce25f-947b-4147-8f42-27cf6ac920fa None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:37.058399 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bce25f-947b-4147-8f42-27cf6ac920fa None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:37.058675 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bce25f-947b-4147-8f42-27cf6ac920fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:37.059505 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bce25f-947b-4147-8f42-27cf6ac920fa None admin] RBAC: Adding query filter params (role.id=6078f0a415d84735a3dd5948e5bde324, scope.project.id=ebe178f5bce64a009bf690031676c89f, user.id=1d39439278814d4faac4cfb1e71aa4fc) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:37.059820 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bce25f-947b-4147-8f42-27cf6ac920fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:37.061281 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bce25f-947b-4147-8f42-27cf6ac920fa None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:37.075416 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 492/988] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:06:36 2022] GET /identity/v3/role_assignments?user.id=1d39439278814d4faac4cfb1e71aa4fc&scope.project.id=ebe178f5bce64a009bf690031676c89f&role.id=6078f0a415d84735a3dd5948e5bde324 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:06:37.079127 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf904825-3715-42c6-9465-566914490f4e None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:37.117718 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88185db1-8de2-4be7-a6c4-11cb650ccef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:37.118339 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88185db1-8de2-4be7-a6c4-11cb650ccef2 None admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:37.118618 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88185db1-8de2-4be7-a6c4-11cb650ccef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:37.118892 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88185db1-8de2-4be7-a6c4-11cb650ccef2 None admin] PATH_INFO: `/v3/services` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:37.119588 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88185db1-8de2-4be7-a6c4-11cb650ccef2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:37.120988 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88185db1-8de2-4be7-a6c4-11cb650ccef2 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:37.187468 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 497/989] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Aug 8 02:06:36 2022] POST /identity/v3/services => generated 242 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:06:38.294295 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b7806-2a05-41e2-a5e8-9c9947c205d1 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:38.294832 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b7806-2a05-41e2-a5e8-9c9947c205d1 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:38.294832 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b7806-2a05-41e2-a5e8-9c9947c205d1 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:38.296238 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 493/990] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:38.302191 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c057c-90fe-444a-bbcc-72970d163aee None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:38.302696 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c057c-90fe-444a-bbcc-72970d163aee None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:38.302770 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c057c-90fe-444a-bbcc-72970d163aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:38.324933 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-6f9c057c-90fe-444a-bbcc-72970d163aee None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:38.326117 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-6f9c057c-90fe-444a-bbcc-72970d163aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:38.404335 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 498/991] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:38 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:38.426445 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b7806-2a05-41e2-a5e8-9c9947c205d1 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:38.528477 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b7806-2a05-41e2-a5e8-9c9947c205d1 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:38.563315 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a0b31-cdc8-4fb2-a33e-d2a9da168828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:38.563893 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a0b31-cdc8-4fb2-a33e-d2a9da168828 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:38.564171 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a0b31-cdc8-4fb2-a33e-d2a9da168828 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:38.564443 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a0b31-cdc8-4fb2-a33e-d2a9da168828 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:38.565020 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a0b31-cdc8-4fb2-a33e-d2a9da168828 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:38.566458 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a0b31-cdc8-4fb2-a33e-d2a9da168828 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:38.568221 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:38.576482 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-f15a0b31-cdc8-4fb2-a33e-d2a9da168828 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:06:38.576482 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:38.576482 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:06:38.576482 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:06:38.576482 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:06:38.576482 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:06:38.576482 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:06:38.576482 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:38.576482 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:06:38.576482 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:38.576482 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:06:38.576482 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:38.576482 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:38.576482 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:38.576482 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:38.576482 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:38.576482 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:38.577438 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:38.577438 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:38.577438 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:38.577438 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:38.577438 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:38.577438 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:38.577438 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:06:38.577438 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:06:38.577438 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:06:38.577438 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:06:38.577438 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:38.577438 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:38.577438 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:38.577438 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:38.577438 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:38.577438 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:38.578262 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:38.578262 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:38.578262 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:38.578262 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:38.578262 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:38.578262 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:38.578262 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:38.578262 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:38.578262 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:38.578262 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:38.578262 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:06:38.578262 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:38.578262 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 02:06:38.578262 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:38.578262 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 494/992] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Aug 8 02:06:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:06:38.585414 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c057c-90fe-444a-bbcc-72970d163aee None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:38.641924 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:38.687903 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c057c-90fe-444a-bbcc-72970d163aee None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:38.723584 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39b6fa-518f-4f4c-ba7b-d3ff38a62e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:38.724194 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39b6fa-518f-4f4c-ba7b-d3ff38a62e95 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:38.724476 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39b6fa-518f-4f4c-ba7b-d3ff38a62e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:38.724748 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39b6fa-518f-4f4c-ba7b-d3ff38a62e95 None admin] PATH_INFO: `/v3/services` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:38.725379 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39b6fa-518f-4f4c-ba7b-d3ff38a62e95 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:38.725684 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39b6fa-518f-4f4c-ba7b-d3ff38a62e95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:38.727073 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39b6fa-518f-4f4c-ba7b-d3ff38a62e95 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:38.736581 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 499/993] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Aug 8 02:06:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:06:38.737848 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a0b31-cdc8-4fb2-a33e-d2a9da168828 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:38.839651 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a0b31-cdc8-4fb2-a33e-d2a9da168828 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:38.872612 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71b663-75ad-4f65-b8ee-9303303336c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:38.873213 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71b663-75ad-4f65-b8ee-9303303336c1 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:38.873489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71b663-75ad-4f65-b8ee-9303303336c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:38.873759 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71b663-75ad-4f65-b8ee-9303303336c1 None admin] PATH_INFO: `/v3/services` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:38.874382 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c71b663-75ad-4f65-b8ee-9303303336c1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:38.874682 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c71b663-75ad-4f65-b8ee-9303303336c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:38.876062 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c71b663-75ad-4f65-b8ee-9303303336c1 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:38.881024 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 495/994] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Aug 8 02:06:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:38.886519 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39b6fa-518f-4f4c-ba7b-d3ff38a62e95 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:39.032937 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39b6fa-518f-4f4c-ba7b-d3ff38a62e95 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:39.052758 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:39.069566 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd6f0c-1686-4bf3-81e0-f18b6a975349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:39.070175 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd6f0c-1686-4bf3-81e0-f18b6a975349 None admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:39.070980 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd6f0c-1686-4bf3-81e0-f18b6a975349 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:39.071255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd6f0c-1686-4bf3-81e0-f18b6a975349 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:39.071955 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd6f0c-1686-4bf3-81e0-f18b6a975349 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:39.073328 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd6f0c-1686-4bf3-81e0-f18b6a975349 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:39.116437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93daabe9-b8f2-4c7a-b2f8-e2f03978bad1 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:39.116626 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93daabe9-b8f2-4c7a-b2f8-e2f03978bad1 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:39.116908 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93daabe9-b8f2-4c7a-b2f8-e2f03978bad1 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:39.118864 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 496/995] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:06:39.123769 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f1e16-8127-4eb6-bd04-026f0e601def None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:39.124052 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f1e16-8127-4eb6-bd04-026f0e601def None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:39.126619 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f1e16-8127-4eb6-bd04-026f0e601def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:39.141830 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-677f1e16-8127-4eb6-bd04-026f0e601def None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:39.143003 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-677f1e16-8127-4eb6-bd04-026f0e601def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:39.152623 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 500/996] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:06:38 2022] POST /identity/v3/endpoints => generated 325 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:06:39.204412 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:39.221859 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 497/997] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:39 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:06:39.224802 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0d128-c01a-4958-8e41-87a511cd4930 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:39.225086 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0d128-c01a-4958-8e41-87a511cd4930 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:39.225404 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0d128-c01a-4958-8e41-87a511cd4930 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:39.227441 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 501/998] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:39.233129 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160e68b-f154-430a-b142-3f12737b64a9 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:39.233438 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160e68b-f154-430a-b142-3f12737b64a9 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:39.233688 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160e68b-f154-430a-b142-3f12737b64a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:39.245243 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0d128-c01a-4958-8e41-87a511cd4930 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:39.255640 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-2160e68b-f154-430a-b142-3f12737b64a9 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:39.256883 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-2160e68b-f154-430a-b142-3f12737b64a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:39.339921 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 498/999] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:39 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:39.362648 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160e68b-f154-430a-b142-3f12737b64a9 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:39.366429 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0d128-c01a-4958-8e41-87a511cd4930 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:39.416029 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1dc49a-1d3d-4050-93e8-8c62054f4e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:39.416655 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1dc49a-1d3d-4050-93e8-8c62054f4e10 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:39.416931 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1dc49a-1d3d-4050-93e8-8c62054f4e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:39.417201 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1dc49a-1d3d-4050-93e8-8c62054f4e10 None admin] PATH_INFO: `/v3/services/image` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:39.417806 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1dc49a-1d3d-4050-93e8-8c62054f4e10 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:39.419152 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1dc49a-1d3d-4050-93e8-8c62054f4e10 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:39.428114 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-7d1dc49a-1d3d-4050-93e8-8c62054f4e10 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 02:06:39.428114 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:39.428114 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:06:39.428114 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:06:39.428114 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:06:39.428114 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:06:39.428114 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:06:39.428114 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:39.428114 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 02:06:39.428114 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:39.428114 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:06:39.428114 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:39.428114 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:39.428114 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:39.428114 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:39.428114 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:39.428114 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:39.429125 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:39.429125 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:39.429125 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:39.429125 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:39.429125 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:39.429125 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:39.429125 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:06:39.429125 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:06:39.429125 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:06:39.429125 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:06:39.429125 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:39.429125 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:39.429125 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:39.429125 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:39.429125 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:39.429125 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:39.430542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:39.430542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:39.430542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:39.430542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:39.430542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:39.430542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:39.430542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:39.430542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:39.430542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:39.430542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:39.430542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:06:39.430542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:39.430542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 02:06:39.430542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:39.435023 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 502/1000] 10.222.0.23 () {56 vars in 1105 bytes} [Mon Aug 8 02:06:39 2022] GET /identity/v3/services/image => generated 86 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:06:39.436371 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1dc49a-1d3d-4050-93e8-8c62054f4e10 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:39.470411 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160e68b-f154-430a-b142-3f12737b64a9 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:39.483227 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:39.490345 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:39.507326 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3a06d-0406-4f24-a9eb-9d2fe0685720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:39.508092 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3a06d-0406-4f24-a9eb-9d2fe0685720 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:39.508409 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3a06d-0406-4f24-a9eb-9d2fe0685720 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:39.508686 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3a06d-0406-4f24-a9eb-9d2fe0685720 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:39.509267 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3a06d-0406-4f24-a9eb-9d2fe0685720 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:39.510696 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3a06d-0406-4f24-a9eb-9d2fe0685720 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:39.519274 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-45f3a06d-0406-4f24-a9eb-9d2fe0685720 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 02:06:39.519274 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:39.519274 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:06:39.519274 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:06:39.519274 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:06:39.519274 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:06:39.519274 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:06:39.519274 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:39.519274 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 02:06:39.519274 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:39.519274 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:06:39.519274 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:39.519274 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:39.519274 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:39.519274 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:39.519274 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:39.519274 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:39.520309 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:39.520309 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:39.520309 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:39.520309 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:39.520309 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:39.520309 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:39.520309 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:06:39.520309 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:06:39.520309 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:06:39.520309 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:06:39.520309 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:39.520309 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:39.520309 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:39.520309 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:39.520309 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:39.520309 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:39.521137 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:39.521137 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:39.521137 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:39.521137 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:39.521137 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:39.521137 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:39.521137 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:39.521137 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:39.521137 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:39.521137 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:39.521137 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:06:39.521137 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:39.521137 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 02:06:39.521137 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:39.525891 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 499/1001] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:06:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:06:39.530692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3a06d-0406-4f24-a9eb-9d2fe0685720 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:39.542533 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1dc49a-1d3d-4050-93e8-8c62054f4e10 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:39.577729 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba6c2c-5f78-4698-8cd2-3c2114cb14ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:39.578340 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba6c2c-5f78-4698-8cd2-3c2114cb14ea None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:39.578943 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba6c2c-5f78-4698-8cd2-3c2114cb14ea None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:39.579438 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba6c2c-5f78-4698-8cd2-3c2114cb14ea None admin] PATH_INFO: `/v3/services` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:39.580377 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba6c2c-5f78-4698-8cd2-3c2114cb14ea None admin] RBAC: Adding query filter params (name=image) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:39.580875 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba6c2c-5f78-4698-8cd2-3c2114cb14ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:39.582915 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba6c2c-5f78-4698-8cd2-3c2114cb14ea None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:39.588170 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 503/1002] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:39.593664 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba6c2c-5f78-4698-8cd2-3c2114cb14ea None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:39.634500 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3a06d-0406-4f24-a9eb-9d2fe0685720 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:39.670116 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041dfcab-442d-4c8d-834d-a938d041c734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:39.671291 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041dfcab-442d-4c8d-834d-a938d041c734 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:39.671733 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041dfcab-442d-4c8d-834d-a938d041c734 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:39.672147 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041dfcab-442d-4c8d-834d-a938d041c734 None admin] PATH_INFO: `/v3/services` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:39.672936 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041dfcab-442d-4c8d-834d-a938d041c734 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:39.673387 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041dfcab-442d-4c8d-834d-a938d041c734 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:39.674753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041dfcab-442d-4c8d-834d-a938d041c734 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:39.681878 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 500/1003] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Aug 8 02:06:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:39.687579 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041dfcab-442d-4c8d-834d-a938d041c734 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:39.702384 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba6c2c-5f78-4698-8cd2-3c2114cb14ea None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:39.712037 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:39.736143 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:39.740967 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d62cf7-a2f9-4048-88cf-a8b1fb37d936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:39.741571 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d62cf7-a2f9-4048-88cf-a8b1fb37d936 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:39.741849 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d62cf7-a2f9-4048-88cf-a8b1fb37d936 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:39.742156 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d62cf7-a2f9-4048-88cf-a8b1fb37d936 None admin] PATH_INFO: `/v3/services` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:39.742775 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d62cf7-a2f9-4048-88cf-a8b1fb37d936 None admin] RBAC: Adding query filter params (type=image) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:39.743077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d62cf7-a2f9-4048-88cf-a8b1fb37d936 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:39.744454 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d62cf7-a2f9-4048-88cf-a8b1fb37d936 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:39.759395 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 504/1004] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:39 2022] GET /identity/v3/services?type=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:06:39.807869 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041dfcab-442d-4c8d-834d-a938d041c734 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:39.845355 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4efbb-fa13-4933-8a00-c74a5974161d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:39.845979 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4efbb-fa13-4933-8a00-c74a5974161d None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:39.846258 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4efbb-fa13-4933-8a00-c74a5974161d None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:39.846531 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4efbb-fa13-4933-8a00-c74a5974161d None admin] PATH_INFO: `/v3/services` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:39.847170 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4efbb-fa13-4933-8a00-c74a5974161d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:39.847508 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4efbb-fa13-4933-8a00-c74a5974161d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:39.848888 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4efbb-fa13-4933-8a00-c74a5974161d None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:39.859095 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 501/1005] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Aug 8 02:06:39 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:06:39.860459 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d62cf7-a2f9-4048-88cf-a8b1fb37d936 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:39.973694 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d62cf7-a2f9-4048-88cf-a8b1fb37d936 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:40.007378 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605bbd1-5cbb-4e46-aa60-b35f915f5c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:40.008502 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605bbd1-5cbb-4e46-aa60-b35f915f5c16 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:40.008782 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605bbd1-5cbb-4e46-aa60-b35f915f5c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:40.009059 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605bbd1-5cbb-4e46-aa60-b35f915f5c16 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:40.009762 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605bbd1-5cbb-4e46-aa60-b35f915f5c16 None admin] RBAC: Adding query filter params (interface=public, service_id=ad1fd6d3c2bb44d28a2868adc5dae006, region_id=RegionOne) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:40.010071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605bbd1-5cbb-4e46-aa60-b35f915f5c16 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:40.012141 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605bbd1-5cbb-4e46-aa60-b35f915f5c16 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:40.021930 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 505/1006] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Aug 8 02:06:39 2022] GET /identity/v3/endpoints?service_id=ad1fd6d3c2bb44d28a2868adc5dae006&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:40.022875 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4efbb-fa13-4933-8a00-c74a5974161d None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:40.120945 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4efbb-fa13-4933-8a00-c74a5974161d None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:40.131282 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:40.154876 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813da94-8043-4808-89a0-161aee38eb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:40.155579 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813da94-8043-4808-89a0-161aee38eb4a None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:40.155860 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813da94-8043-4808-89a0-161aee38eb4a None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:40.156132 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813da94-8043-4808-89a0-161aee38eb4a None admin] PATH_INFO: `/v3/services` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:40.156724 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813da94-8043-4808-89a0-161aee38eb4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:40.158072 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813da94-8043-4808-89a0-161aee38eb4a None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:40.165068 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 502/1007] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Aug 8 02:06:40 2022] GET /identity/v3/services => generated 1727 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:06:41.219626 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a643ad-5bec-4ab2-ba8b-ef9b63eef80f None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:41.220200 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a643ad-5bec-4ab2-ba8b-ef9b63eef80f None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:41.220200 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a643ad-5bec-4ab2-ba8b-ef9b63eef80f None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:41.222056 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 506/1008] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:41.227445 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da76841-9db9-4082-b5ab-c7a54ff50f96 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:41.227890 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da76841-9db9-4082-b5ab-c7a54ff50f96 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:41.227980 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da76841-9db9-4082-b5ab-c7a54ff50f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:41.246270 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-2da76841-9db9-4082-b5ab-c7a54ff50f96 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:41.247471 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-2da76841-9db9-4082-b5ab-c7a54ff50f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:41.319786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 503/1009] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:41 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:41.343011 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a643ad-5bec-4ab2-ba8b-ef9b63eef80f None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:41.395386 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:41.466564 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a643ad-5bec-4ab2-ba8b-ef9b63eef80f None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:41.502301 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa40a7-985c-4dba-a70e-44febf67d4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:41.503333 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa40a7-985c-4dba-a70e-44febf67d4aa None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:41.503646 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa40a7-985c-4dba-a70e-44febf67d4aa None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:41.503925 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa40a7-985c-4dba-a70e-44febf67d4aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:41.505082 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa40a7-985c-4dba-a70e-44febf67d4aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:41.506518 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa40a7-985c-4dba-a70e-44febf67d4aa None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:41.513386 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 507/1010] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:41.514608 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da76841-9db9-4082-b5ab-c7a54ff50f96 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:41.613950 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da76841-9db9-4082-b5ab-c7a54ff50f96 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:41.616228 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:41.646974 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932e26e-1b08-499b-bc8b-4ee9f9ac8731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:41.647602 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932e26e-1b08-499b-bc8b-4ee9f9ac8731 None admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:41.647888 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932e26e-1b08-499b-bc8b-4ee9f9ac8731 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:41.648161 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932e26e-1b08-499b-bc8b-4ee9f9ac8731 None admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:41.648848 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932e26e-1b08-499b-bc8b-4ee9f9ac8731 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:41.650253 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932e26e-1b08-499b-bc8b-4ee9f9ac8731 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:41.755466 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 504/1011] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Aug 8 02:06:41 2022] POST /identity/v3/projects => generated 311 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:06:41.816374 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab02008-51d8-45b1-afc0-7a1a3f416493 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:41.816659 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab02008-51d8-45b1-afc0-7a1a3f416493 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:41.816937 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab02008-51d8-45b1-afc0-7a1a3f416493 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:41.818331 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 508/1012] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:41.824065 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e5097-8f4d-46b0-b92e-b86c6a0a91d2 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:41.824354 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e5097-8f4d-46b0-b92e-b86c6a0a91d2 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:41.824635 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e5097-8f4d-46b0-b92e-b86c6a0a91d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:41.843983 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-b55e5097-8f4d-46b0-b92e-b86c6a0a91d2 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:41.845185 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-b55e5097-8f4d-46b0-b92e-b86c6a0a91d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:41.915868 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 505/1013] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:41 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:41.945627 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab02008-51d8-45b1-afc0-7a1a3f416493 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:42.053224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab02008-51d8-45b1-afc0-7a1a3f416493 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:42.054681 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:42.088088 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c434b94-9c34-4b5b-accb-e5b788c4043c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:42.088689 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c434b94-9c34-4b5b-accb-e5b788c4043c None admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:42.088966 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c434b94-9c34-4b5b-accb-e5b788c4043c None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:42.089235 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c434b94-9c34-4b5b-accb-e5b788c4043c None admin] PATH_INFO: `/v3/services` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:42.089867 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c434b94-9c34-4b5b-accb-e5b788c4043c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:42.091219 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c434b94-9c34-4b5b-accb-e5b788c4043c None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:42.165398 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 509/1014] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Aug 8 02:06:41 2022] POST /identity/v3/services => generated 242 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:06:42.188542 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470342ad-9e99-4d8d-8ad6-acf437c69cbb None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:42.188833 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470342ad-9e99-4d8d-8ad6-acf437c69cbb None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:42.189262 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470342ad-9e99-4d8d-8ad6-acf437c69cbb None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:42.193663 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 506/1015] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:42.197134 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a245b5-4a75-43f9-8ace-0579ba3c5172 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:42.197640 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a245b5-4a75-43f9-8ace-0579ba3c5172 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:42.198100 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a245b5-4a75-43f9-8ace-0579ba3c5172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:42.218663 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-c3a245b5-4a75-43f9-8ace-0579ba3c5172 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:42.220340 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-c3a245b5-4a75-43f9-8ace-0579ba3c5172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:42.304394 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 510/1016] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:42 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:42.327262 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470342ad-9e99-4d8d-8ad6-acf437c69cbb None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:42.417553 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:42.433228 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470342ad-9e99-4d8d-8ad6-acf437c69cbb None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:42.468063 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285ae5b-cf64-491f-aabe-0863e6026270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:42.468690 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285ae5b-cf64-491f-aabe-0863e6026270 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:42.468976 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285ae5b-cf64-491f-aabe-0863e6026270 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:42.469253 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285ae5b-cf64-491f-aabe-0863e6026270 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:42.469863 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285ae5b-cf64-491f-aabe-0863e6026270 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:42.471231 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285ae5b-cf64-491f-aabe-0863e6026270 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:42.479920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-3285ae5b-cf64-491f-aabe-0863e6026270 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 02:06:42.479920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:42.479920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:06:42.479920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:06:42.479920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:06:42.479920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:06:42.479920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:06:42.479920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:42.479920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 02:06:42.479920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:42.479920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:06:42.479920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:42.479920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:42.479920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:42.479920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:42.479920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:42.479920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:42.480898 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:42.480898 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:42.480898 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:42.480898 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:42.480898 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:42.480898 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:42.480898 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:06:42.480898 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:06:42.480898 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:06:42.480898 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:06:42.480898 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:42.480898 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:42.480898 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:42.480898 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:42.480898 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:42.480898 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:42.481780 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:42.481780 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:42.481780 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:42.481780 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:42.481780 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:42.481780 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:42.481780 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:42.481780 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:42.481780 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:42.481780 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:42.481780 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:06:42.481780 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:42.481780 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 02:06:42.481780 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:42.481780 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 507/1017] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:06:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:42.488574 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a245b5-4a75-43f9-8ace-0579ba3c5172 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:42.577765 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:42.589995 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a245b5-4a75-43f9-8ace-0579ba3c5172 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:42.624146 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97269a6b-3d7c-462c-bf3f-3fb4d92e511e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:42.631328 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97269a6b-3d7c-462c-bf3f-3fb4d92e511e None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:42.631328 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97269a6b-3d7c-462c-bf3f-3fb4d92e511e None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:42.631328 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97269a6b-3d7c-462c-bf3f-3fb4d92e511e None admin] PATH_INFO: `/v3/services` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:42.631328 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97269a6b-3d7c-462c-bf3f-3fb4d92e511e None admin] RBAC: Adding query filter params (name=compute) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:42.631328 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97269a6b-3d7c-462c-bf3f-3fb4d92e511e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:42.631328 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97269a6b-3d7c-462c-bf3f-3fb4d92e511e None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:42.638623 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 511/1018] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Aug 8 02:06:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:42.638780 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285ae5b-cf64-491f-aabe-0863e6026270 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:42.740908 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285ae5b-cf64-491f-aabe-0863e6026270 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:42.773183 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77601fc-c67a-4036-afb0-979cab719ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:42.774311 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77601fc-c67a-4036-afb0-979cab719ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:42.774593 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77601fc-c67a-4036-afb0-979cab719ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:42.774863 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77601fc-c67a-4036-afb0-979cab719ce2 None admin] PATH_INFO: `/v3/services` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:42.775510 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77601fc-c67a-4036-afb0-979cab719ce2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:42.775817 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77601fc-c67a-4036-afb0-979cab719ce2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:42.777236 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77601fc-c67a-4036-afb0-979cab719ce2 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:42.786756 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 508/1019] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Aug 8 02:06:42 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:06:42.787715 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97269a6b-3d7c-462c-bf3f-3fb4d92e511e None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:42.889434 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97269a6b-3d7c-462c-bf3f-3fb4d92e511e None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:42.923996 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c51644-bb88-4d34-99a0-f881ed33f1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:42.924625 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c51644-bb88-4d34-99a0-f881ed33f1fb None admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:42.924905 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c51644-bb88-4d34-99a0-f881ed33f1fb None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:42.925176 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c51644-bb88-4d34-99a0-f881ed33f1fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:42.925859 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c51644-bb88-4d34-99a0-f881ed33f1fb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:42.927270 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c51644-bb88-4d34-99a0-f881ed33f1fb None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:43.007396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 512/1020] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:06:42 2022] POST /identity/v3/endpoints => generated 334 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:06:43.838138 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f3673-cd5a-48d4-bafe-d8847ddd5e29 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:43.838686 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f3673-cd5a-48d4-bafe-d8847ddd5e29 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:43.838686 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f3673-cd5a-48d4-bafe-d8847ddd5e29 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:43.840091 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 509/1021] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:43.845415 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac7176-74ec-466c-9741-cf465805404f None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:43.845851 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac7176-74ec-466c-9741-cf465805404f None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:43.845996 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac7176-74ec-466c-9741-cf465805404f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:43.864581 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-7fac7176-74ec-466c-9741-cf465805404f None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:43.865797 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-7fac7176-74ec-466c-9741-cf465805404f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:43.868549 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:43.940321 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 513/1022] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:43 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:43.965965 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f3673-cd5a-48d4-bafe-d8847ddd5e29 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:43.982380 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:44.068631 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f3673-cd5a-48d4-bafe-d8847ddd5e29 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:44.102424 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae4042-328a-4279-ba8b-761e17653a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:44.102974 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae4042-328a-4279-ba8b-761e17653a0e None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:44.103257 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae4042-328a-4279-ba8b-761e17653a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:44.103559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae4042-328a-4279-ba8b-761e17653a0e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:44.104661 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae4042-328a-4279-ba8b-761e17653a0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:44.106083 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae4042-328a-4279-ba8b-761e17653a0e None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:44.107889 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 510/1023] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:44.113336 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac7176-74ec-466c-9741-cf465805404f None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:44.190728 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac9495-cfb8-4ed6-949b-cf046f678518 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:44.191011 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac9495-cfb8-4ed6-949b-cf046f678518 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:44.191289 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac9495-cfb8-4ed6-949b-cf046f678518 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:44.192875 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 511/1024] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:06:44.198949 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca3755-44e7-4bf0-a9a0-0f8e8abf6745 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:44.199291 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca3755-44e7-4bf0-a9a0-0f8e8abf6745 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:44.199538 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca3755-44e7-4bf0-a9a0-0f8e8abf6745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:44.216585 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac7176-74ec-466c-9741-cf465805404f None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:44.217361 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-60ca3755-44e7-4bf0-a9a0-0f8e8abf6745 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:44.218546 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-60ca3755-44e7-4bf0-a9a0-0f8e8abf6745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:44.253099 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e88a9-a301-44f6-b5ff-18577e45c6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:44.254404 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e88a9-a301-44f6-b5ff-18577e45c6aa None admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:44.255253 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e88a9-a301-44f6-b5ff-18577e45c6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:44.255585 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e88a9-a301-44f6-b5ff-18577e45c6aa None admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:44.256248 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e88a9-a301-44f6-b5ff-18577e45c6aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:44.257704 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e88a9-a301-44f6-b5ff-18577e45c6aa None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:44.266210 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:44.287759 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 512/1025] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:44 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:06:44.310970 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca3755-44e7-4bf0-a9a0-0f8e8abf6745 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:44.325442 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:44.363473 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 514/1026] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 8 02:06:44 2022] POST /identity/v3/users => generated 285 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:06:44.415744 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca3755-44e7-4bf0-a9a0-0f8e8abf6745 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:44.453048 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa586c-7a6e-4a3e-a610-98086c3d3f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:44.453689 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa586c-7a6e-4a3e-a610-98086c3d3f8b None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:44.453965 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa586c-7a6e-4a3e-a610-98086c3d3f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:44.454232 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa586c-7a6e-4a3e-a610-98086c3d3f8b None admin] PATH_INFO: `/v3/services/image` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:44.454822 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa586c-7a6e-4a3e-a610-98086c3d3f8b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:44.456226 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa586c-7a6e-4a3e-a610-98086c3d3f8b None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:44.465986 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-a4fa586c-7a6e-4a3e-a610-98086c3d3f8b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 02:06:44.465986 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:44.465986 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:06:44.465986 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:06:44.465986 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:06:44.465986 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:06:44.465986 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:06:44.465986 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:44.465986 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 02:06:44.465986 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:44.465986 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:06:44.465986 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:44.465986 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:44.465986 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:44.465986 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:44.465986 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:44.465986 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:44.467039 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:44.467039 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:44.467039 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:44.467039 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:44.467039 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:44.467039 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:44.467039 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:06:44.467039 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:06:44.467039 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:06:44.467039 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:06:44.467039 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:44.467039 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:44.467039 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:44.467039 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:44.467039 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:44.467039 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:44.468525 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:44.468525 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:44.468525 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:44.468525 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:44.468525 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:44.468525 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:44.468525 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:44.468525 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:44.468525 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:44.468525 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:44.468525 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:06:44.468525 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:44.468525 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 02:06:44.468525 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:44.468525 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 513/1027] 10.222.0.23 () {56 vars in 1105 bytes} [Mon Aug 8 02:06:44 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:06:44.476630 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e88a9-a301-44f6-b5ff-18577e45c6aa None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:44.583573 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e88a9-a301-44f6-b5ff-18577e45c6aa None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:44.621087 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0763a-9765-4822-a874-17d9e1db73b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:44.621625 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0763a-9765-4822-a874-17d9e1db73b8 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:44.621908 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0763a-9765-4822-a874-17d9e1db73b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:44.622182 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0763a-9765-4822-a874-17d9e1db73b8 None admin] PATH_INFO: `/v3/services` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:44.622816 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae0763a-9765-4822-a874-17d9e1db73b8 None admin] RBAC: Adding query filter params (name=image) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:44.623122 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae0763a-9765-4822-a874-17d9e1db73b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:44.624508 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae0763a-9765-4822-a874-17d9e1db73b8 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:44.629632 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 515/1028] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:44.635131 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa586c-7a6e-4a3e-a610-98086c3d3f8b None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:44.714815 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:44.737800 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa586c-7a6e-4a3e-a610-98086c3d3f8b None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:44.771611 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaeb28d-9f68-4816-9982-346797018514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:44.772213 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaeb28d-9f68-4816-9982-346797018514 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:44.772495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaeb28d-9f68-4816-9982-346797018514 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:44.772770 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaeb28d-9f68-4816-9982-346797018514 None admin] PATH_INFO: `/v3/services` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:44.773913 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaeb28d-9f68-4816-9982-346797018514 None admin] RBAC: Adding query filter params (type=image) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:44.774217 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaeb28d-9f68-4816-9982-346797018514 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:44.775598 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaeb28d-9f68-4816-9982-346797018514 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:44.785218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 514/1029] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:44 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:44.786830 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0763a-9765-4822-a874-17d9e1db73b8 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:44.845060 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:44.889783 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0763a-9765-4822-a874-17d9e1db73b8 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:44.924748 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b318d-58d2-445f-bafb-4aedbf09e8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:44.925358 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b318d-58d2-445f-bafb-4aedbf09e8b0 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:44.925644 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b318d-58d2-445f-bafb-4aedbf09e8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:44.925918 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b318d-58d2-445f-bafb-4aedbf09e8b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:44.926615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b318d-58d2-445f-bafb-4aedbf09e8b0 None admin] RBAC: Adding query filter params (interface=public, service_id=ba4537cbaf0648129ae34b0eae72ad8b, region_id=RegionOne) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:44.926926 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b318d-58d2-445f-bafb-4aedbf09e8b0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:44.928308 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b318d-58d2-445f-bafb-4aedbf09e8b0 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:44.938425 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 516/1030] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Aug 8 02:06:44 2022] GET /identity/v3/endpoints?service_id=ba4537cbaf0648129ae34b0eae72ad8b&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:44.939977 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaeb28d-9f68-4816-9982-346797018514 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:45.039973 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaeb28d-9f68-4816-9982-346797018514 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:45.073592 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb3a49-0b8f-4ed6-a048-324291a6023d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:45.074197 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb3a49-0b8f-4ed6-a048-324291a6023d None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:45.074481 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb3a49-0b8f-4ed6-a048-324291a6023d None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:45.074755 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb3a49-0b8f-4ed6-a048-324291a6023d None admin] PATH_INFO: `/v3/services` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:45.075365 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb3a49-0b8f-4ed6-a048-324291a6023d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:45.076734 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb3a49-0b8f-4ed6-a048-324291a6023d None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:45.091465 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 515/1031] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Aug 8 02:06:44 2022] GET /identity/v3/services => generated 1957 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:06:45.102038 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886d4ab-0222-4a24-b876-ca16e85badf9 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:45.102311 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886d4ab-0222-4a24-b876-ca16e85badf9 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:45.102592 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886d4ab-0222-4a24-b876-ca16e85badf9 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:45.103990 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 517/1032] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:06:45.109629 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f801e14-9ab1-4746-9534-77a8432bfa07 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:45.109916 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f801e14-9ab1-4746-9534-77a8432bfa07 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:45.110196 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f801e14-9ab1-4746-9534-77a8432bfa07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:45.118261 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:45.131067 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-9f801e14-9ab1-4746-9534-77a8432bfa07 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:45.132319 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-9f801e14-9ab1-4746-9534-77a8432bfa07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:45.203954 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 516/1033] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:45 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:45.228283 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886d4ab-0222-4a24-b876-ca16e85badf9 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:45.338852 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886d4ab-0222-4a24-b876-ca16e85badf9 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:45.357658 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:45.375004 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59caddf-c353-47fc-8fcb-f2669d620d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:45.375769 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59caddf-c353-47fc-8fcb-f2669d620d5f None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:45.376062 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59caddf-c353-47fc-8fcb-f2669d620d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:45.376381 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59caddf-c353-47fc-8fcb-f2669d620d5f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:45.391817 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59caddf-c353-47fc-8fcb-f2669d620d5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:06:45.397031 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-e59caddf-c353-47fc-8fcb-f2669d620d5f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 02:06:45.397031 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:45.397031 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:45.397031 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:45.397031 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:45.397031 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:45.397031 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:45.397031 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:45.397031 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:45.397031 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:45.397031 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:45.397031 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:45.397031 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:06:45.397031 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:06:45.397031 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:06:45.397031 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:06:45.398071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:06:45.398071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:06:45.398071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:06:45.398071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:06:45.398071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:45.398071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:45.398071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:45.398071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:45.398071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:45.398071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:45.398071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:45.398071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:45.398071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:45.398071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:45.398071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:45.398071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:45.404239 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:45.404239 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:45.404239 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:45.404239 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:45.404239 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:06:45.404239 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:06:45.404239 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:06:45.404239 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:06:45.404239 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:06:45.404239 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:06:45.404239 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 02:06:45.404239 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:45.404239 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 518/1034] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Aug 8 02:06:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:45.406448 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f801e14-9ab1-4746-9534-77a8432bfa07 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:45.507754 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f801e14-9ab1-4746-9534-77a8432bfa07 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:45.544353 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319aea9-e136-4a5e-9d2b-b84af077a8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:45.544984 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319aea9-e136-4a5e-9d2b-b84af077a8ed None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:45.545268 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319aea9-e136-4a5e-9d2b-b84af077a8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:45.545545 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319aea9-e136-4a5e-9d2b-b84af077a8ed None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:45.546224 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319aea9-e136-4a5e-9d2b-b84af077a8ed None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:45.546533 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319aea9-e136-4a5e-9d2b-b84af077a8ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:45.547946 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319aea9-e136-4a5e-9d2b-b84af077a8ed None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:45.549752 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:45.562548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 517/1035] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Aug 8 02:06:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:06:45.563767 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59caddf-c353-47fc-8fcb-f2669d620d5f None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:45.665639 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59caddf-c353-47fc-8fcb-f2669d620d5f None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:45.698882 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76eada-1050-4bbe-bfe8-c8ac98800776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:45.699526 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76eada-1050-4bbe-bfe8-c8ac98800776 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:45.699808 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76eada-1050-4bbe-bfe8-c8ac98800776 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:45.700078 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76eada-1050-4bbe-bfe8-c8ac98800776 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:45.709884 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76eada-1050-4bbe-bfe8-c8ac98800776 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:45.711863 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76eada-1050-4bbe-bfe8-c8ac98800776 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:45.725893 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-6e76eada-1050-4bbe-bfe8-c8ac98800776 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:45.725893 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:45.725893 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:45.725893 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:45.725893 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:45.725893 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:45.725893 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:45.725893 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:45.725893 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:45.725893 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:45.725893 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:45.725893 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:45.725893 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:45.725893 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:45.725893 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:45.725893 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:45.726886 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:45.726886 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:45.726886 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:45.726886 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:45.726886 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:45.726886 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:45.726886 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:45.726886 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:45.726886 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:45.726886 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:45.726886 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:45.726886 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:45.726886 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:45.726886 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:45.726886 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:45.726886 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:45.726886 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:45.727830 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:45.727830 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:45.727830 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:45.727830 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 519/1036] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:45.736849 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319aea9-e136-4a5e-9d2b-b84af077a8ed None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:45.836420 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319aea9-e136-4a5e-9d2b-b84af077a8ed None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:45.869203 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d122838-671a-4b2a-a9d7-adf977ec56b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:45.869812 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d122838-671a-4b2a-a9d7-adf977ec56b5 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:45.870091 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d122838-671a-4b2a-a9d7-adf977ec56b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:45.870363 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d122838-671a-4b2a-a9d7-adf977ec56b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:45.870991 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d122838-671a-4b2a-a9d7-adf977ec56b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:45.871349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d122838-671a-4b2a-a9d7-adf977ec56b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:45.872719 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d122838-671a-4b2a-a9d7-adf977ec56b5 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:45.889257 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 518/1037] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:45.890501 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76eada-1050-4bbe-bfe8-c8ac98800776 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:45.921522 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:45.993482 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76eada-1050-4bbe-bfe8-c8ac98800776 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:46.028149 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfba47c-28aa-4873-a98c-0eb287e48c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:46.028769 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfba47c-28aa-4873-a98c-0eb287e48c47 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:46.029045 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfba47c-28aa-4873-a98c-0eb287e48c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:46.029313 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfba47c-28aa-4873-a98c-0eb287e48c47 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:46.036495 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfba47c-28aa-4873-a98c-0eb287e48c47 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:46.037905 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfba47c-28aa-4873-a98c-0eb287e48c47 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:46.049512 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-fcfba47c-28aa-4873-a98c-0eb287e48c47 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:06:46.049512 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:46.049512 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:46.049512 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:46.049512 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:46.049512 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:46.049512 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:46.049512 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:46.049512 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:46.049512 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:46.049512 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:46.049512 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:46.049512 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:06:46.049512 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:06:46.049512 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:06:46.049512 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:06:46.050558 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:46.050558 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:46.050558 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:06:46.050558 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:46.050558 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:06:46.050558 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:46.050558 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:46.050558 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:46.050558 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:46.050558 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:46.050558 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:46.050558 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:46.050558 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:46.050558 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:46.050558 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:46.050558 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:46.050558 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:46.050558 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:46.051580 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:46.051580 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:46.051580 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:06:46.051580 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:06:46.051580 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:06:46.051580 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:06:46.051580 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:06:46.051580 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:06:46.051580 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:06:46.051580 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:46.051580 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 520/1038] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Aug 8 02:06:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:46.058816 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d122838-671a-4b2a-a9d7-adf977ec56b5 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:46.114320 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:46.159150 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d122838-671a-4b2a-a9d7-adf977ec56b5 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:46.193437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3d0c9-2686-490f-a72a-05d1593ff658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:46.194048 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3d0c9-2686-490f-a72a-05d1593ff658 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:46.194330 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3d0c9-2686-490f-a72a-05d1593ff658 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:46.194611 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3d0c9-2686-490f-a72a-05d1593ff658 None admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:46.195874 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3d0c9-2686-490f-a72a-05d1593ff658 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:46.196187 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3d0c9-2686-490f-a72a-05d1593ff658 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:46.197609 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3d0c9-2686-490f-a72a-05d1593ff658 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:46.220716 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 519/1039] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Aug 8 02:06:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:46.222028 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfba47c-28aa-4873-a98c-0eb287e48c47 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:46.314939 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:46.325351 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfba47c-28aa-4873-a98c-0eb287e48c47 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:46.359436 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619f468-91cc-47da-8890-d0db386341da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:46.360101 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619f468-91cc-47da-8890-d0db386341da None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:46.360388 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619f468-91cc-47da-8890-d0db386341da None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:46.360665 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619f468-91cc-47da-8890-d0db386341da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:46.437638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8619f468-91cc-47da-8890-d0db386341da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:46.439085 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8619f468-91cc-47da-8890-d0db386341da None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:46.454601 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c22e56-08f6-4cf9-9a02-2b9db36ef20e None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:46.454898 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c22e56-08f6-4cf9-9a02-2b9db36ef20e None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:46.455187 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c22e56-08f6-4cf9-9a02-2b9db36ef20e None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:46.456698 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 520/1040] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:46.461363 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eace0c-98b7-4d99-950c-0ac0a2535209 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:46.461653 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eace0c-98b7-4d99-950c-0ac0a2535209 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:46.461934 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eace0c-98b7-4d99-950c-0ac0a2535209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:46.479248 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-46eace0c-98b7-4d99-950c-0ac0a2535209 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:46.480474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-46eace0c-98b7-4d99-950c-0ac0a2535209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:46.538580 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:46.549216 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 521/1041] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:46 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:06:46.550004 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 521/1042] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:06:46 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:06:46.556079 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eace0c-98b7-4d99-950c-0ac0a2535209 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:46.573731 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619f468-91cc-47da-8890-d0db386341da None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:46.607651 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:46.670757 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eace0c-98b7-4d99-950c-0ac0a2535209 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:46.677217 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619f468-91cc-47da-8890-d0db386341da None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:46.709844 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4250e-88a0-4431-9b98-7a3007248d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:46.710472 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4250e-88a0-4431-9b98-7a3007248d8f None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:46.710765 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4250e-88a0-4431-9b98-7a3007248d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:46.711085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4250e-88a0-4431-9b98-7a3007248d8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:46.712809 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe0dc6-61de-4946-8c14-55009674cc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:46.713434 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe0dc6-61de-4946-8c14-55009674cc71 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:46.713718 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe0dc6-61de-4946-8c14-55009674cc71 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:46.714000 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe0dc6-61de-4946-8c14-55009674cc71 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:46.721201 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4250e-88a0-4431-9b98-7a3007248d8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:46.722573 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4250e-88a0-4431-9b98-7a3007248d8f None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:46.725050 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe0dc6-61de-4946-8c14-55009674cc71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:06:46.730206 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-0cbe0dc6-61de-4946-8c14-55009674cc71 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:06:46.730206 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:46.730206 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:46.730206 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:46.730206 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:46.730206 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:46.730206 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:46.730206 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:46.730206 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:46.730206 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:46.730206 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:46.730206 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:46.730206 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:06:46.730206 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:06:46.730206 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:06:46.730206 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:06:46.731319 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:06:46.731319 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:06:46.731319 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:06:46.731319 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:06:46.731319 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:46.731319 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:46.731319 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:46.731319 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:46.731319 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:46.731319 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:46.731319 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:46.731319 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:46.731319 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:46.731319 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:46.731319 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:46.731319 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:46.732199 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:46.732199 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:46.732199 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:46.732199 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:46.732199 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:06:46.732199 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:06:46.732199 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:06:46.732199 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:06:46.732199 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:06:46.732199 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:06:46.732199 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:06:46.732199 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:46.732199 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 522/1043] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 02:06:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:46.737760 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe0dc6-61de-4946-8c14-55009674cc71 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:46.740446 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-bca4250e-88a0-4431-9b98-7a3007248d8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:46.740446 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:46.740446 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:46.740446 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:46.740446 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:46.740446 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:46.740446 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:46.740446 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:46.740446 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:46.740446 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:46.740446 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:46.740446 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:46.740446 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:46.740446 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:46.740446 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:46.740446 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:46.741386 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:46.741386 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:46.741386 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:46.741386 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:46.741386 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:46.741386 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:46.741386 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:46.741386 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:46.741386 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:46.741386 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:46.741386 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:46.741386 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:46.741386 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:46.741386 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:46.741386 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:46.741386 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:46.741386 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:46.743858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:46.743858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:46.743858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:46.743858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 522/1044] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:06:46.747052 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4250e-88a0-4431-9b98-7a3007248d8f None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:46.798486 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:46.846024 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe0dc6-61de-4946-8c14-55009674cc71 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:46.847346 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:46.853918 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4250e-88a0-4431-9b98-7a3007248d8f None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:46.882070 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338b7a5-85b4-4b32-9236-fb9d4f5157df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:46.883170 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338b7a5-85b4-4b32-9236-fb9d4f5157df None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:46.883591 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338b7a5-85b4-4b32-9236-fb9d4f5157df None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:46.883792 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338b7a5-85b4-4b32-9236-fb9d4f5157df None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:46.884442 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338b7a5-85b4-4b32-9236-fb9d4f5157df None admin] RBAC: Adding query filter params (name=admin) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:46.884745 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338b7a5-85b4-4b32-9236-fb9d4f5157df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:46.886099 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338b7a5-85b4-4b32-9236-fb9d4f5157df None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:46.888573 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73d181-b6ed-4d7f-802d-ee10a121065e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:46.889171 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73d181-b6ed-4d7f-802d-ee10a121065e None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:46.889454 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73d181-b6ed-4d7f-802d-ee10a121065e None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:46.889725 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73d181-b6ed-4d7f-802d-ee10a121065e None admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:46.890361 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb73d181-b6ed-4d7f-802d-ee10a121065e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:46.890665 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb73d181-b6ed-4d7f-802d-ee10a121065e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:46.892040 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb73d181-b6ed-4d7f-802d-ee10a121065e None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:46.894641 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 523/1045] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:06:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:06:46.900471 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338b7a5-85b4-4b32-9236-fb9d4f5157df None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:46.905267 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 523/1046] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:06:46.910593 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73d181-b6ed-4d7f-802d-ee10a121065e None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:47.008909 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73d181-b6ed-4d7f-802d-ee10a121065e None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:47.014339 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338b7a5-85b4-4b32-9236-fb9d4f5157df None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:47.028933 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:47.043832 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16661d66-13bd-450f-809d-e2679129fb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:47.044465 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16661d66-13bd-450f-809d-e2679129fb7d None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:47.044763 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16661d66-13bd-450f-809d-e2679129fb7d None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:47.045028 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16661d66-13bd-450f-809d-e2679129fb7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:47.050498 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9dffbd-985e-4741-a646-886d3c29b5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:47.051139 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9dffbd-985e-4741-a646-886d3c29b5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:47.051450 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9dffbd-985e-4741-a646-886d3c29b5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:47.051732 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9dffbd-985e-4741-a646-886d3c29b5e4 None admin] PATH_INFO: `/v3/users/eeaa52837f2f4e3e890f4f50ea019613` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:47.052721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16661d66-13bd-450f-809d-e2679129fb7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:47.054312 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16661d66-13bd-450f-809d-e2679129fb7d None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:47.066374 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-16661d66-13bd-450f-809d-e2679129fb7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:47.066374 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:47.066374 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:47.066374 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:47.066374 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:47.066374 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:47.066374 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:47.066374 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:47.066374 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:47.066374 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:47.066374 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:47.066374 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:47.066374 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:06:47.066374 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:06:47.066374 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:06:47.072661 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:06:47.072661 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:47.072661 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:47.072661 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:47.072661 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:47.072661 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:47.072661 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:47.072661 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:47.072661 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:47.072661 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:47.072661 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:47.072661 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:47.072661 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:47.072661 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:47.072661 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:47.072661 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:47.072661 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:47.073840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:06:47.073840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:06:47.073840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:06:47.073840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:06:47.073840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:06:47.073840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:06:47.073840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:47.073840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:47.074337 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9dffbd-985e-4741-a646-886d3c29b5e4 None admin] RBAC: Authorizing `identity:get_user(user_id=eeaa52837f2f4e3e890f4f50ea019613)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:47.074421 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 524/1047] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:06:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:06:47.074490 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9dffbd-985e-4741-a646-886d3c29b5e4 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:47.074490 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 524/1048] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:06:46 2022] GET /identity/v3/users/eeaa52837f2f4e3e890f4f50ea019613 => generated 285 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:06:47.075304 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9dffbd-985e-4741-a646-886d3c29b5e4 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:47.075489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16661d66-13bd-450f-809d-e2679129fb7d None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:47.095194 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:47.178915 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9dffbd-985e-4741-a646-886d3c29b5e4 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:47.179124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16661d66-13bd-450f-809d-e2679129fb7d None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:47.212523 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922e136-ab34-4d9c-b7bf-1956c60ae737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:47.212960 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf697d-2797-40a5-bc42-c19f0118cf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:47.213119 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922e136-ab34-4d9c-b7bf-1956c60ae737 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:47.213399 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922e136-ab34-4d9c-b7bf-1956c60ae737 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:47.213556 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf697d-2797-40a5-bc42-c19f0118cf98 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:47.213679 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922e136-ab34-4d9c-b7bf-1956c60ae737 None admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:47.213839 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf697d-2797-40a5-bc42-c19f0118cf98 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:47.214116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf697d-2797-40a5-bc42-c19f0118cf98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:47.214336 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3922e136-ab34-4d9c-b7bf-1956c60ae737 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:47.214640 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3922e136-ab34-4d9c-b7bf-1956c60ae737 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:47.216088 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3922e136-ab34-4d9c-b7bf-1956c60ae737 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:47.227098 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 525/1049] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 02:06:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:47.228286 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24ca30-d311-4992-9357-f4985367d104 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:47.228569 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24ca30-d311-4992-9357-f4985367d104 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:47.228844 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24ca30-d311-4992-9357-f4985367d104 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:47.230176 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 526/1050] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:47.233117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24ca30-d311-4992-9357-f4985367d104 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:47.253527 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:47.282218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf697d-2797-40a5-bc42-c19f0118cf98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:47.283624 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf697d-2797-40a5-bc42-c19f0118cf98 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:47.309491 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:47.332663 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24ca30-d311-4992-9357-f4985367d104 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:47.365978 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea7d87-5956-4aff-acf2-9dca4c5db17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:47.366587 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea7d87-5956-4aff-acf2-9dca4c5db17c None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:47.366868 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea7d87-5956-4aff-acf2-9dca4c5db17c None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:47.367195 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea7d87-5956-4aff-acf2-9dca4c5db17c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:47.367948 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea7d87-5956-4aff-acf2-9dca4c5db17c None admin] RBAC: Adding query filter params (role.id=6078f0a415d84735a3dd5948e5bde324, scope.project.id=ebe178f5bce64a009bf690031676c89f, user.id=5d89e0c7d62444e4b75d3f4da49b2bc4) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:47.368256 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea7d87-5956-4aff-acf2-9dca4c5db17c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:47.369665 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea7d87-5956-4aff-acf2-9dca4c5db17c None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:47.374937 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 527/1051] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:06:47 2022] GET /identity/v3/role_assignments?user.id=5d89e0c7d62444e4b75d3f4da49b2bc4&scope.project.id=ebe178f5bce64a009bf690031676c89f&role.id=6078f0a415d84735a3dd5948e5bde324 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:06:47.376215 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd7f53-c4b0-4881-9622-85702d5ea789 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:47.376513 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd7f53-c4b0-4881-9622-85702d5ea789 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:47.376790 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd7f53-c4b0-4881-9622-85702d5ea789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:47.386280 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 525/1052] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:06:47 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:06:47.392523 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf697d-2797-40a5-bc42-c19f0118cf98 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:47.403076 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-2ddd7f53-c4b0-4881-9622-85702d5ea789 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:47.404363 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-2ddd7f53-c4b0-4881-9622-85702d5ea789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:47.473933 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:47.484998 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 528/1053] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:47 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:47.505989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf697d-2797-40a5-bc42-c19f0118cf98 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:47.507572 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd7f53-c4b0-4881-9622-85702d5ea789 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:47.545240 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a5ea8-aa1d-4fa1-a30f-d8f5c4ee6bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:47.545793 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a5ea8-aa1d-4fa1-a30f-d8f5c4ee6bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:47.546074 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a5ea8-aa1d-4fa1-a30f-d8f5c4ee6bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:47.546352 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a5ea8-aa1d-4fa1-a30f-d8f5c4ee6bc3 None admin] PATH_INFO: `/v3/projects/0938d0f458a34ee98c0ab7e8a4d6c75c` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:47.547565 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a5ea8-aa1d-4fa1-a30f-d8f5c4ee6bc3 None admin] RBAC: Authorizing `identity:get_project(project_id=0938d0f458a34ee98c0ab7e8a4d6c75c)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:47.548992 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a5ea8-aa1d-4fa1-a30f-d8f5c4ee6bc3 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:47.550779 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 526/1054] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:06:47 2022] GET /identity/v3/projects/0938d0f458a34ee98c0ab7e8a4d6c75c => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:06:47.557024 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a5ea8-aa1d-4fa1-a30f-d8f5c4ee6bc3 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:47.582953 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:47.614093 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd7f53-c4b0-4881-9622-85702d5ea789 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:47.651846 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770bf8b-b521-457d-90d6-3ee7cc85ade6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:47.652476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770bf8b-b521-457d-90d6-3ee7cc85ade6 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:47.652757 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770bf8b-b521-457d-90d6-3ee7cc85ade6 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:47.653037 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770bf8b-b521-457d-90d6-3ee7cc85ade6 None admin] PATH_INFO: `/v3/services/image` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:47.653616 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770bf8b-b521-457d-90d6-3ee7cc85ade6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:47.654976 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770bf8b-b521-457d-90d6-3ee7cc85ade6 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:47.662611 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a5ea8-aa1d-4fa1-a30f-d8f5c4ee6bc3 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:47.663633 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-8770bf8b-b521-457d-90d6-3ee7cc85ade6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 02:06:47.663633 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:47.663633 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:06:47.663633 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:06:47.663633 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:06:47.663633 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:06:47.663633 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:06:47.663633 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:47.663633 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 02:06:47.663633 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:47.663633 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:06:47.663633 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:47.663633 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:47.663633 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:47.663633 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:47.663633 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:47.663633 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:47.665117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:47.665117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:47.665117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:47.665117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:47.665117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:47.665117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:47.665117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:06:47.665117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:06:47.665117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:06:47.665117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:06:47.665117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:47.665117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:47.665117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:47.665117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:47.665117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:47.665117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:47.665938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:47.665938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:47.665938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:47.665938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:47.665938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:47.665938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:47.665938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:47.665938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:47.665938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:47.665938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:47.665938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:06:47.665938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:06:47.665938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 02:06:47.665938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:47.665938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 529/1055] 10.222.0.23 () {56 vars in 1105 bytes} [Mon Aug 8 02:06:47 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:06:47.672274 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770bf8b-b521-457d-90d6-3ee7cc85ade6 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:47.702344 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e305e-ccbf-40db-b8ee-afb50d9daa6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:47.703103 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e305e-ccbf-40db-b8ee-afb50d9daa6d None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:47.703397 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e305e-ccbf-40db-b8ee-afb50d9daa6d None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:47.703995 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e305e-ccbf-40db-b8ee-afb50d9daa6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:47.704873 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e305e-ccbf-40db-b8ee-afb50d9daa6d None admin] RBAC: Adding query filter params (role.id=84da65a75e544d1191ec53cb6b05aa73, scope.project.id=0938d0f458a34ee98c0ab7e8a4d6c75c, user.id=eeaa52837f2f4e3e890f4f50ea019613) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:47.705183 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e305e-ccbf-40db-b8ee-afb50d9daa6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:47.706589 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e305e-ccbf-40db-b8ee-afb50d9daa6d None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:47.712527 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 527/1056] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:06:47 2022] GET /identity/v3/role_assignments?user.id=eeaa52837f2f4e3e890f4f50ea019613&scope.project.id=0938d0f458a34ee98c0ab7e8a4d6c75c&role.id=84da65a75e544d1191ec53cb6b05aa73 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:06:47.777557 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770bf8b-b521-457d-90d6-3ee7cc85ade6 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:47.818960 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255643e-770c-4858-a52d-951f3ede08ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:47.819530 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255643e-770c-4858-a52d-951f3ede08ea None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:47.819816 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255643e-770c-4858-a52d-951f3ede08ea None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:47.820095 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255643e-770c-4858-a52d-951f3ede08ea None admin] PATH_INFO: `/v3/services` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:47.821318 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255643e-770c-4858-a52d-951f3ede08ea None admin] RBAC: Adding query filter params (name=image) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:47.821626 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255643e-770c-4858-a52d-951f3ede08ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:47.823024 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255643e-770c-4858-a52d-951f3ede08ea None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:47.824369 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:47.834585 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 530/1057] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:47.839078 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e305e-ccbf-40db-b8ee-afb50d9daa6d None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:47.839078 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:47.941173 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e305e-ccbf-40db-b8ee-afb50d9daa6d None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:47.974673 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ad805-0ea3-4925-a1e8-5203bb339f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:47.975269 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ad805-0ea3-4925-a1e8-5203bb339f5e None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:47.975573 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ad805-0ea3-4925-a1e8-5203bb339f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:47.975847 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ad805-0ea3-4925-a1e8-5203bb339f5e None admin] PATH_INFO: `/v3/services` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:47.976524 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ad805-0ea3-4925-a1e8-5203bb339f5e None admin] RBAC: Adding query filter params (type=image) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:47.976827 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ad805-0ea3-4925-a1e8-5203bb339f5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:47.978171 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ad805-0ea3-4925-a1e8-5203bb339f5e None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:47.987705 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 528/1058] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:47 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:47.988915 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255643e-770c-4858-a52d-951f3ede08ea None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:48.109201 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255643e-770c-4858-a52d-951f3ede08ea None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:48.146102 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49547369-1333-43c1-9a6e-279e451a49da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:48.146710 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49547369-1333-43c1-9a6e-279e451a49da None admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:48.146989 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49547369-1333-43c1-9a6e-279e451a49da None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:48.147262 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49547369-1333-43c1-9a6e-279e451a49da None admin] PATH_INFO: `/v3/endpoints` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:48.147946 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49547369-1333-43c1-9a6e-279e451a49da None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:48.149319 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49547369-1333-43c1-9a6e-279e451a49da None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:48.238466 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 531/1059] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:06:47 2022] POST /identity/v3/endpoints => generated 327 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:06:49.388930 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d2a98-7769-4d34-82c0-4483ba805c1d None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:49.389822 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d2a98-7769-4d34-82c0-4483ba805c1d None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:49.390106 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d2a98-7769-4d34-82c0-4483ba805c1d None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:49.391617 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 529/1060] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:49.396962 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47a925-60f5-4dab-b503-0eac6e068c17 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:49.397362 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47a925-60f5-4dab-b503-0eac6e068c17 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:49.397526 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47a925-60f5-4dab-b503-0eac6e068c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:49.416532 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-af47a925-60f5-4dab-b503-0eac6e068c17 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:49.417721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-af47a925-60f5-4dab-b503-0eac6e068c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:49.467249 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:49.491101 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 532/1061] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:49.512958 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d2a98-7769-4d34-82c0-4483ba805c1d None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:49.583827 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:49.619049 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d2a98-7769-4d34-82c0-4483ba805c1d None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:49.653560 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e580a5f-0111-499d-8a46-1d3545c57905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:49.654110 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e580a5f-0111-499d-8a46-1d3545c57905 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:49.654390 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e580a5f-0111-499d-8a46-1d3545c57905 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:49.654664 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e580a5f-0111-499d-8a46-1d3545c57905 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:49.666233 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e580a5f-0111-499d-8a46-1d3545c57905 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:06:49.671026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-1e580a5f-0111-499d-8a46-1d3545c57905 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 02:06:49.671026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:49.671026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:49.671026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:49.671026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:49.671026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:49.671026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:49.671026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:49.671026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:49.671026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:49.671026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:49.671026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:49.671026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:06:49.671026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:06:49.671026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:06:49.671026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:06:49.672044 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:06:49.672044 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:06:49.672044 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:06:49.672044 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:06:49.672044 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:49.672044 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:49.672044 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:49.672044 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:49.672044 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:49.672044 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:49.672044 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:49.672044 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:49.672044 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:49.672044 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:49.672044 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:49.672044 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:49.672891 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:49.672891 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:49.672891 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:49.672891 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:49.672891 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:06:49.672891 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:06:49.672891 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:06:49.672891 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:06:49.672891 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:06:49.672891 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:06:49.672891 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 02:06:49.672891 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:49.675682 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 530/1062] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Aug 8 02:06:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:49.678139 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af47a925-60f5-4dab-b503-0eac6e068c17 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:49.752861 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc6623-1c60-4ca1-a826-38f2f81604b0 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:49.753183 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc6623-1c60-4ca1-a826-38f2f81604b0 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:49.753423 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc6623-1c60-4ca1-a826-38f2f81604b0 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:49.754775 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 531/1063] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:06:49.759871 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec4e6e-67ef-441e-8e07-65c6a762b63c None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:49.760165 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec4e6e-67ef-441e-8e07-65c6a762b63c None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:49.760447 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec4e6e-67ef-441e-8e07-65c6a762b63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:49.777979 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-c6ec4e6e-67ef-441e-8e07-65c6a762b63c None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:49.779152 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-c6ec4e6e-67ef-441e-8e07-65c6a762b63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:49.781342 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af47a925-60f5-4dab-b503-0eac6e068c17 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:49.817598 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ffc08-36c0-4dec-a3f5-d1600e860b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:49.818202 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ffc08-36c0-4dec-a3f5-d1600e860b6f None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:49.818481 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ffc08-36c0-4dec-a3f5-d1600e860b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:49.818753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ffc08-36c0-4dec-a3f5-d1600e860b6f None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:49.819436 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ffc08-36c0-4dec-a3f5-d1600e860b6f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:49.819742 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ffc08-36c0-4dec-a3f5-d1600e860b6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:49.821124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ffc08-36c0-4dec-a3f5-d1600e860b6f None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:49.829337 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 533/1064] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Aug 8 02:06:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:49.834853 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ffc08-36c0-4dec-a3f5-d1600e860b6f None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:49.859742 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 532/1065] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:49.872579 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec4e6e-67ef-441e-8e07-65c6a762b63c None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:49.883644 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:49.930732 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:49.948215 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ffc08-36c0-4dec-a3f5-d1600e860b6f None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:49.974486 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec4e6e-67ef-441e-8e07-65c6a762b63c None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:49.982809 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85097f9-28e7-44fd-8c43-11ef89ade591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:49.983528 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85097f9-28e7-44fd-8c43-11ef89ade591 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:49.984038 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85097f9-28e7-44fd-8c43-11ef89ade591 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:49.984316 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85097f9-28e7-44fd-8c43-11ef89ade591 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:49.996753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85097f9-28e7-44fd-8c43-11ef89ade591 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:49.998859 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85097f9-28e7-44fd-8c43-11ef89ade591 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:50.008861 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73352048-34e9-4982-9386-21557f64f8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:50.009489 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73352048-34e9-4982-9386-21557f64f8e5 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:50.009768 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73352048-34e9-4982-9386-21557f64f8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:50.010063 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73352048-34e9-4982-9386-21557f64f8e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:50.016302 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-e85097f9-28e7-44fd-8c43-11ef89ade591 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:50.016302 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:50.016302 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:50.016302 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:50.016302 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:50.016302 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:50.016302 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:50.016302 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:50.016302 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:50.016302 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:50.016302 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:50.016302 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:50.016302 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:50.016302 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:50.016302 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:50.016302 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:50.017287 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:50.017287 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:50.017287 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:50.017287 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:50.017287 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:50.017287 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:50.017287 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:50.017287 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:50.017287 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:50.017287 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:50.017287 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:50.017287 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:50.017287 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:50.017287 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:50.017287 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:50.017287 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:50.017287 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:50.018162 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:50.018162 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:50.018162 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:50.018162 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 534/1066] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:06:50.023847 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85097f9-28e7-44fd-8c43-11ef89ade591 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:50.024782 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73352048-34e9-4982-9386-21557f64f8e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:06:50.029753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-73352048-34e9-4982-9386-21557f64f8e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:06:50.029753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:50.029753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:50.029753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:50.029753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:50.029753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:50.029753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:50.029753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:50.029753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:50.029753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:50.029753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:50.029753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:50.029753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:06:50.029753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:06:50.029753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:06:50.029753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:06:50.030721 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:06:50.030721 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:06:50.030721 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:06:50.030721 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:06:50.030721 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:50.030721 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:50.030721 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:50.030721 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:50.030721 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:50.030721 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:50.030721 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:50.030721 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:50.030721 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:50.030721 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:50.030721 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:50.030721 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:50.031559 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:50.031559 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:50.031559 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:50.031559 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:50.031559 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:06:50.031559 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:06:50.031559 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:06:50.031559 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:06:50.031559 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:06:50.031559 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:06:50.031559 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:06:50.031559 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:50.032832 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 533/1067] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 02:06:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:06:50.038383 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73352048-34e9-4982-9386-21557f64f8e5 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:50.138061 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:50.145228 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85097f9-28e7-44fd-8c43-11ef89ade591 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:50.146664 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73352048-34e9-4982-9386-21557f64f8e5 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:50.164562 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:50.181406 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736366f-f427-4cb6-96f8-991f37221396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:50.182288 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736366f-f427-4cb6-96f8-991f37221396 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:50.182572 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736366f-f427-4cb6-96f8-991f37221396 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:50.182849 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736366f-f427-4cb6-96f8-991f37221396 None admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:50.183132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9487406c-87b0-43ce-b0e9-68c010266f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:50.183523 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4736366f-f427-4cb6-96f8-991f37221396 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:50.183759 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487406c-87b0-43ce-b0e9-68c010266f34 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:50.183856 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4736366f-f427-4cb6-96f8-991f37221396 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:50.184034 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487406c-87b0-43ce-b0e9-68c010266f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:50.184345 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487406c-87b0-43ce-b0e9-68c010266f34 None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:50.184953 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9487406c-87b0-43ce-b0e9-68c010266f34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:50.185184 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4736366f-f427-4cb6-96f8-991f37221396 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:50.185281 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9487406c-87b0-43ce-b0e9-68c010266f34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:50.186576 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9487406c-87b0-43ce-b0e9-68c010266f34 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:50.194858 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 534/1068] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:06:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:06:50.201851 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 535/1069] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:06:50.202008 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9487406c-87b0-43ce-b0e9-68c010266f34 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:50.203289 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736366f-f427-4cb6-96f8-991f37221396 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:50.304702 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736366f-f427-4cb6-96f8-991f37221396 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:50.305255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9487406c-87b0-43ce-b0e9-68c010266f34 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:50.337649 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd20487-8964-4bf8-a6d7-3cbc41a56aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:50.338263 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd20487-8964-4bf8-a6d7-3cbc41a56aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:50.338381 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea958114-46a3-45fe-98a7-9d5df0fa38ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:50.338543 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd20487-8964-4bf8-a6d7-3cbc41a56aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:50.338815 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd20487-8964-4bf8-a6d7-3cbc41a56aa5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:50.338962 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea958114-46a3-45fe-98a7-9d5df0fa38ad None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:50.339246 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea958114-46a3-45fe-98a7-9d5df0fa38ad None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:50.339555 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea958114-46a3-45fe-98a7-9d5df0fa38ad None admin] PATH_INFO: `/v3/users/eeaa52837f2f4e3e890f4f50ea019613` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:50.340680 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea958114-46a3-45fe-98a7-9d5df0fa38ad None admin] RBAC: Authorizing `identity:get_user(user_id=eeaa52837f2f4e3e890f4f50ea019613)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:50.342099 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea958114-46a3-45fe-98a7-9d5df0fa38ad None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:50.343722 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 535/1070] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:06:50 2022] GET /identity/v3/users/eeaa52837f2f4e3e890f4f50ea019613 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:50.344886 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fefd5-1f61-4d79-b65a-b266e10af196 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:50.345176 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fefd5-1f61-4d79-b65a-b266e10af196 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:50.345457 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fefd5-1f61-4d79-b65a-b266e10af196 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:50.346650 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 536/1071] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:50.349247 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fefd5-1f61-4d79-b65a-b266e10af196 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:50.349759 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd20487-8964-4bf8-a6d7-3cbc41a56aa5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:50.351204 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd20487-8964-4bf8-a6d7-3cbc41a56aa5 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:50.364559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-6fd20487-8964-4bf8-a6d7-3cbc41a56aa5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:06:50.364559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:50.364559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:50.364559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:50.364559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:50.364559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:50.364559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:50.364559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:50.364559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:50.364559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:50.364559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:50.364559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:50.364559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:06:50.364559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:06:50.364559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:06:50.364559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:06:50.365503 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:50.365503 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:50.365503 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:06:50.365503 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:50.365503 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:06:50.365503 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:50.365503 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:50.365503 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:50.365503 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:50.365503 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:50.365503 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:50.365503 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:50.365503 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:50.365503 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:50.365503 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:50.365503 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:50.365503 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:50.365503 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:50.366441 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:50.366441 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:50.366441 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:06:50.366441 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:06:50.366441 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:06:50.366441 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:06:50.366441 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:06:50.366441 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:06:50.366441 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:06:50.366441 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:50.366441 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 536/1072] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Aug 8 02:06:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:06:50.367133 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce0e4d-db8f-4036-b4c2-921351c7855e None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:50.367133 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce0e4d-db8f-4036-b4c2-921351c7855e None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:50.367696 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce0e4d-db8f-4036-b4c2-921351c7855e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:50.385821 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-e5ce0e4d-db8f-4036-b4c2-921351c7855e None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:50.387030 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-e5ce0e4d-db8f-4036-b4c2-921351c7855e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:50.396559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:50.401038 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:50.453609 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fefd5-1f61-4d79-b65a-b266e10af196 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:50.454274 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 537/1073] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:50.455100 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce0e4d-db8f-4036-b4c2-921351c7855e None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:50.494996 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa0547-282d-4e5d-bcb5-f966b765d4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:50.495764 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa0547-282d-4e5d-bcb5-f966b765d4a1 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:50.496049 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa0547-282d-4e5d-bcb5-f966b765d4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:50.496328 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa0547-282d-4e5d-bcb5-f966b765d4a1 None admin] PATH_INFO: `/v3/projects/0938d0f458a34ee98c0ab7e8a4d6c75c` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:50.497447 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa0547-282d-4e5d-bcb5-f966b765d4a1 None admin] RBAC: Authorizing `identity:get_project(project_id=0938d0f458a34ee98c0ab7e8a4d6c75c)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:50.498867 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa0547-282d-4e5d-bcb5-f966b765d4a1 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:50.505320 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 537/1074] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:06:50 2022] GET /identity/v3/projects/0938d0f458a34ee98c0ab7e8a4d6c75c => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:06:50.505320 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa0547-282d-4e5d-bcb5-f966b765d4a1 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:50.563078 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce0e4d-db8f-4036-b4c2-921351c7855e None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:50.596418 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c80054-7947-4d47-98c9-f1e45481548e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:50.597056 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c80054-7947-4d47-98c9-f1e45481548e None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:50.597331 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c80054-7947-4d47-98c9-f1e45481548e None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:50.597601 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c80054-7947-4d47-98c9-f1e45481548e None admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:50.598314 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c80054-7947-4d47-98c9-f1e45481548e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:50.598620 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c80054-7947-4d47-98c9-f1e45481548e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:50.598735 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa0547-282d-4e5d-bcb5-f966b765d4a1 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:50.600067 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c80054-7947-4d47-98c9-f1e45481548e None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:50.613789 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:50.616614 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 538/1075] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Aug 8 02:06:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:50.617283 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c80054-7947-4d47-98c9-f1e45481548e None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:50.623624 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:50.634087 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a74e7-5b32-41da-89b4-684860200887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:50.634691 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a74e7-5b32-41da-89b4-684860200887 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:50.634971 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a74e7-5b32-41da-89b4-684860200887 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:50.635248 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a74e7-5b32-41da-89b4-684860200887 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:50.702123 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a74e7-5b32-41da-89b4-684860200887 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:50.703591 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a74e7-5b32-41da-89b4-684860200887 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:50.718238 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c80054-7947-4d47-98c9-f1e45481548e None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:50.750637 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11af68-bf4b-4639-9b74-eb9840dc888c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:50.751298 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11af68-bf4b-4639-9b74-eb9840dc888c None admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:50.751612 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11af68-bf4b-4639-9b74-eb9840dc888c None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:50.751892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11af68-bf4b-4639-9b74-eb9840dc888c None admin] PATH_INFO: `/v3/projects/0938d0f458a34ee98c0ab7e8a4d6c75c/users/eeaa52837f2f4e3e890f4f50ea019613/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:50.753816 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11af68-bf4b-4639-9b74-eb9840dc888c None admin] RBAC: Authorizing `identity:create_grant(project_id=0938d0f458a34ee98c0ab7e8a4d6c75c, user_id=eeaa52837f2f4e3e890f4f50ea019613, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:50.755235 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11af68-bf4b-4639-9b74-eb9840dc888c None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:50.799774 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 538/1076] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:06:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:06:50.800586 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a74e7-5b32-41da-89b4-684860200887 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:50.814887 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:50.870985 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 539/1077] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 02:06:50 2022] PUT /identity/v3/projects/0938d0f458a34ee98c0ab7e8a4d6c75c/users/eeaa52837f2f4e3e890f4f50ea019613/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:06:50.871843 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11af68-bf4b-4639-9b74-eb9840dc888c None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:50.900385 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a74e7-5b32-41da-89b4-684860200887 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:50.938046 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246ded1-d000-4b4e-8ba2-43110a75ed7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:50.938673 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246ded1-d000-4b4e-8ba2-43110a75ed7b None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:50.938954 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246ded1-d000-4b4e-8ba2-43110a75ed7b None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:50.939230 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246ded1-d000-4b4e-8ba2-43110a75ed7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:50.943922 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:50.951293 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246ded1-d000-4b4e-8ba2-43110a75ed7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:50.953866 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246ded1-d000-4b4e-8ba2-43110a75ed7b None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:50.971668 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-d246ded1-d000-4b4e-8ba2-43110a75ed7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:50.971668 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:50.971668 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:50.971668 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:50.971668 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:50.971668 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:50.971668 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:50.971668 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:50.971668 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:50.971668 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:50.971668 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:50.971668 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:50.971668 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:50.971668 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:50.971668 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:50.971668 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:50.972841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:50.972841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:50.972841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:50.972841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:50.972841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:50.972841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:50.972841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:50.972841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:50.972841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:50.972841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:50.972841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:50.972841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:50.972841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:50.972841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:50.972841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:50.972841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:50.972841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:50.973923 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:50.973923 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:50.973923 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:50.974330 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 539/1078] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:50.978831 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246ded1-d000-4b4e-8ba2-43110a75ed7b None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:51.030681 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11af68-bf4b-4639-9b74-eb9840dc888c None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:51.069118 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:51.075656 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415e9a7-e5ce-4070-a153-d7247528858a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:51.076306 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415e9a7-e5ce-4070-a153-d7247528858a None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:51.076589 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415e9a7-e5ce-4070-a153-d7247528858a None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:51.076872 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415e9a7-e5ce-4070-a153-d7247528858a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:51.090467 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d415e9a7-e5ce-4070-a153-d7247528858a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:51.091966 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d415e9a7-e5ce-4070-a153-d7247528858a None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:51.104962 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246ded1-d000-4b4e-8ba2-43110a75ed7b None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:51.107301 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-d415e9a7-e5ce-4070-a153-d7247528858a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:51.107301 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:51.107301 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:51.107301 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:51.107301 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:51.107301 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:51.107301 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:51.107301 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:51.107301 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:51.107301 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:51.107301 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:51.107301 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:51.107301 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:51.107301 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:51.107301 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:51.107301 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:51.108241 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:51.108241 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:51.108241 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:51.108241 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:51.108241 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:51.108241 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:51.108241 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:51.108241 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:51.108241 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:51.108241 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:51.108241 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:51.108241 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:51.108241 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:51.108241 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:51.108241 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:51.108241 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:51.108241 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:51.109128 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:51.109128 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:51.109128 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:51.111686 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 540/1079] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:51.114935 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415e9a7-e5ce-4070-a153-d7247528858a None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:51.145606 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad8ceba-f0f7-4747-861a-6709306c5a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:51.146212 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8ceba-f0f7-4747-861a-6709306c5a26 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:51.146491 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8ceba-f0f7-4747-861a-6709306c5a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:51.146764 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8ceba-f0f7-4747-861a-6709306c5a26 None admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:51.147414 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad8ceba-f0f7-4747-861a-6709306c5a26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:51.147717 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad8ceba-f0f7-4747-861a-6709306c5a26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:51.149111 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad8ceba-f0f7-4747-861a-6709306c5a26 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:51.162308 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 540/1080] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:51.168323 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad8ceba-f0f7-4747-861a-6709306c5a26 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:51.222981 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415e9a7-e5ce-4070-a153-d7247528858a None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:51.237994 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:51.260291 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5807e2-65ee-43ee-be96-8f3d88a36b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:51.260861 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5807e2-65ee-43ee-be96-8f3d88a36b3e None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:51.261147 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5807e2-65ee-43ee-be96-8f3d88a36b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:51.261417 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5807e2-65ee-43ee-be96-8f3d88a36b3e None admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:51.262287 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5807e2-65ee-43ee-be96-8f3d88a36b3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:51.262415 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5807e2-65ee-43ee-be96-8f3d88a36b3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:51.263822 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5807e2-65ee-43ee-be96-8f3d88a36b3e None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:51.271028 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad8ceba-f0f7-4747-861a-6709306c5a26 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:51.287397 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 541/1081] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:06:51.309841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:51.319597 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b35221-9076-4f73-81b9-9c86cb895c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:51.320847 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b35221-9076-4f73-81b9-9c86cb895c44 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:51.321397 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b35221-9076-4f73-81b9-9c86cb895c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:51.321397 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b35221-9076-4f73-81b9-9c86cb895c44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:51.330007 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b35221-9076-4f73-81b9-9c86cb895c44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:51.331505 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b35221-9076-4f73-81b9-9c86cb895c44 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:51.344155 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-d4b35221-9076-4f73-81b9-9c86cb895c44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:51.344155 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:51.344155 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:51.344155 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:51.344155 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:51.344155 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:51.344155 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:51.344155 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:51.344155 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:51.344155 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:51.344155 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:51.344155 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:51.344155 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:06:51.344155 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:06:51.344155 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:06:51.345400 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:06:51.345400 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:51.345400 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:51.345400 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:51.345400 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:51.345400 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:51.345400 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:51.345400 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:51.345400 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:51.345400 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:51.345400 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:51.345400 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:51.345400 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:51.345400 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:51.345400 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:51.345400 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:51.345400 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:51.346337 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:06:51.346337 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:06:51.346337 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:06:51.346337 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:06:51.346337 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:06:51.346337 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:06:51.346337 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:51.346337 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:51.346337 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 541/1082] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:06:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:06:51.352454 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5807e2-65ee-43ee-be96-8f3d88a36b3e None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:51.467078 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5807e2-65ee-43ee-be96-8f3d88a36b3e None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:51.501915 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee75e88-a1a0-49ff-952d-30ac7dc2c142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:51.502456 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee75e88-a1a0-49ff-952d-30ac7dc2c142 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:51.502732 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee75e88-a1a0-49ff-952d-30ac7dc2c142 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:51.503003 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee75e88-a1a0-49ff-952d-30ac7dc2c142 None admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:51.503716 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee75e88-a1a0-49ff-952d-30ac7dc2c142 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:51.504018 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee75e88-a1a0-49ff-952d-30ac7dc2c142 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:51.505435 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee75e88-a1a0-49ff-952d-30ac7dc2c142 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:51.517226 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 542/1083] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 02:06:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:06:51.522959 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b35221-9076-4f73-81b9-9c86cb895c44 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:51.628968 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b35221-9076-4f73-81b9-9c86cb895c44 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:51.661169 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a306b-14ba-42e4-a8f9-c27975215f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:51.661809 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a306b-14ba-42e4-a8f9-c27975215f27 None admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:51.662089 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a306b-14ba-42e4-a8f9-c27975215f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:51.662363 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a306b-14ba-42e4-a8f9-c27975215f27 None admin] PATH_INFO: `/v3/projects/ebe178f5bce64a009bf690031676c89f/users/5d89e0c7d62444e4b75d3f4da49b2bc4/roles/6078f0a415d84735a3dd5948e5bde324` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:51.664489 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a306b-14ba-42e4-a8f9-c27975215f27 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebe178f5bce64a009bf690031676c89f, user_id=5d89e0c7d62444e4b75d3f4da49b2bc4, role_id=6078f0a415d84735a3dd5948e5bde324)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:51.665910 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a306b-14ba-42e4-a8f9-c27975215f27 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:51.768527 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 542/1084] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 02:06:51 2022] PUT /identity/v3/projects/ebe178f5bce64a009bf690031676c89f/users/5d89e0c7d62444e4b75d3f4da49b2bc4/roles/6078f0a415d84735a3dd5948e5bde324 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:06:52.877602 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd195c68-01ce-4604-8da9-c02a561140fe None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:52.878172 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd195c68-01ce-4604-8da9-c02a561140fe None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:52.878172 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd195c68-01ce-4604-8da9-c02a561140fe None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:52.879559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 543/1085] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:52.884791 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970bce2-8faf-46e1-87fc-d029dd82fa27 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:52.885204 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970bce2-8faf-46e1-87fc-d029dd82fa27 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:52.885337 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970bce2-8faf-46e1-87fc-d029dd82fa27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:52.902915 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-7970bce2-8faf-46e1-87fc-d029dd82fa27 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:52.904114 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-7970bce2-8faf-46e1-87fc-d029dd82fa27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:52.945494 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:52.968707 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 543/1086] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:52.991242 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd195c68-01ce-4604-8da9-c02a561140fe None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:53.026646 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:53.089116 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd195c68-01ce-4604-8da9-c02a561140fe None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:53.120799 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96d801-8471-48e1-8aca-279c5db01e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:53.121407 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96d801-8471-48e1-8aca-279c5db01e59 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:53.121683 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96d801-8471-48e1-8aca-279c5db01e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:53.121953 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96d801-8471-48e1-8aca-279c5db01e59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:53.133863 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb96d801-8471-48e1-8aca-279c5db01e59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:06:53.138346 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-bb96d801-8471-48e1-8aca-279c5db01e59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:06:53.138346 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:53.138346 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:53.138346 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:53.138346 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:53.138346 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:53.138346 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:53.138346 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:53.138346 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:53.138346 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:53.138346 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:53.138346 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:53.138346 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:06:53.138346 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:06:53.138346 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:06:53.138346 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:06:53.139472 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:06:53.139472 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:06:53.139472 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:06:53.139472 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:06:53.139472 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:53.139472 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:53.139472 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:53.139472 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:53.139472 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:53.139472 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:53.139472 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:53.139472 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:53.139472 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:53.139472 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:53.139472 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:53.139472 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:53.140507 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:53.140507 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:53.140507 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:53.140507 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:53.140507 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:06:53.140507 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:06:53.140507 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:06:53.140507 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:06:53.140507 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:06:53.140507 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:06:53.140507 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:06:53.140507 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:53.143647 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 544/1087] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 02:06:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:53.145406 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970bce2-8faf-46e1-87fc-d029dd82fa27 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:53.239498 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970bce2-8faf-46e1-87fc-d029dd82fa27 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:53.272068 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679647a6-7993-4eb6-a95e-04edf752214b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:53.272662 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679647a6-7993-4eb6-a95e-04edf752214b None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:53.272940 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679647a6-7993-4eb6-a95e-04edf752214b None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:53.273213 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679647a6-7993-4eb6-a95e-04edf752214b None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:53.273889 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679647a6-7993-4eb6-a95e-04edf752214b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:53.274189 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679647a6-7993-4eb6-a95e-04edf752214b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:53.275570 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679647a6-7993-4eb6-a95e-04edf752214b None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:53.283292 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 544/1088] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:06:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:53.289164 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96d801-8471-48e1-8aca-279c5db01e59 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:53.379420 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:53.386508 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96d801-8471-48e1-8aca-279c5db01e59 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:53.420461 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa044f-5d18-49ed-a33f-8691335c05fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:53.421084 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa044f-5d18-49ed-a33f-8691335c05fc None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:53.421364 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa044f-5d18-49ed-a33f-8691335c05fc None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:53.421639 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa044f-5d18-49ed-a33f-8691335c05fc None admin] PATH_INFO: `/v3/users/eeaa52837f2f4e3e890f4f50ea019613` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:53.422748 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa044f-5d18-49ed-a33f-8691335c05fc None admin] RBAC: Authorizing `identity:get_user(user_id=eeaa52837f2f4e3e890f4f50ea019613)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:53.424220 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa044f-5d18-49ed-a33f-8691335c05fc None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:53.426154 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 545/1089] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:06:53 2022] GET /identity/v3/users/eeaa52837f2f4e3e890f4f50ea019613 => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:06:53.432315 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679647a6-7993-4eb6-a95e-04edf752214b None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:53.471851 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:53.531073 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679647a6-7993-4eb6-a95e-04edf752214b None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:53.563343 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b7520-50d0-4e69-9e7d-24c7b40ee019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:53.563959 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b7520-50d0-4e69-9e7d-24c7b40ee019 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:53.564241 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b7520-50d0-4e69-9e7d-24c7b40ee019 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:53.564510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b7520-50d0-4e69-9e7d-24c7b40ee019 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:53.628934 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b7520-50d0-4e69-9e7d-24c7b40ee019 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:53.630420 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b7520-50d0-4e69-9e7d-24c7b40ee019 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:53.666833 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:53.724711 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 545/1090] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:06:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:06:53.731085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa044f-5d18-49ed-a33f-8691335c05fc None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:53.756599 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d86a0-f19e-497c-a485-7fabef2f2922 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:53.756882 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d86a0-f19e-497c-a485-7fabef2f2922 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:53.757165 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d86a0-f19e-497c-a485-7fabef2f2922 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:53.758557 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 546/1091] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:06:53.764546 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12631aaa-fb84-433c-b457-7b4a0727508e None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:53.764546 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12631aaa-fb84-433c-b457-7b4a0727508e None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:53.764546 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12631aaa-fb84-433c-b457-7b4a0727508e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:53.783731 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-12631aaa-fb84-433c-b457-7b4a0727508e None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:53.785012 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-12631aaa-fb84-433c-b457-7b4a0727508e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:53.829041 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa044f-5d18-49ed-a33f-8691335c05fc None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:53.853401 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 547/1092] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:06:53.863006 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852fa79-c626-4e39-b14c-4f4a76d6e2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:53.863669 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852fa79-c626-4e39-b14c-4f4a76d6e2f4 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:53.863952 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852fa79-c626-4e39-b14c-4f4a76d6e2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:53.864228 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852fa79-c626-4e39-b14c-4f4a76d6e2f4 None admin] PATH_INFO: `/v3/projects/0938d0f458a34ee98c0ab7e8a4d6c75c` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:53.865338 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0852fa79-c626-4e39-b14c-4f4a76d6e2f4 None admin] RBAC: Authorizing `identity:get_project(project_id=0938d0f458a34ee98c0ab7e8a4d6c75c)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:53.866753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0852fa79-c626-4e39-b14c-4f4a76d6e2f4 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:53.874769 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 546/1093] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:06:53 2022] GET /identity/v3/projects/0938d0f458a34ee98c0ab7e8a4d6c75c => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:06:53.875927 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12631aaa-fb84-433c-b457-7b4a0727508e None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:53.876068 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852fa79-c626-4e39-b14c-4f4a76d6e2f4 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:53.905544 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:53.942151 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:53.974242 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12631aaa-fb84-433c-b457-7b4a0727508e None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:53.975809 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852fa79-c626-4e39-b14c-4f4a76d6e2f4 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:54.007743 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4d4b1-493f-4d58-9c36-e556e1d06e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:54.008342 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4d4b1-493f-4d58-9c36-e556e1d06e21 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:54.008615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4d4b1-493f-4d58-9c36-e556e1d06e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:54.008888 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4d4b1-493f-4d58-9c36-e556e1d06e21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:54.009479 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304592a9-05bd-4cfb-8db8-e36b87f2fd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:54.009595 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4d4b1-493f-4d58-9c36-e556e1d06e21 None admin] RBAC: Adding query filter params (role.id=84da65a75e544d1191ec53cb6b05aa73, scope.project.id=0938d0f458a34ee98c0ab7e8a4d6c75c, user.id=eeaa52837f2f4e3e890f4f50ea019613) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:54.009895 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4d4b1-493f-4d58-9c36-e556e1d06e21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:54.010094 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304592a9-05bd-4cfb-8db8-e36b87f2fd7b None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:54.010372 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304592a9-05bd-4cfb-8db8-e36b87f2fd7b None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:54.010643 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304592a9-05bd-4cfb-8db8-e36b87f2fd7b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:54.011325 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4d4b1-493f-4d58-9c36-e556e1d06e21 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:54.017027 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 548/1094] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:06:53 2022] GET /identity/v3/role_assignments?user.id=eeaa52837f2f4e3e890f4f50ea019613&scope.project.id=0938d0f458a34ee98c0ab7e8a4d6c75c&role.id=84da65a75e544d1191ec53cb6b05aa73 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:54.020725 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304592a9-05bd-4cfb-8db8-e36b87f2fd7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:06:54.026078 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-304592a9-05bd-4cfb-8db8-e36b87f2fd7b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 02:06:54.026078 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:54.026078 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:54.026078 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:54.026078 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:54.026078 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:54.026078 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:54.026078 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:54.026078 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:54.026078 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:54.026078 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:54.026078 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:54.026078 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:06:54.026078 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:06:54.026078 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:06:54.026078 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:06:54.027085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:06:54.027085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:06:54.027085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:06:54.027085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:06:54.027085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:54.027085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:54.027085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:54.027085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:54.027085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:54.027085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:54.027085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:54.027085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:54.027085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:54.027085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:54.027085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:54.027085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:54.027985 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:54.027985 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:54.027985 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:54.027985 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:54.027985 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:06:54.027985 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:06:54.027985 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:06:54.027985 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:06:54.027985 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:06:54.027985 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:06:54.027985 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 02:06:54.027985 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:54.027985 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 547/1095] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Aug 8 02:06:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:06:54.033887 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4d4b1-493f-4d58-9c36-e556e1d06e21 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:54.137971 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4d4b1-493f-4d58-9c36-e556e1d06e21 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:54.168158 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:54.173235 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891650c7-e1e3-47f2-a67e-ae7332c2fc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:54.173899 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891650c7-e1e3-47f2-a67e-ae7332c2fc9f None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:54.194527 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891650c7-e1e3-47f2-a67e-ae7332c2fc9f None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:54.194527 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891650c7-e1e3-47f2-a67e-ae7332c2fc9f None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:54.194527 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891650c7-e1e3-47f2-a67e-ae7332c2fc9f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:54.194527 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891650c7-e1e3-47f2-a67e-ae7332c2fc9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:54.194527 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891650c7-e1e3-47f2-a67e-ae7332c2fc9f None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:54.194527 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 549/1096] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Aug 8 02:06:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:54.195004 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304592a9-05bd-4cfb-8db8-e36b87f2fd7b None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:54.303106 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:54.313179 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304592a9-05bd-4cfb-8db8-e36b87f2fd7b None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:54.346179 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06088f4c-8d54-4139-9267-bbbf78cc1159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:54.346805 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06088f4c-8d54-4139-9267-bbbf78cc1159 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:54.347086 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06088f4c-8d54-4139-9267-bbbf78cc1159 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:54.347374 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06088f4c-8d54-4139-9267-bbbf78cc1159 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:54.357556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06088f4c-8d54-4139-9267-bbbf78cc1159 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:54.358990 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06088f4c-8d54-4139-9267-bbbf78cc1159 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:54.373474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-06088f4c-8d54-4139-9267-bbbf78cc1159 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:54.373474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:54.373474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:54.373474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:54.373474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:54.373474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:54.373474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:54.373474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:54.373474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:54.373474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:54.373474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:54.373474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:54.373474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:54.373474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:54.373474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:54.373474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:54.374462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:54.374462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:54.374462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:54.374462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:54.374462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:54.374462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:54.374462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:54.374462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:54.374462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:54.374462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:54.374462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:54.374462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:54.374462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:54.374462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:54.374462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:54.374462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:54.374462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:54.375331 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:54.375331 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:54.375331 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:54.375331 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 548/1097] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:06:54.380300 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891650c7-e1e3-47f2-a67e-ae7332c2fc9f None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:54.477305 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891650c7-e1e3-47f2-a67e-ae7332c2fc9f None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:54.509782 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81c8ef-08aa-4308-9ab5-8c31b5cd8186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:54.510380 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81c8ef-08aa-4308-9ab5-8c31b5cd8186 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:54.510663 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81c8ef-08aa-4308-9ab5-8c31b5cd8186 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:54.510992 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81c8ef-08aa-4308-9ab5-8c31b5cd8186 None admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:54.511667 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81c8ef-08aa-4308-9ab5-8c31b5cd8186 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:54.511973 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81c8ef-08aa-4308-9ab5-8c31b5cd8186 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:54.513326 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81c8ef-08aa-4308-9ab5-8c31b5cd8186 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:54.525342 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 550/1098] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:54.530957 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06088f4c-8d54-4139-9267-bbbf78cc1159 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:54.636542 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06088f4c-8d54-4139-9267-bbbf78cc1159 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:54.669041 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7febe0-51cc-442f-8643-56f5cfc00695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:54.669650 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7febe0-51cc-442f-8643-56f5cfc00695 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:54.669929 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7febe0-51cc-442f-8643-56f5cfc00695 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:54.670199 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7febe0-51cc-442f-8643-56f5cfc00695 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:54.677221 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7febe0-51cc-442f-8643-56f5cfc00695 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:54.678637 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7febe0-51cc-442f-8643-56f5cfc00695 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:54.689498 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-be7febe0-51cc-442f-8643-56f5cfc00695 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:06:54.689498 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:54.689498 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:54.689498 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:54.689498 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:54.689498 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:54.689498 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:54.689498 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:54.689498 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:54.689498 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:54.689498 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:54.689498 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:54.689498 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:06:54.689498 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:06:54.689498 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:06:54.689498 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:06:54.690603 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:54.690603 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:54.690603 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:06:54.690603 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:54.690603 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:06:54.690603 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:06:54.690603 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:54.690603 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:54.690603 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:54.690603 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:54.690603 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:54.690603 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:54.690603 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:54.690603 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:54.690603 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:54.690603 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:54.690603 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:54.690603 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:54.691574 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:54.691574 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:54.691574 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:06:54.691574 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:06:54.691574 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:06:54.691574 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:06:54.691574 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:06:54.691574 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:06:54.691574 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 02:06:54.691574 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:06:54.691574 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 549/1099] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Aug 8 02:06:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:06:54.696319 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81c8ef-08aa-4308-9ab5-8c31b5cd8186 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:54.750254 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:54.795452 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81c8ef-08aa-4308-9ab5-8c31b5cd8186 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:54.829132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ea8c4-96b0-4825-928d-fc322f9f8e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:54.829742 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ea8c4-96b0-4825-928d-fc322f9f8e8a None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:54.830022 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ea8c4-96b0-4825-928d-fc322f9f8e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:54.830301 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ea8c4-96b0-4825-928d-fc322f9f8e8a None admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:54.831020 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ea8c4-96b0-4825-928d-fc322f9f8e8a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:54.831366 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ea8c4-96b0-4825-928d-fc322f9f8e8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:54.832789 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ea8c4-96b0-4825-928d-fc322f9f8e8a None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:54.850261 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 551/1100] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Aug 8 02:06:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:06:54.856042 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7febe0-51cc-442f-8643-56f5cfc00695 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:54.858905 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:54.960535 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7febe0-51cc-442f-8643-56f5cfc00695 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:54.993458 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2e77a-7e5d-4e04-acc9-ece4d5b52eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:54.994052 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2e77a-7e5d-4e04-acc9-ece4d5b52eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:54.994332 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2e77a-7e5d-4e04-acc9-ece4d5b52eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:54.994604 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2e77a-7e5d-4e04-acc9-ece4d5b52eb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:55.058615 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2e77a-7e5d-4e04-acc9-ece4d5b52eb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:55.060000 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2e77a-7e5d-4e04-acc9-ece4d5b52eb8 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:55.061747 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:55.154496 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 550/1101] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:06:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:06:55.160249 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ea8c4-96b0-4825-928d-fc322f9f8e8a None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:55.278146 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ea8c4-96b0-4825-928d-fc322f9f8e8a None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:55.296343 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:55.317602 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3317a1f-11dc-49be-872a-06ed0c816dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:55.318164 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3317a1f-11dc-49be-872a-06ed0c816dea None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:55.318445 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3317a1f-11dc-49be-872a-06ed0c816dea None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:55.318720 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3317a1f-11dc-49be-872a-06ed0c816dea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:55.328719 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3317a1f-11dc-49be-872a-06ed0c816dea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:55.330437 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3317a1f-11dc-49be-872a-06ed0c816dea None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:55.345384 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-b3317a1f-11dc-49be-872a-06ed0c816dea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:55.345384 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:55.345384 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:55.345384 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:55.345384 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:55.345384 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:55.345384 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:55.345384 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:55.345384 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:55.345384 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:55.345384 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:55.345384 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:55.345384 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:06:55.345384 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:06:55.345384 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:06:55.345384 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:06:55.346442 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:55.346442 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:55.346442 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:55.346442 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:55.346442 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:55.346442 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:55.346442 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:55.346442 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:55.346442 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:55.346442 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:55.346442 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:55.346442 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:55.346442 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:55.346442 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:55.346442 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:55.346442 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:55.346442 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:06:55.347553 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:06:55.347553 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:06:55.347553 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:55.347553 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 552/1102] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:06:55.352655 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2e77a-7e5d-4e04-acc9-ece4d5b52eb8 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:55.450627 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2e77a-7e5d-4e04-acc9-ece4d5b52eb8 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:55.452131 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:55.483748 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2f1ff-5648-4a8e-ba1d-527806b5a4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:55.484356 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2f1ff-5648-4a8e-ba1d-527806b5a4f6 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:55.484903 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2f1ff-5648-4a8e-ba1d-527806b5a4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:55.485174 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2f1ff-5648-4a8e-ba1d-527806b5a4f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:55.485803 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab2f1ff-5648-4a8e-ba1d-527806b5a4f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:55.486102 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab2f1ff-5648-4a8e-ba1d-527806b5a4f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:55.487467 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab2f1ff-5648-4a8e-ba1d-527806b5a4f6 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:55.498386 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 551/1103] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:06:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:55.503994 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3317a1f-11dc-49be-872a-06ed0c816dea None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:55.603115 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3317a1f-11dc-49be-872a-06ed0c816dea None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:55.635236 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7528cb70-7d57-4446-9dcf-fa76a2ceb82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:55.635886 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528cb70-7d57-4446-9dcf-fa76a2ceb82b None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:55.636165 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528cb70-7d57-4446-9dcf-fa76a2ceb82b None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:55.636437 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528cb70-7d57-4446-9dcf-fa76a2ceb82b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:55.642802 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7528cb70-7d57-4446-9dcf-fa76a2ceb82b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:55.644244 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7528cb70-7d57-4446-9dcf-fa76a2ceb82b None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:55.655483 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-7528cb70-7d57-4446-9dcf-fa76a2ceb82b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:55.655483 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:06:55.655483 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:06:55.655483 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:06:55.655483 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:06:55.655483 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:06:55.655483 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:06:55.655483 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:06:55.655483 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:06:55.655483 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:06:55.655483 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:06:55.655483 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:06:55.655483 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:06:55.655483 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:06:55.655483 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:06:55.656396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:06:55.656396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:06:55.656396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:06:55.656396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:06:55.656396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:06:55.656396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:06:55.656396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:06:55.656396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:06:55.656396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:06:55.656396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:06:55.656396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:06:55.656396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:06:55.656396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:06:55.656396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:06:55.656396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:06:55.656396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:06:55.656396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:06:55.657275 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:06:55.657275 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:06:55.657275 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:06:55.657275 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:06:55.657275 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:06:55.657275 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:06:55.657275 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:06:55.657275 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:06:55.657275 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 553/1104] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:06:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:06:55.662399 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2f1ff-5648-4a8e-ba1d-527806b5a4f6 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:55.758991 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2f1ff-5648-4a8e-ba1d-527806b5a4f6 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:55.791695 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9682a4a-39a2-4aa8-89a6-b41b54713252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:55.792302 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9682a4a-39a2-4aa8-89a6-b41b54713252 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:55.792585 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9682a4a-39a2-4aa8-89a6-b41b54713252 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:55.792889 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9682a4a-39a2-4aa8-89a6-b41b54713252 None admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:55.793543 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9682a4a-39a2-4aa8-89a6-b41b54713252 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:55.793850 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9682a4a-39a2-4aa8-89a6-b41b54713252 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:55.795265 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9682a4a-39a2-4aa8-89a6-b41b54713252 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:55.807272 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 552/1105] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 02:06:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:55.813337 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7528cb70-7d57-4446-9dcf-fa76a2ceb82b None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:55.839029 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:55.915996 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7528cb70-7d57-4446-9dcf-fa76a2ceb82b None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:55.949371 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304fd6f6-1771-4232-aed7-427d975ac1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:55.949961 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fd6f6-1771-4232-aed7-427d975ac1ab None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:55.950237 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fd6f6-1771-4232-aed7-427d975ac1ab None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:55.950507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fd6f6-1771-4232-aed7-427d975ac1ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:55.951269 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304fd6f6-1771-4232-aed7-427d975ac1ab None admin] RBAC: Adding query filter params (role.id=6078f0a415d84735a3dd5948e5bde324, scope.project.id=ebe178f5bce64a009bf690031676c89f, user.id=5d89e0c7d62444e4b75d3f4da49b2bc4) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:55.951603 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304fd6f6-1771-4232-aed7-427d975ac1ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:55.952992 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304fd6f6-1771-4232-aed7-427d975ac1ab None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:55.958653 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 554/1106] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:06:55 2022] GET /identity/v3/role_assignments?user.id=5d89e0c7d62444e4b75d3f4da49b2bc4&scope.project.id=ebe178f5bce64a009bf690031676c89f&role.id=6078f0a415d84735a3dd5948e5bde324 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:56.094772 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595633c-b1da-4a55-8a11-0f245696ca84 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:56.095297 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595633c-b1da-4a55-8a11-0f245696ca84 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:56.096029 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595633c-b1da-4a55-8a11-0f245696ca84 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:56.097388 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 553/1107] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:56.102792 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c68f70-0a4b-48d0-b0bd-ba40d752793d None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:56.103081 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c68f70-0a4b-48d0-b0bd-ba40d752793d None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:56.103382 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c68f70-0a4b-48d0-b0bd-ba40d752793d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:56.124022 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-08c68f70-0a4b-48d0-b0bd-ba40d752793d None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:56.124974 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-08c68f70-0a4b-48d0-b0bd-ba40d752793d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:56.194801 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 555/1108] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:56.219665 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595633c-b1da-4a55-8a11-0f245696ca84 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:56.244965 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:56.322003 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595633c-b1da-4a55-8a11-0f245696ca84 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:56.355170 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b5905-343c-4de2-a563-08e2490b17e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:56.355899 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b5905-343c-4de2-a563-08e2490b17e2 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:56.356178 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b5905-343c-4de2-a563-08e2490b17e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:56.356450 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b5905-343c-4de2-a563-08e2490b17e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:56.357543 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448b5905-343c-4de2-a563-08e2490b17e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:56.358959 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448b5905-343c-4de2-a563-08e2490b17e2 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:56.360551 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 554/1109] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:06:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:56.366515 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c68f70-0a4b-48d0-b0bd-ba40d752793d None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:56.388603 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:56.470610 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c68f70-0a4b-48d0-b0bd-ba40d752793d None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:56.505227 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17bc7be-e25b-4290-b9d5-9dbd3da54877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:56.505839 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bc7be-e25b-4290-b9d5-9dbd3da54877 None admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:56.506106 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bc7be-e25b-4290-b9d5-9dbd3da54877 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:56.506374 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bc7be-e25b-4290-b9d5-9dbd3da54877 None admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:56.507023 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17bc7be-e25b-4290-b9d5-9dbd3da54877 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:56.509009 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17bc7be-e25b-4290-b9d5-9dbd3da54877 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:56.632350 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 556/1110] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 8 02:06:56 2022] POST /identity/v3/users => generated 286 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:06:58.671368 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1267d06-93ec-4a61-9fed-c140801a8a80 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:58.671888 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1267d06-93ec-4a61-9fed-c140801a8a80 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:58.672001 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1267d06-93ec-4a61-9fed-c140801a8a80 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:58.673271 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 555/1111] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:06:58.678390 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2fdf6-3e8a-46d6-8e97-69339a1136bd None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:58.678787 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2fdf6-3e8a-46d6-8e97-69339a1136bd None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:58.678939 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2fdf6-3e8a-46d6-8e97-69339a1136bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:58.697201 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-cda2fdf6-3e8a-46d6-8e97-69339a1136bd None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:06:58.698376 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-cda2fdf6-3e8a-46d6-8e97-69339a1136bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:06:58.762026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 557/1112] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:06:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:06:58.785281 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1267d06-93ec-4a61-9fed-c140801a8a80 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:58.872384 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:58.882302 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1267d06-93ec-4a61-9fed-c140801a8a80 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:58.914324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017dd5d-352d-4a95-8a9d-7ec3c7dc5367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:58.927146 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017dd5d-352d-4a95-8a9d-7ec3c7dc5367 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:58.927146 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017dd5d-352d-4a95-8a9d-7ec3c7dc5367 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:58.927146 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017dd5d-352d-4a95-8a9d-7ec3c7dc5367 None admin] PATH_INFO: `/v3/roles/e513bb6d8f644c1d9156090e507a03d4` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:58.927146 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c017dd5d-352d-4a95-8a9d-7ec3c7dc5367 None admin] RBAC: Authorizing `identity:get_role(role_id=e513bb6d8f644c1d9156090e507a03d4)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:58.927146 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c017dd5d-352d-4a95-8a9d-7ec3c7dc5367 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:58.927146 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 556/1113] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:06:58 2022] GET /identity/v3/roles/e513bb6d8f644c1d9156090e507a03d4 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:58.927741 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2fdf6-3e8a-46d6-8e97-69339a1136bd None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:58.928513 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:59.088814 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2fdf6-3e8a-46d6-8e97-69339a1136bd None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:59.122197 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96902b2-5883-4f85-919d-f1c47f9a15b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:59.122812 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96902b2-5883-4f85-919d-f1c47f9a15b7 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:59.123089 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96902b2-5883-4f85-919d-f1c47f9a15b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:59.123384 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96902b2-5883-4f85-919d-f1c47f9a15b7 None admin] PATH_INFO: `/v3/users/e787004b9e754e9d969a3a5fbdf59883` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:59.135847 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96902b2-5883-4f85-919d-f1c47f9a15b7 None admin] RBAC: Authorizing `identity:get_user(user_id=e787004b9e754e9d969a3a5fbdf59883)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:59.137261 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96902b2-5883-4f85-919d-f1c47f9a15b7 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:59.138829 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 558/1114] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:06:58 2022] GET /identity/v3/users/e787004b9e754e9d969a3a5fbdf59883 => generated 286 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:59.144709 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017dd5d-352d-4a95-8a9d-7ec3c7dc5367 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:59.239982 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017dd5d-352d-4a95-8a9d-7ec3c7dc5367 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:59.272251 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3374cac-ab10-4a0a-9cd0-f2333fa19a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:59.272834 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3374cac-ab10-4a0a-9cd0-f2333fa19a84 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:59.273111 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3374cac-ab10-4a0a-9cd0-f2333fa19a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:59.273894 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3374cac-ab10-4a0a-9cd0-f2333fa19a84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:59.299645 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:59.338910 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3374cac-ab10-4a0a-9cd0-f2333fa19a84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:59.340433 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3374cac-ab10-4a0a-9cd0-f2333fa19a84 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:59.435065 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 557/1115] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:06:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:06:59.440965 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96902b2-5883-4f85-919d-f1c47f9a15b7 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:59.500103 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:59.536999 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96902b2-5883-4f85-919d-f1c47f9a15b7 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:59.571575 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709328b-75be-4a9c-9e8d-e2c1c02eedc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:59.572194 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709328b-75be-4a9c-9e8d-e2c1c02eedc9 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:59.572472 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709328b-75be-4a9c-9e8d-e2c1c02eedc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:59.572745 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709328b-75be-4a9c-9e8d-e2c1c02eedc9 None admin] PATH_INFO: `/v3/projects/0938d0f458a34ee98c0ab7e8a4d6c75c` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:59.573836 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709328b-75be-4a9c-9e8d-e2c1c02eedc9 None admin] RBAC: Authorizing `identity:get_project(project_id=0938d0f458a34ee98c0ab7e8a4d6c75c)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:59.575246 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709328b-75be-4a9c-9e8d-e2c1c02eedc9 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:59.576876 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 559/1116] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:06:59 2022] GET /identity/v3/projects/0938d0f458a34ee98c0ab7e8a4d6c75c => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:06:59.582949 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3374cac-ab10-4a0a-9cd0-f2333fa19a84 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:06:59.637911 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:06:59.677206 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3374cac-ab10-4a0a-9cd0-f2333fa19a84 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:06:59.709890 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358bd46-951e-4ff1-a50d-38005d857927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:06:59.710476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358bd46-951e-4ff1-a50d-38005d857927 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:06:59.711255 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358bd46-951e-4ff1-a50d-38005d857927 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:06:59.711554 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358bd46-951e-4ff1-a50d-38005d857927 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:06:59.712264 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9358bd46-951e-4ff1-a50d-38005d857927 None admin] RBAC: Adding query filter params (role.id=e513bb6d8f644c1d9156090e507a03d4, scope.project.id=0938d0f458a34ee98c0ab7e8a4d6c75c, user.id=e787004b9e754e9d969a3a5fbdf59883) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:06:59.712569 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9358bd46-951e-4ff1-a50d-38005d857927 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:06:59.713970 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9358bd46-951e-4ff1-a50d-38005d857927 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:06:59.719045 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 558/1117] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:06:59 2022] GET /identity/v3/role_assignments?user.id=e787004b9e754e9d969a3a5fbdf59883&scope.project.id=0938d0f458a34ee98c0ab7e8a4d6c75c&role.id=e513bb6d8f644c1d9156090e507a03d4 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:07:01.678634 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfa970-0668-4ebc-84f5-a341d1ec001c None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:01.679139 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfa970-0668-4ebc-84f5-a341d1ec001c None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:01.679258 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfa970-0668-4ebc-84f5-a341d1ec001c None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:01.680652 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 560/1118] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:07:01.686009 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c53632-9051-45b0-9756-fc13001c0794 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:01.686391 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c53632-9051-45b0-9756-fc13001c0794 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:01.686558 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c53632-9051-45b0-9756-fc13001c0794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:01.704565 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-77c53632-9051-45b0-9756-fc13001c0794 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:07:01.705731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-77c53632-9051-45b0-9756-fc13001c0794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:07:01.769182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 559/1119] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:07:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:07:01.791505 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bfa970-0668-4ebc-84f5-a341d1ec001c None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:01.889256 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bfa970-0668-4ebc-84f5-a341d1ec001c None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:01.917419 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:01.923007 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b9633-49e0-4222-be36-8612a95a2c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:01.923652 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b9633-49e0-4222-be36-8612a95a2c96 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:01.923934 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b9633-49e0-4222-be36-8612a95a2c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:01.924234 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b9633-49e0-4222-be36-8612a95a2c96 None admin] PATH_INFO: `/v3/roles/e513bb6d8f644c1d9156090e507a03d4` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:01.925623 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b9633-49e0-4222-be36-8612a95a2c96 None admin] RBAC: Authorizing `identity:get_role(role_id=e513bb6d8f644c1d9156090e507a03d4)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:01.927007 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b9633-49e0-4222-be36-8612a95a2c96 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:01.928382 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 561/1120] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:07:01 2022] GET /identity/v3/roles/e513bb6d8f644c1d9156090e507a03d4 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:07:01.934983 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c53632-9051-45b0-9756-fc13001c0794 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:01.984942 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:02.028540 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c53632-9051-45b0-9756-fc13001c0794 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:02.061314 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7407e15-a7a3-4e22-aa01-d7ba4c77a228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:02.061927 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7407e15-a7a3-4e22-aa01-d7ba4c77a228 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:02.062207 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7407e15-a7a3-4e22-aa01-d7ba4c77a228 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:02.062478 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7407e15-a7a3-4e22-aa01-d7ba4c77a228 None admin] PATH_INFO: `/v3/users/e787004b9e754e9d969a3a5fbdf59883` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:02.063601 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7407e15-a7a3-4e22-aa01-d7ba4c77a228 None admin] RBAC: Authorizing `identity:get_user(user_id=e787004b9e754e9d969a3a5fbdf59883)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:02.065014 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7407e15-a7a3-4e22-aa01-d7ba4c77a228 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:02.066566 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 560/1121] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:07:01 2022] GET /identity/v3/users/e787004b9e754e9d969a3a5fbdf59883 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:07:02.072228 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b9633-49e0-4222-be36-8612a95a2c96 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:02.172873 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b9633-49e0-4222-be36-8612a95a2c96 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:02.205013 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36bf0d0-37da-41b9-8ffd-c21c6dd769a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:02.205564 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bf0d0-37da-41b9-8ffd-c21c6dd769a1 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:02.205841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bf0d0-37da-41b9-8ffd-c21c6dd769a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:02.206109 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bf0d0-37da-41b9-8ffd-c21c6dd769a1 None admin] PATH_INFO: `/v3/projects/0938d0f458a34ee98c0ab7e8a4d6c75c` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:02.207199 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36bf0d0-37da-41b9-8ffd-c21c6dd769a1 None admin] RBAC: Authorizing `identity:get_project(project_id=0938d0f458a34ee98c0ab7e8a4d6c75c)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:02.208635 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36bf0d0-37da-41b9-8ffd-c21c6dd769a1 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:02.210230 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 562/1122] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:07:02 2022] GET /identity/v3/projects/0938d0f458a34ee98c0ab7e8a4d6c75c => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:07:02.216824 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7407e15-a7a3-4e22-aa01-d7ba4c77a228 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:02.312237 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7407e15-a7a3-4e22-aa01-d7ba4c77a228 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:02.331453 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:02.344708 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efbdf52-e287-43f9-bfa2-9e90155e74f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:02.345432 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efbdf52-e287-43f9-bfa2-9e90155e74f7 None admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:02.345715 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efbdf52-e287-43f9-bfa2-9e90155e74f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:02.345994 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efbdf52-e287-43f9-bfa2-9e90155e74f7 None admin] PATH_INFO: `/v3/projects/0938d0f458a34ee98c0ab7e8a4d6c75c/users/e787004b9e754e9d969a3a5fbdf59883/roles/e513bb6d8f644c1d9156090e507a03d4` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:02.348122 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efbdf52-e287-43f9-bfa2-9e90155e74f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=0938d0f458a34ee98c0ab7e8a4d6c75c, user_id=e787004b9e754e9d969a3a5fbdf59883, role_id=e513bb6d8f644c1d9156090e507a03d4)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:02.349546 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efbdf52-e287-43f9-bfa2-9e90155e74f7 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:02.402916 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 561/1123] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 02:07:02 2022] PUT /identity/v3/projects/0938d0f458a34ee98c0ab7e8a4d6c75c/users/e787004b9e754e9d969a3a5fbdf59883/roles/e513bb6d8f644c1d9156090e507a03d4 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:07:04.395069 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9e2ba-8443-4841-9fad-9d4a2d88499c None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:04.395638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9e2ba-8443-4841-9fad-9d4a2d88499c None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:04.395638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9e2ba-8443-4841-9fad-9d4a2d88499c None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:04.396967 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 563/1124] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:07:04.402145 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011351e7-ab5c-450e-8b99-47ac756b63bb None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:04.402592 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011351e7-ab5c-450e-8b99-47ac756b63bb None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:04.402692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011351e7-ab5c-450e-8b99-47ac756b63bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:04.420762 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-011351e7-ab5c-450e-8b99-47ac756b63bb None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:07:04.421939 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-011351e7-ab5c-450e-8b99-47ac756b63bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:07:04.485578 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 562/1125] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:07:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:07:04.508775 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9e2ba-8443-4841-9fad-9d4a2d88499c None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:04.572494 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:04.606480 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9e2ba-8443-4841-9fad-9d4a2d88499c None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:04.639809 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b66e1f-052e-4980-831f-c8b25298f188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:04.640358 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b66e1f-052e-4980-831f-c8b25298f188 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:04.640636 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b66e1f-052e-4980-831f-c8b25298f188 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:04.640909 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b66e1f-052e-4980-831f-c8b25298f188 None admin] PATH_INFO: `/v3/roles/e513bb6d8f644c1d9156090e507a03d4` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:04.642267 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b66e1f-052e-4980-831f-c8b25298f188 None admin] RBAC: Authorizing `identity:get_role(role_id=e513bb6d8f644c1d9156090e507a03d4)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:04.643774 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b66e1f-052e-4980-831f-c8b25298f188 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:04.645082 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 564/1126] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:07:04 2022] GET /identity/v3/roles/e513bb6d8f644c1d9156090e507a03d4 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:07:04.650802 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011351e7-ab5c-450e-8b99-47ac756b63bb None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:04.745068 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011351e7-ab5c-450e-8b99-47ac756b63bb None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:04.755070 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:04.778102 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f5e30-7d57-48fa-96a9-790406327b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:04.778714 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f5e30-7d57-48fa-96a9-790406327b68 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:04.778992 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f5e30-7d57-48fa-96a9-790406327b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:04.779263 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f5e30-7d57-48fa-96a9-790406327b68 None admin] PATH_INFO: `/v3/users/e787004b9e754e9d969a3a5fbdf59883` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:04.780592 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f5e30-7d57-48fa-96a9-790406327b68 None admin] RBAC: Authorizing `identity:get_user(user_id=e787004b9e754e9d969a3a5fbdf59883)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:04.782574 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f5e30-7d57-48fa-96a9-790406327b68 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:04.784194 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 563/1127] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:07:04 2022] GET /identity/v3/users/e787004b9e754e9d969a3a5fbdf59883 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:07:04.789803 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b66e1f-052e-4980-831f-c8b25298f188 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:04.886295 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b66e1f-052e-4980-831f-c8b25298f188 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:04.919027 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c1cb9-a4a4-44cd-a96d-b70b09c78b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:04.919637 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c1cb9-a4a4-44cd-a96d-b70b09c78b6f None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:04.919919 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c1cb9-a4a4-44cd-a96d-b70b09c78b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:04.920192 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c1cb9-a4a4-44cd-a96d-b70b09c78b6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:04.922662 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:04.986389 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c1cb9-a4a4-44cd-a96d-b70b09c78b6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:04.987850 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c1cb9-a4a4-44cd-a96d-b70b09c78b6f None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:05.081264 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 565/1128] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:07:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:07:05.087639 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f5e30-7d57-48fa-96a9-790406327b68 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:05.183056 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f5e30-7d57-48fa-96a9-790406327b68 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:05.214957 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db82839-6daf-4bb4-b3bd-6dac7ac54765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:05.215591 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db82839-6daf-4bb4-b3bd-6dac7ac54765 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:05.215874 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db82839-6daf-4bb4-b3bd-6dac7ac54765 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:05.216150 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db82839-6daf-4bb4-b3bd-6dac7ac54765 None admin] PATH_INFO: `/v3/projects/0938d0f458a34ee98c0ab7e8a4d6c75c` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:05.217272 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db82839-6daf-4bb4-b3bd-6dac7ac54765 None admin] RBAC: Authorizing `identity:get_project(project_id=0938d0f458a34ee98c0ab7e8a4d6c75c)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:05.218691 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db82839-6daf-4bb4-b3bd-6dac7ac54765 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:05.220376 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 564/1129] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:07:05 2022] GET /identity/v3/projects/0938d0f458a34ee98c0ab7e8a4d6c75c => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:07:05.226970 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c1cb9-a4a4-44cd-a96d-b70b09c78b6f None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:05.258575 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:05.322939 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c1cb9-a4a4-44cd-a96d-b70b09c78b6f None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:05.355249 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f706a2-60c3-40c3-be19-7029f216a54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:05.355885 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f706a2-60c3-40c3-be19-7029f216a54e None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:05.356161 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f706a2-60c3-40c3-be19-7029f216a54e None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:05.356430 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f706a2-60c3-40c3-be19-7029f216a54e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:05.357133 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f706a2-60c3-40c3-be19-7029f216a54e None admin] RBAC: Adding query filter params (role.id=e513bb6d8f644c1d9156090e507a03d4, scope.project.id=0938d0f458a34ee98c0ab7e8a4d6c75c, user.id=e787004b9e754e9d969a3a5fbdf59883) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:07:05.357435 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f706a2-60c3-40c3-be19-7029f216a54e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:05.358827 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f706a2-60c3-40c3-be19-7029f216a54e None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:05.364369 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 566/1130] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:07:05 2022] GET /identity/v3/role_assignments?user.id=e787004b9e754e9d969a3a5fbdf59883&scope.project.id=0938d0f458a34ee98c0ab7e8a4d6c75c&role.id=e513bb6d8f644c1d9156090e507a03d4 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:07:07.351699 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788ea0a-18a3-42b7-9263-9c48eaae77f9 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:07.352259 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788ea0a-18a3-42b7-9263-9c48eaae77f9 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:07.352259 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788ea0a-18a3-42b7-9263-9c48eaae77f9 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:07.353610 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 565/1131] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:07:07.358825 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a2721-8048-4ab8-b943-27e2a8ed1e9b None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:07.359224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a2721-8048-4ab8-b943-27e2a8ed1e9b None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:07.360675 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a2721-8048-4ab8-b943-27e2a8ed1e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:07.380813 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-ea3a2721-8048-4ab8-b943-27e2a8ed1e9b None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:07:07.381996 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-ea3a2721-8048-4ab8-b943-27e2a8ed1e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:07:07.446213 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 567/1132] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:07:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:07:07.469066 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788ea0a-18a3-42b7-9263-9c48eaae77f9 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:07.515109 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:07.566764 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788ea0a-18a3-42b7-9263-9c48eaae77f9 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:07.599121 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988cbab-6be8-483f-89e0-9e41ddbbfef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:07.599776 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988cbab-6be8-483f-89e0-9e41ddbbfef0 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:07.600058 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988cbab-6be8-483f-89e0-9e41ddbbfef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:07.600332 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988cbab-6be8-483f-89e0-9e41ddbbfef0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:07.601472 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988cbab-6be8-483f-89e0-9e41ddbbfef0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:07.602941 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988cbab-6be8-483f-89e0-9e41ddbbfef0 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:07.604465 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 566/1133] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:07:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:07:07.610121 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a2721-8048-4ab8-b943-27e2a8ed1e9b None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:07.636938 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:07.706240 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a2721-8048-4ab8-b943-27e2a8ed1e9b None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:07.738245 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849cafe-38f3-48e1-8d8c-4d7567745a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:07.738836 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849cafe-38f3-48e1-8d8c-4d7567745a11 None admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:07.739114 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849cafe-38f3-48e1-8d8c-4d7567745a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:07.739417 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849cafe-38f3-48e1-8d8c-4d7567745a11 None admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:07.740058 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b849cafe-38f3-48e1-8d8c-4d7567745a11 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:07.741464 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b849cafe-38f3-48e1-8d8c-4d7567745a11 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:07.832363 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 568/1134] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Aug 8 02:07:07 2022] POST /identity/v3/projects => generated 311 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:07:09.848243 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22357d1c-8d83-4c4e-b759-133efc493b48 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:09.848796 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22357d1c-8d83-4c4e-b759-133efc493b48 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:09.848796 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22357d1c-8d83-4c4e-b759-133efc493b48 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:09.850148 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 567/1135] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:07:09.855859 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1bbff7-eee9-41e2-874a-7c093044316d None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:09.856263 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1bbff7-eee9-41e2-874a-7c093044316d None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:09.856415 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1bbff7-eee9-41e2-874a-7c093044316d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:09.874410 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-2c1bbff7-eee9-41e2-874a-7c093044316d None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:07:09.875607 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-2c1bbff7-eee9-41e2-874a-7c093044316d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:07:09.938943 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 569/1136] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:07:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:07:09.962852 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22357d1c-8d83-4c4e-b759-133efc493b48 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:10.072523 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22357d1c-8d83-4c4e-b759-133efc493b48 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:10.085806 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:10.104969 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aba8ef-c27c-4dc9-abd9-673808ba76b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:10.105533 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aba8ef-c27c-4dc9-abd9-673808ba76b3 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:10.105814 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aba8ef-c27c-4dc9-abd9-673808ba76b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:10.106087 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aba8ef-c27c-4dc9-abd9-673808ba76b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:10.107190 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aba8ef-c27c-4dc9-abd9-673808ba76b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:10.108634 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aba8ef-c27c-4dc9-abd9-673808ba76b3 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:10.110182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 568/1137] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:07:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:07:10.116006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1bbff7-eee9-41e2-874a-7c093044316d None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:10.127922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:10.220041 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1bbff7-eee9-41e2-874a-7c093044316d None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:10.252793 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94f715-b84b-4051-a6a8-72dca8abf869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:10.253381 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94f715-b84b-4051-a6a8-72dca8abf869 None admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:10.253656 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94f715-b84b-4051-a6a8-72dca8abf869 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:10.253925 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94f715-b84b-4051-a6a8-72dca8abf869 None admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:10.254565 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94f715-b84b-4051-a6a8-72dca8abf869 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:10.255997 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94f715-b84b-4051-a6a8-72dca8abf869 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:10.340948 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 570/1138] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 8 02:07:10 2022] POST /identity/v3/users => generated 286 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:07:12.348402 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffed98-ec6f-45e0-b883-9fddc7eb04c3 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:12.348960 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffed98-ec6f-45e0-b883-9fddc7eb04c3 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:12.348960 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffed98-ec6f-45e0-b883-9fddc7eb04c3 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:12.350272 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 569/1139] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:07:12.355521 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b5887-6108-451f-aa7d-9fa257cb9f2a None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:12.355940 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b5887-6108-451f-aa7d-9fa257cb9f2a None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:12.356087 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b5887-6108-451f-aa7d-9fa257cb9f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:12.373570 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-ee2b5887-6108-451f-aa7d-9fa257cb9f2a None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:07:12.374747 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-ee2b5887-6108-451f-aa7d-9fa257cb9f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:07:12.433168 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:12.440227 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 571/1140] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:07:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:07:12.464575 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffed98-ec6f-45e0-b883-9fddc7eb04c3 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:12.560637 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffed98-ec6f-45e0-b883-9fddc7eb04c3 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:12.593681 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2be0e0-102c-430b-9640-803c13a12e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:12.594284 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2be0e0-102c-430b-9640-803c13a12e8c None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:12.594560 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2be0e0-102c-430b-9640-803c13a12e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:12.594830 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2be0e0-102c-430b-9640-803c13a12e8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:12.604422 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2be0e0-102c-430b-9640-803c13a12e8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:07:12.608920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-8f2be0e0-102c-430b-9640-803c13a12e8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:07:12.608920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:07:12.608920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:07:12.608920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:07:12.608920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:07:12.608920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:07:12.608920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:07:12.608920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:07:12.608920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:07:12.608920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:07:12.608920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:07:12.608920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:07:12.608920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:07:12.608920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:07:12.608920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:07:12.608920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:07:12.610079 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:07:12.610079 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:07:12.610079 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:07:12.610079 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:07:12.610079 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:07:12.610079 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:07:12.610079 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:07:12.610079 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:07:12.610079 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:07:12.610079 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:07:12.610079 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:07:12.610079 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:07:12.610079 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:07:12.610079 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:07:12.610079 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:07:12.610079 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:07:12.611338 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:07:12.611338 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:07:12.611338 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:07:12.611338 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:07:12.611338 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:07:12.611338 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:07:12.611338 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:07:12.611338 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:07:12.611338 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:07:12.611338 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:07:12.611338 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:07:12.611338 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:07:12.611338 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 570/1141] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 02:07:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:07:12.615883 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b5887-6108-451f-aa7d-9fa257cb9f2a None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:12.709759 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b5887-6108-451f-aa7d-9fa257cb9f2a None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:12.741381 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39646a88-eae3-4efb-88c6-ff1362104e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:12.742485 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39646a88-eae3-4efb-88c6-ff1362104e3e None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:12.742768 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39646a88-eae3-4efb-88c6-ff1362104e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:12.743077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39646a88-eae3-4efb-88c6-ff1362104e3e None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:12.743888 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39646a88-eae3-4efb-88c6-ff1362104e3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:07:12.744192 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39646a88-eae3-4efb-88c6-ff1362104e3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:12.745551 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39646a88-eae3-4efb-88c6-ff1362104e3e None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:12.753514 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 572/1142] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:07:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:07:12.759261 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2be0e0-102c-430b-9640-803c13a12e8c None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:12.801270 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:12.854059 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2be0e0-102c-430b-9640-803c13a12e8c None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:12.885808 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba36710-f612-441a-a84c-23d86f8e1e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:12.886348 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba36710-f612-441a-a84c-23d86f8e1e70 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:12.886623 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba36710-f612-441a-a84c-23d86f8e1e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:12.886890 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba36710-f612-441a-a84c-23d86f8e1e70 None admin] PATH_INFO: `/v3/users/135b93f074c845c8b5cb9412268d1230` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:12.901202 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba36710-f612-441a-a84c-23d86f8e1e70 None admin] RBAC: Authorizing `identity:get_user(user_id=135b93f074c845c8b5cb9412268d1230)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:12.902574 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba36710-f612-441a-a84c-23d86f8e1e70 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:12.904233 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 571/1143] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:07:12 2022] GET /identity/v3/users/135b93f074c845c8b5cb9412268d1230 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:07:12.909965 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39646a88-eae3-4efb-88c6-ff1362104e3e None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:12.966371 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:13.006355 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39646a88-eae3-4efb-88c6-ff1362104e3e None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:13.039298 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a52fc2-f137-4219-a4e9-c6663fe5788e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:13.039918 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a52fc2-f137-4219-a4e9-c6663fe5788e None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:13.040204 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a52fc2-f137-4219-a4e9-c6663fe5788e None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:13.040484 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a52fc2-f137-4219-a4e9-c6663fe5788e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:13.105337 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a52fc2-f137-4219-a4e9-c6663fe5788e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:13.106761 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a52fc2-f137-4219-a4e9-c6663fe5788e None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:13.161240 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:13.202173 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 573/1144] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:07:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:07:13.208057 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba36710-f612-441a-a84c-23d86f8e1e70 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:13.298952 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:13.301757 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba36710-f612-441a-a84c-23d86f8e1e70 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:13.334250 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae655a5c-75e2-4f9a-a664-4ced5c1ce509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:13.335089 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae655a5c-75e2-4f9a-a664-4ced5c1ce509 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:13.335597 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae655a5c-75e2-4f9a-a664-4ced5c1ce509 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:13.336179 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae655a5c-75e2-4f9a-a664-4ced5c1ce509 None admin] PATH_INFO: `/v3/projects/b8bb154fc1d24b00af4e25ae8974e85d` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:13.337280 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae655a5c-75e2-4f9a-a664-4ced5c1ce509 None admin] RBAC: Authorizing `identity:get_project(project_id=b8bb154fc1d24b00af4e25ae8974e85d)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:13.338685 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae655a5c-75e2-4f9a-a664-4ced5c1ce509 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:13.340285 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 572/1145] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:07:13 2022] GET /identity/v3/projects/b8bb154fc1d24b00af4e25ae8974e85d => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:07:13.346453 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a52fc2-f137-4219-a4e9-c6663fe5788e None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:13.441734 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a52fc2-f137-4219-a4e9-c6663fe5788e None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:13.474237 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d8e9a-a3f2-4ec5-b91b-019d8f9e1fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:13.474827 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d8e9a-a3f2-4ec5-b91b-019d8f9e1fbd None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:13.475106 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d8e9a-a3f2-4ec5-b91b-019d8f9e1fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:13.475461 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d8e9a-a3f2-4ec5-b91b-019d8f9e1fbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:13.476210 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d8e9a-a3f2-4ec5-b91b-019d8f9e1fbd None admin] RBAC: Adding query filter params (role.id=84da65a75e544d1191ec53cb6b05aa73, scope.project.id=b8bb154fc1d24b00af4e25ae8974e85d, user.id=135b93f074c845c8b5cb9412268d1230) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:07:13.476524 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d8e9a-a3f2-4ec5-b91b-019d8f9e1fbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:13.477926 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d8e9a-a3f2-4ec5-b91b-019d8f9e1fbd None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:13.483066 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 574/1146] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:07:13 2022] GET /identity/v3/role_assignments?user.id=135b93f074c845c8b5cb9412268d1230&scope.project.id=b8bb154fc1d24b00af4e25ae8974e85d&role.id=84da65a75e544d1191ec53cb6b05aa73 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:07:15.441868 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a37d8-1020-407a-a8ac-07b2665aa3c3 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:15.442489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a37d8-1020-407a-a8ac-07b2665aa3c3 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:15.442489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a37d8-1020-407a-a8ac-07b2665aa3c3 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:15.443843 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 573/1147] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:07:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:07:15.449001 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092bb87-ddc0-448b-97f5-bfcc4374b167 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:15.449380 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092bb87-ddc0-448b-97f5-bfcc4374b167 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:15.449558 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092bb87-ddc0-448b-97f5-bfcc4374b167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:15.468507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-d092bb87-ddc0-448b-97f5-bfcc4374b167 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:07:15.469680 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-d092bb87-ddc0-448b-97f5-bfcc4374b167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:07:15.485894 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:15.533995 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 575/1148] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:07:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:07:15.556206 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a37d8-1020-407a-a8ac-07b2665aa3c3 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:15.651977 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a37d8-1020-407a-a8ac-07b2665aa3c3 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:15.683980 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d01f1b-fe88-4950-ad41-c7ec217e8ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:15.684583 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d01f1b-fe88-4950-ad41-c7ec217e8ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:15.684861 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d01f1b-fe88-4950-ad41-c7ec217e8ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:15.685132 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d01f1b-fe88-4950-ad41-c7ec217e8ba2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:15.694598 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d01f1b-fe88-4950-ad41-c7ec217e8ba2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:07:15.699176 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-58d01f1b-fe88-4950-ad41-c7ec217e8ba2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:07:15.699176 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:07:15.699176 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:07:15.699176 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:07:15.699176 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:07:15.699176 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:07:15.699176 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:07:15.699176 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:07:15.699176 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:07:15.699176 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:07:15.699176 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:07:15.699176 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:07:15.699176 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:07:15.699176 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:07:15.699176 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:07:15.699176 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:07:15.700276 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:07:15.700276 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:07:15.700276 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:07:15.700276 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:07:15.700276 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:07:15.700276 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:07:15.700276 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:07:15.700276 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:07:15.700276 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:07:15.700276 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:07:15.700276 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:07:15.700276 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:07:15.700276 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:07:15.700276 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:07:15.700276 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:07:15.700276 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:07:15.701304 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:07:15.701304 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:07:15.701304 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:07:15.701304 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:07:15.701304 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:07:15.701304 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:07:15.701304 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:07:15.701304 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:07:15.701304 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:07:15.701304 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:07:15.701304 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:07:15.701304 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:07:15.701304 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 574/1149] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 02:07:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:07:15.706235 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092bb87-ddc0-448b-97f5-bfcc4374b167 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:15.799890 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092bb87-ddc0-448b-97f5-bfcc4374b167 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:15.833049 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a6fd3-0b68-4f13-a67f-a84ba041f332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:15.833638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a6fd3-0b68-4f13-a67f-a84ba041f332 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:15.833918 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a6fd3-0b68-4f13-a67f-a84ba041f332 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:15.834193 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a6fd3-0b68-4f13-a67f-a84ba041f332 None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:15.834849 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a6fd3-0b68-4f13-a67f-a84ba041f332 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:07:15.835151 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a6fd3-0b68-4f13-a67f-a84ba041f332 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:15.836534 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a6fd3-0b68-4f13-a67f-a84ba041f332 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:15.844306 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 576/1150] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:07:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:07:15.850015 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d01f1b-fe88-4950-ad41-c7ec217e8ba2 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:15.878620 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:15.947645 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d01f1b-fe88-4950-ad41-c7ec217e8ba2 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:15.980479 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3fb2c-6cd6-4d03-8ec7-84dacd1af5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:15.981088 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3fb2c-6cd6-4d03-8ec7-84dacd1af5f2 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:15.981372 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3fb2c-6cd6-4d03-8ec7-84dacd1af5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:15.981649 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3fb2c-6cd6-4d03-8ec7-84dacd1af5f2 None admin] PATH_INFO: `/v3/users/135b93f074c845c8b5cb9412268d1230` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:15.982756 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e3fb2c-6cd6-4d03-8ec7-84dacd1af5f2 None admin] RBAC: Authorizing `identity:get_user(user_id=135b93f074c845c8b5cb9412268d1230)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:15.984284 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e3fb2c-6cd6-4d03-8ec7-84dacd1af5f2 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:15.985880 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 575/1151] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:07:15 2022] GET /identity/v3/users/135b93f074c845c8b5cb9412268d1230 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:07:15.991532 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a6fd3-0b68-4f13-a67f-a84ba041f332 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:16.007619 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:16.086544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a6fd3-0b68-4f13-a67f-a84ba041f332 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:16.119312 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18660356-1aa6-4404-b710-b1431f89bde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:16.119949 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18660356-1aa6-4404-b710-b1431f89bde3 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:16.120231 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18660356-1aa6-4404-b710-b1431f89bde3 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:16.120526 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18660356-1aa6-4404-b710-b1431f89bde3 None admin] PATH_INFO: `/v3/projects/b8bb154fc1d24b00af4e25ae8974e85d` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:16.121611 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18660356-1aa6-4404-b710-b1431f89bde3 None admin] RBAC: Authorizing `identity:get_project(project_id=b8bb154fc1d24b00af4e25ae8974e85d)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:16.123027 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18660356-1aa6-4404-b710-b1431f89bde3 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:16.124649 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 577/1152] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:07:15 2022] GET /identity/v3/projects/b8bb154fc1d24b00af4e25ae8974e85d => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:07:16.130388 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3fb2c-6cd6-4d03-8ec7-84dacd1af5f2 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:16.221006 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:16.226932 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3fb2c-6cd6-4d03-8ec7-84dacd1af5f2 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:16.263025 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c14d55-a5b9-4c48-99c5-5026b2840d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:16.263692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c14d55-a5b9-4c48-99c5-5026b2840d73 None admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:16.263972 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c14d55-a5b9-4c48-99c5-5026b2840d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:16.264244 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c14d55-a5b9-4c48-99c5-5026b2840d73 None admin] PATH_INFO: `/v3/projects/b8bb154fc1d24b00af4e25ae8974e85d/users/135b93f074c845c8b5cb9412268d1230/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:16.266107 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c14d55-a5b9-4c48-99c5-5026b2840d73 None admin] RBAC: Authorizing `identity:create_grant(project_id=b8bb154fc1d24b00af4e25ae8974e85d, user_id=135b93f074c845c8b5cb9412268d1230, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:16.267548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c14d55-a5b9-4c48-99c5-5026b2840d73 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:16.334373 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 576/1153] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 02:07:16 2022] PUT /identity/v3/projects/b8bb154fc1d24b00af4e25ae8974e85d/users/135b93f074c845c8b5cb9412268d1230/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:07:18.294591 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95689e7b-b3c1-4a78-ad1c-a6062da4c8ac None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:18.295124 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95689e7b-b3c1-4a78-ad1c-a6062da4c8ac None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:18.295124 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95689e7b-b3c1-4a78-ad1c-a6062da4c8ac None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:18.296584 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 578/1154] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:07:18.301643 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54255f5f-7b94-4249-aad0-b3791a9d3bad None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:18.302075 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54255f5f-7b94-4249-aad0-b3791a9d3bad None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:18.302203 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54255f5f-7b94-4249-aad0-b3791a9d3bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:18.320621 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-54255f5f-7b94-4249-aad0-b3791a9d3bad None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:07:18.321807 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-54255f5f-7b94-4249-aad0-b3791a9d3bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:07:18.385646 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 577/1155] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:07:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:07:18.408799 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95689e7b-b3c1-4a78-ad1c-a6062da4c8ac None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:18.488498 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:18.506232 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95689e7b-b3c1-4a78-ad1c-a6062da4c8ac None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:18.539410 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ae841-a866-46c0-9a1b-ee6cc503db18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:18.540022 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ae841-a866-46c0-9a1b-ee6cc503db18 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:18.540304 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ae841-a866-46c0-9a1b-ee6cc503db18 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:18.540579 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ae841-a866-46c0-9a1b-ee6cc503db18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:18.550272 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ae841-a866-46c0-9a1b-ee6cc503db18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:07:18.554813 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-909ae841-a866-46c0-9a1b-ee6cc503db18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:07:18.554813 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:07:18.554813 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:07:18.554813 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:07:18.554813 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:07:18.554813 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:07:18.554813 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:07:18.554813 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:07:18.554813 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:07:18.554813 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:07:18.554813 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:07:18.554813 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:07:18.554813 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:07:18.554813 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:07:18.554813 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:07:18.554813 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:07:18.556025 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:07:18.556025 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:07:18.556025 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:07:18.556025 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:07:18.556025 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:07:18.556025 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:07:18.556025 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:07:18.556025 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:07:18.556025 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:07:18.556025 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:07:18.556025 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:07:18.556025 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:07:18.556025 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:07:18.556025 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:07:18.556025 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:07:18.556025 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:07:18.557195 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:07:18.557195 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:07:18.557195 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:07:18.557195 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:07:18.557195 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:07:18.557195 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:07:18.557195 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:07:18.557195 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:07:18.557195 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:07:18.557195 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:07:18.557195 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:07:18.557195 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:07:18.557195 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 579/1156] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 02:07:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:07:18.562132 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54255f5f-7b94-4249-aad0-b3791a9d3bad None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:18.642994 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:18.658129 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54255f5f-7b94-4249-aad0-b3791a9d3bad None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:18.692286 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638c5a0-da20-40f5-8ad3-ed482a121952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:18.692879 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638c5a0-da20-40f5-8ad3-ed482a121952 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:18.693164 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638c5a0-da20-40f5-8ad3-ed482a121952 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:18.693442 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638c5a0-da20-40f5-8ad3-ed482a121952 None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:18.694103 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5638c5a0-da20-40f5-8ad3-ed482a121952 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:07:18.694413 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5638c5a0-da20-40f5-8ad3-ed482a121952 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:18.695830 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5638c5a0-da20-40f5-8ad3-ed482a121952 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:18.703971 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 578/1157] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:07:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:07:18.709670 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ae841-a866-46c0-9a1b-ee6cc503db18 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:18.805451 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ae841-a866-46c0-9a1b-ee6cc503db18 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:18.840476 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b55a7a-9bae-4113-9114-1bace4e4bd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:18.841095 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b55a7a-9bae-4113-9114-1bace4e4bd94 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:18.841375 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b55a7a-9bae-4113-9114-1bace4e4bd94 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:18.841648 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b55a7a-9bae-4113-9114-1bace4e4bd94 None admin] PATH_INFO: `/v3/users/135b93f074c845c8b5cb9412268d1230` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:18.842757 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b55a7a-9bae-4113-9114-1bace4e4bd94 None admin] RBAC: Authorizing `identity:get_user(user_id=135b93f074c845c8b5cb9412268d1230)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:18.844199 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b55a7a-9bae-4113-9114-1bace4e4bd94 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:18.845764 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 580/1158] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:07:18 2022] GET /identity/v3/users/135b93f074c845c8b5cb9412268d1230 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:07:18.853555 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638c5a0-da20-40f5-8ad3-ed482a121952 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:18.949529 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638c5a0-da20-40f5-8ad3-ed482a121952 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:18.981054 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57a726-d770-4a61-ab3c-a488b751d2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:18.981664 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57a726-d770-4a61-ab3c-a488b751d2fd None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:18.981947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57a726-d770-4a61-ab3c-a488b751d2fd None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:18.982215 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57a726-d770-4a61-ab3c-a488b751d2fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:18.998418 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:19.045769 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57a726-d770-4a61-ab3c-a488b751d2fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:19.047192 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57a726-d770-4a61-ab3c-a488b751d2fd None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:19.141719 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 579/1159] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:07:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:07:19.149262 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b55a7a-9bae-4113-9114-1bace4e4bd94 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:19.160743 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:19.244337 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b55a7a-9bae-4113-9114-1bace4e4bd94 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:19.276288 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841780c-5b15-4585-a7d4-a2cc576d3472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:19.276892 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841780c-5b15-4585-a7d4-a2cc576d3472 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:19.277171 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841780c-5b15-4585-a7d4-a2cc576d3472 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:19.277443 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841780c-5b15-4585-a7d4-a2cc576d3472 None admin] PATH_INFO: `/v3/projects/b8bb154fc1d24b00af4e25ae8974e85d` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:19.278524 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7841780c-5b15-4585-a7d4-a2cc576d3472 None admin] RBAC: Authorizing `identity:get_project(project_id=b8bb154fc1d24b00af4e25ae8974e85d)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:19.279961 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7841780c-5b15-4585-a7d4-a2cc576d3472 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:19.281555 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 581/1160] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:07:19 2022] GET /identity/v3/projects/b8bb154fc1d24b00af4e25ae8974e85d => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:07:19.287631 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57a726-d770-4a61-ab3c-a488b751d2fd None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:19.335419 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:19.384866 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57a726-d770-4a61-ab3c-a488b751d2fd None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:19.417035 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5564c-f133-4677-9a43-345fb6ba2058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:19.417627 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5564c-f133-4677-9a43-345fb6ba2058 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:19.417906 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5564c-f133-4677-9a43-345fb6ba2058 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:19.418182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5564c-f133-4677-9a43-345fb6ba2058 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:19.418889 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5564c-f133-4677-9a43-345fb6ba2058 None admin] RBAC: Adding query filter params (role.id=84da65a75e544d1191ec53cb6b05aa73, scope.project.id=b8bb154fc1d24b00af4e25ae8974e85d, user.id=135b93f074c845c8b5cb9412268d1230) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:07:19.419194 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5564c-f133-4677-9a43-345fb6ba2058 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:19.420623 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5564c-f133-4677-9a43-345fb6ba2058 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:19.426274 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 580/1161] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:07:19 2022] GET /identity/v3/role_assignments?user.id=135b93f074c845c8b5cb9412268d1230&scope.project.id=b8bb154fc1d24b00af4e25ae8974e85d&role.id=84da65a75e544d1191ec53cb6b05aa73 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:07:21.420307 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6436e66-645c-4b8e-975d-c158f238df83 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:21.420766 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6436e66-645c-4b8e-975d-c158f238df83 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:21.420880 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6436e66-645c-4b8e-975d-c158f238df83 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:21.422205 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 582/1162] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:07:21.427319 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86c9c6-3ba2-4eb7-bbd9-0c94cd1cc7b6 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:21.427751 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86c9c6-3ba2-4eb7-bbd9-0c94cd1cc7b6 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:21.427898 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86c9c6-3ba2-4eb7-bbd9-0c94cd1cc7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:21.445974 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-bf86c9c6-3ba2-4eb7-bbd9-0c94cd1cc7b6 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:07:21.447135 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-bf86c9c6-3ba2-4eb7-bbd9-0c94cd1cc7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:07:21.510412 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 581/1163] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:07:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:07:21.532492 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6436e66-645c-4b8e-975d-c158f238df83 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:21.616244 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:21.637386 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6436e66-645c-4b8e-975d-c158f238df83 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:21.670974 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10649d-e4b8-4c3e-b8ff-9e5909eeabca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:21.671605 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10649d-e4b8-4c3e-b8ff-9e5909eeabca None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:21.671888 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10649d-e4b8-4c3e-b8ff-9e5909eeabca None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:21.672165 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10649d-e4b8-4c3e-b8ff-9e5909eeabca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:21.736145 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a10649d-e4b8-4c3e-b8ff-9e5909eeabca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:21.737574 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a10649d-e4b8-4c3e-b8ff-9e5909eeabca None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:21.810312 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:21.834210 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 583/1164] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:07:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:07:21.840375 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86c9c6-3ba2-4eb7-bbd9-0c94cd1cc7b6 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:21.880910 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:21.934543 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86c9c6-3ba2-4eb7-bbd9-0c94cd1cc7b6 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:21.965946 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8a775-1cf5-4424-80e9-b4c0ecb0359b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:21.966577 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8a775-1cf5-4424-80e9-b4c0ecb0359b None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:21.966854 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8a775-1cf5-4424-80e9-b4c0ecb0359b None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:21.967125 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8a775-1cf5-4424-80e9-b4c0ecb0359b None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:21.973512 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8a775-1cf5-4424-80e9-b4c0ecb0359b None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:21.975033 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8a775-1cf5-4424-80e9-b4c0ecb0359b None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:21.986247 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-a3b8a775-1cf5-4424-80e9-b4c0ecb0359b None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 08 02:07:21.986247 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:07:21.986247 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 08 02:07:21.986247 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 08 02:07:21.986247 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:07:21.986247 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:07:21.986247 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:07:21.986247 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:07:21.986247 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 08 02:07:21.986247 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:07:21.986247 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:07:21.986247 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:07:21.986247 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:07:21.986247 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:07:21.986247 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:07:21.986247 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:07:21.986247 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:07:21.987489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:07:21.987489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:07:21.987489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:07:21.987489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:07:21.987489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:07:21.987489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:07:21.987489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:07:21.987489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:07:21.987489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:07:21.987489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:07:21.987489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:07:21.987489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:07:21.987489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:07:21.987489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:07:21.987489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:07:21.987489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:07:21.988339 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:07:21.988339 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:07:21.988339 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:07:21.988339 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:07:21.988339 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:07:21.988339 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:07:21.988339 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:07:21.988339 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:07:21.988339 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:07:21.988339 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:07:21.988339 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 08 02:07:21.988339 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:07:21.988339 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 08 02:07:21.988339 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:07:21.988339 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 582/1165] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Aug 8 02:07:21 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:07:21.993952 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10649d-e4b8-4c3e-b8ff-9e5909eeabca None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:22.087295 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10649d-e4b8-4c3e-b8ff-9e5909eeabca None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:22.120418 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e3025-8022-4198-9417-a2652f6d92e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:22.121008 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e3025-8022-4198-9417-a2652f6d92e8 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:22.121293 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e3025-8022-4198-9417-a2652f6d92e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:22.121574 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e3025-8022-4198-9417-a2652f6d92e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:22.122210 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e3025-8022-4198-9417-a2652f6d92e8 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:07:22.122517 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e3025-8022-4198-9417-a2652f6d92e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:22.123909 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e3025-8022-4198-9417-a2652f6d92e8 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:22.130733 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 584/1166] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Aug 8 02:07:21 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:07:24.169745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601fa3e-d9ef-41f9-b098-c0e42e0bad75 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:24.170308 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601fa3e-d9ef-41f9-b098-c0e42e0bad75 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:24.170308 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601fa3e-d9ef-41f9-b098-c0e42e0bad75 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:24.171672 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 583/1167] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:07:24.176735 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90dfd3-55e1-4e26-8304-6da5c6367fa3 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:24.177155 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90dfd3-55e1-4e26-8304-6da5c6367fa3 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:24.177281 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90dfd3-55e1-4e26-8304-6da5c6367fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:24.195587 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-ab90dfd3-55e1-4e26-8304-6da5c6367fa3 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:07:24.196748 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-ab90dfd3-55e1-4e26-8304-6da5c6367fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:07:24.230101 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:24.261061 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 585/1168] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:07:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:07:24.289885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601fa3e-d9ef-41f9-b098-c0e42e0bad75 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:24.386944 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601fa3e-d9ef-41f9-b098-c0e42e0bad75 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:24.388480 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:24.419850 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f518e4-c0f1-4a51-917b-bba0b511cbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:24.420374 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f518e4-c0f1-4a51-917b-bba0b511cbaa None admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:24.420652 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f518e4-c0f1-4a51-917b-bba0b511cbaa None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:24.420923 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f518e4-c0f1-4a51-917b-bba0b511cbaa None admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:24.421564 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f518e4-c0f1-4a51-917b-bba0b511cbaa None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:24.422895 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f518e4-c0f1-4a51-917b-bba0b511cbaa None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:24.489642 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 584/1169] 10.222.0.23 () {60 vars in 1138 bytes} [Mon Aug 8 02:07:24 2022] POST /identity/v3/domains => generated 267 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:07:26.497659 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25763dcd-9a94-4a37-ba46-4ee9b44a0f74 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:26.498182 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25763dcd-9a94-4a37-ba46-4ee9b44a0f74 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:26.498268 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25763dcd-9a94-4a37-ba46-4ee9b44a0f74 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:26.499611 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 586/1170] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:07:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:07:26.505339 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532df74-32ee-4459-b333-9f4ddadc96e9 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:26.505812 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532df74-32ee-4459-b333-9f4ddadc96e9 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:26.505970 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532df74-32ee-4459-b333-9f4ddadc96e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:26.523678 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-5532df74-32ee-4459-b333-9f4ddadc96e9 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:07:26.524902 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-5532df74-32ee-4459-b333-9f4ddadc96e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:07:26.587528 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 585/1171] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:07:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:07:26.610370 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25763dcd-9a94-4a37-ba46-4ee9b44a0f74 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:26.707222 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25763dcd-9a94-4a37-ba46-4ee9b44a0f74 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:26.740671 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9cb87-a5da-47c5-b86d-24099eb73283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:26.741282 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9cb87-a5da-47c5-b86d-24099eb73283 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:26.741564 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9cb87-a5da-47c5-b86d-24099eb73283 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:26.741873 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9cb87-a5da-47c5-b86d-24099eb73283 None admin] PATH_INFO: `/v3/domains/198838dee98e4433990cafbe5b8d9d47` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:26.751851 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e9cb87-a5da-47c5-b86d-24099eb73283 None admin] RBAC: Authorizing `identity:get_domain(domain_id=198838dee98e4433990cafbe5b8d9d47)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:26.753286 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e9cb87-a5da-47c5-b86d-24099eb73283 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:26.754815 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 587/1172] 10.222.0.23 () {56 vars in 1183 bytes} [Mon Aug 8 02:07:26 2022] GET /identity/v3/domains/198838dee98e4433990cafbe5b8d9d47 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:07:26.760354 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5532df74-32ee-4459-b333-9f4ddadc96e9 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:26.846932 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:26.855619 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5532df74-32ee-4459-b333-9f4ddadc96e9 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:26.887451 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295817bf-f8a5-4763-b599-a7181d67d156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:26.888041 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295817bf-f8a5-4763-b599-a7181d67d156 None admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:26.888322 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295817bf-f8a5-4763-b599-a7181d67d156 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:26.888595 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295817bf-f8a5-4763-b599-a7181d67d156 None admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:26.889226 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295817bf-f8a5-4763-b599-a7181d67d156 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:26.890635 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295817bf-f8a5-4763-b599-a7181d67d156 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:26.952519 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 586/1173] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Aug 8 02:07:26 2022] POST /identity/v3/projects => generated 361 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:07:28.950235 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6d9c2-e9e4-44f6-9dd1-77f0a29fb917 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:28.950790 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6d9c2-e9e4-44f6-9dd1-77f0a29fb917 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:28.950790 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6d9c2-e9e4-44f6-9dd1-77f0a29fb917 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:28.952283 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 588/1174] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:07:28.957398 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ce60b-1e0a-4c75-84dd-38998a483641 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:28.957818 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ce60b-1e0a-4c75-84dd-38998a483641 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:28.957960 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ce60b-1e0a-4c75-84dd-38998a483641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:28.976128 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-a01ce60b-1e0a-4c75-84dd-38998a483641 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:07:28.977304 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-a01ce60b-1e0a-4c75-84dd-38998a483641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:07:29.041500 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 587/1175] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:07:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:07:29.066525 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6d9c2-e9e4-44f6-9dd1-77f0a29fb917 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:29.097314 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:29.164524 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6d9c2-e9e4-44f6-9dd1-77f0a29fb917 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:29.197628 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d0927-f0c9-4ba2-ad3d-47d87cfa72ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:29.198241 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d0927-f0c9-4ba2-ad3d-47d87cfa72ef None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:29.198521 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d0927-f0c9-4ba2-ad3d-47d87cfa72ef None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:29.198797 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d0927-f0c9-4ba2-ad3d-47d87cfa72ef None admin] PATH_INFO: `/v3/domains/198838dee98e4433990cafbe5b8d9d47` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:29.199926 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d0927-f0c9-4ba2-ad3d-47d87cfa72ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=198838dee98e4433990cafbe5b8d9d47)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:29.201405 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d0927-f0c9-4ba2-ad3d-47d87cfa72ef None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:29.202887 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 589/1176] 10.222.0.23 () {56 vars in 1183 bytes} [Mon Aug 8 02:07:29 2022] GET /identity/v3/domains/198838dee98e4433990cafbe5b8d9d47 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:07:29.208464 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ce60b-1e0a-4c75-84dd-38998a483641 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:29.279211 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:29.302638 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ce60b-1e0a-4c75-84dd-38998a483641 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:29.336029 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da5e13-b54c-44fb-915b-27f6feb91997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:29.336624 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da5e13-b54c-44fb-915b-27f6feb91997 None admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:29.336907 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da5e13-b54c-44fb-915b-27f6feb91997 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:29.337186 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da5e13-b54c-44fb-915b-27f6feb91997 None admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:29.337886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da5e13-b54c-44fb-915b-27f6feb91997 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:29.339835 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da5e13-b54c-44fb-915b-27f6feb91997 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:29.419302 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 588/1177] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 8 02:07:29 2022] POST /identity/v3/users => generated 311 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:07:31.440156 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f6501-f635-41d8-85c3-3855215b8440 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:31.440659 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f6501-f635-41d8-85c3-3855215b8440 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:31.440750 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f6501-f635-41d8-85c3-3855215b8440 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:31.442031 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 590/1178] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:07:31.447284 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4730be-dd30-4b00-82c2-f57b6c3e3cea None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:31.447738 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4730be-dd30-4b00-82c2-f57b6c3e3cea None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:31.447865 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4730be-dd30-4b00-82c2-f57b6c3e3cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:31.465823 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-0c4730be-dd30-4b00-82c2-f57b6c3e3cea None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:07:31.466997 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-0c4730be-dd30-4b00-82c2-f57b6c3e3cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:07:31.530663 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 589/1179] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:07:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:07:31.553195 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f6501-f635-41d8-85c3-3855215b8440 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:31.647790 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:31.651446 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f6501-f635-41d8-85c3-3855215b8440 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:31.684759 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c48e1-9ff1-4a48-89b0-7305267df32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:31.685359 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c48e1-9ff1-4a48-89b0-7305267df32c None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:31.685640 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c48e1-9ff1-4a48-89b0-7305267df32c None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:31.685911 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c48e1-9ff1-4a48-89b0-7305267df32c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:31.695748 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275c48e1-9ff1-4a48-89b0-7305267df32c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:07:31.700388 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-275c48e1-9ff1-4a48-89b0-7305267df32c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:07:31.700388 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:07:31.700388 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:07:31.700388 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:07:31.700388 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:07:31.700388 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:07:31.700388 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:07:31.700388 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:07:31.700388 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:07:31.700388 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:07:31.700388 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:07:31.700388 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:07:31.700388 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:07:31.700388 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:07:31.700388 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:07:31.700388 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:07:31.701458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:07:31.701458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:07:31.701458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:07:31.701458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:07:31.701458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:07:31.701458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:07:31.701458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:07:31.701458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:07:31.701458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:07:31.701458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:07:31.701458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:07:31.701458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:07:31.701458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:07:31.701458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:07:31.701458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:07:31.701458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:07:31.702615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:07:31.702615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:07:31.702615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:07:31.702615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:07:31.702615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:07:31.702615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:07:31.702615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:07:31.702615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:07:31.702615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:07:31.702615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:07:31.702615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:07:31.702615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:07:31.702615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 591/1180] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 02:07:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:07:31.707325 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4730be-dd30-4b00-82c2-f57b6c3e3cea None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:31.762769 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:31.800633 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4730be-dd30-4b00-82c2-f57b6c3e3cea None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:31.833034 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803a1af-aa2b-46ab-bb2a-9d5700bea790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:31.833619 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803a1af-aa2b-46ab-bb2a-9d5700bea790 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:31.833895 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803a1af-aa2b-46ab-bb2a-9d5700bea790 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:31.834166 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803a1af-aa2b-46ab-bb2a-9d5700bea790 None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:31.834811 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803a1af-aa2b-46ab-bb2a-9d5700bea790 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:07:31.835110 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803a1af-aa2b-46ab-bb2a-9d5700bea790 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:31.836511 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803a1af-aa2b-46ab-bb2a-9d5700bea790 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:31.844106 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 590/1181] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:07:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:07:31.849695 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c48e1-9ff1-4a48-89b0-7305267df32c None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:31.946047 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c48e1-9ff1-4a48-89b0-7305267df32c None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:31.978242 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49446544-cc3a-4fcd-be42-6eaab6793978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:31.978847 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49446544-cc3a-4fcd-be42-6eaab6793978 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:31.979125 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49446544-cc3a-4fcd-be42-6eaab6793978 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:31.979426 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49446544-cc3a-4fcd-be42-6eaab6793978 None admin] PATH_INFO: `/v3/users/48954147983a4f89b38cde5161ecd1d2` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:31.992432 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49446544-cc3a-4fcd-be42-6eaab6793978 None admin] RBAC: Authorizing `identity:get_user(user_id=48954147983a4f89b38cde5161ecd1d2)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:31.993858 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49446544-cc3a-4fcd-be42-6eaab6793978 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:31.995463 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 592/1182] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:07:31 2022] GET /identity/v3/users/48954147983a4f89b38cde5161ecd1d2 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:07:32.001157 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803a1af-aa2b-46ab-bb2a-9d5700bea790 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:32.097326 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803a1af-aa2b-46ab-bb2a-9d5700bea790 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:32.118541 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:32.129377 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959b881-4311-480a-ba4f-2449a0ceef08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:32.129966 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959b881-4311-480a-ba4f-2449a0ceef08 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:32.130240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959b881-4311-480a-ba4f-2449a0ceef08 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:32.130508 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959b881-4311-480a-ba4f-2449a0ceef08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:32.193606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2959b881-4311-480a-ba4f-2449a0ceef08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:32.195582 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2959b881-4311-480a-ba4f-2449a0ceef08 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:32.288051 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 591/1183] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:07:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:07:32.293942 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49446544-cc3a-4fcd-be42-6eaab6793978 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:32.313062 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:32.395269 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49446544-cc3a-4fcd-be42-6eaab6793978 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:32.428338 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70ceed-ab50-4978-a753-7b66b79bf3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:32.428950 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70ceed-ab50-4978-a753-7b66b79bf3cb None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:32.429845 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70ceed-ab50-4978-a753-7b66b79bf3cb None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:32.430120 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70ceed-ab50-4978-a753-7b66b79bf3cb None admin] PATH_INFO: `/v3/projects/e4e82e3afbd349728805d0164f15488c` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:32.431231 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e70ceed-ab50-4978-a753-7b66b79bf3cb None admin] RBAC: Authorizing `identity:get_project(project_id=e4e82e3afbd349728805d0164f15488c)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:32.432671 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e70ceed-ab50-4978-a753-7b66b79bf3cb None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:32.434543 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 593/1184] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:07:32 2022] GET /identity/v3/projects/e4e82e3afbd349728805d0164f15488c => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:07:32.440647 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959b881-4311-480a-ba4f-2449a0ceef08 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:32.463080 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:32.534438 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959b881-4311-480a-ba4f-2449a0ceef08 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:32.567670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60630701-2adc-42f1-bc33-0c01c720bd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:32.568206 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60630701-2adc-42f1-bc33-0c01c720bd58 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:32.568482 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60630701-2adc-42f1-bc33-0c01c720bd58 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:32.568752 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60630701-2adc-42f1-bc33-0c01c720bd58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:32.569463 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60630701-2adc-42f1-bc33-0c01c720bd58 None admin] RBAC: Adding query filter params (role.id=84da65a75e544d1191ec53cb6b05aa73, scope.project.id=e4e82e3afbd349728805d0164f15488c, user.id=48954147983a4f89b38cde5161ecd1d2) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:07:32.569798 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60630701-2adc-42f1-bc33-0c01c720bd58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:32.571205 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60630701-2adc-42f1-bc33-0c01c720bd58 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:32.576326 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 592/1185] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:07:32 2022] GET /identity/v3/role_assignments?user.id=48954147983a4f89b38cde5161ecd1d2&scope.project.id=e4e82e3afbd349728805d0164f15488c&role.id=84da65a75e544d1191ec53cb6b05aa73 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:07:34.520892 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11106eb5-77ca-4f65-a065-88c302739b86 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:34.521461 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11106eb5-77ca-4f65-a065-88c302739b86 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:34.521461 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11106eb5-77ca-4f65-a065-88c302739b86 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:34.522770 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 594/1186] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:07:34.528314 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb6f1f-1782-456b-b411-34d40bdd32e7 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:34.528712 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb6f1f-1782-456b-b411-34d40bdd32e7 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:34.528864 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb6f1f-1782-456b-b411-34d40bdd32e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:34.547133 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-cebb6f1f-1782-456b-b411-34d40bdd32e7 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:07:34.548334 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-cebb6f1f-1782-456b-b411-34d40bdd32e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:07:34.612117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 593/1187] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:07:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:07:34.635278 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11106eb5-77ca-4f65-a065-88c302739b86 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:34.717300 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:34.731692 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11106eb5-77ca-4f65-a065-88c302739b86 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:34.764618 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f36860-d475-47b1-8048-ed8b90ebb420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:34.765219 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f36860-d475-47b1-8048-ed8b90ebb420 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:34.765496 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f36860-d475-47b1-8048-ed8b90ebb420 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:34.765766 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f36860-d475-47b1-8048-ed8b90ebb420 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:34.775932 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f36860-d475-47b1-8048-ed8b90ebb420 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:07:34.780440 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-71f36860-d475-47b1-8048-ed8b90ebb420 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:07:34.780440 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:07:34.780440 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:07:34.780440 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:07:34.780440 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:07:34.780440 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:07:34.780440 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:07:34.780440 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:07:34.780440 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:07:34.780440 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:07:34.780440 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:07:34.780440 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:07:34.780440 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:07:34.780440 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:07:34.780440 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:07:34.780440 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:07:34.781605 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:07:34.781605 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:07:34.781605 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:07:34.781605 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:07:34.781605 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:07:34.781605 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:07:34.781605 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:07:34.781605 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:07:34.781605 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:07:34.781605 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:07:34.781605 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:07:34.781605 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:07:34.781605 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:07:34.781605 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:07:34.781605 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:07:34.781605 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:07:34.782860 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:07:34.782860 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:07:34.782860 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:07:34.782860 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:07:34.782860 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:07:34.782860 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:07:34.782860 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:07:34.782860 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:07:34.782860 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:07:34.782860 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:07:34.782860 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:07:34.782860 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:07:34.782860 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 595/1188] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 02:07:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:07:34.787439 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb6f1f-1782-456b-b411-34d40bdd32e7 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:34.804174 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:34.881565 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb6f1f-1782-456b-b411-34d40bdd32e7 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:34.914338 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19531fd-1990-4d4e-bf67-2a80fa48269b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:34.914930 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19531fd-1990-4d4e-bf67-2a80fa48269b None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:34.915210 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19531fd-1990-4d4e-bf67-2a80fa48269b None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:34.915584 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19531fd-1990-4d4e-bf67-2a80fa48269b None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:34.916237 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19531fd-1990-4d4e-bf67-2a80fa48269b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:07:34.916538 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19531fd-1990-4d4e-bf67-2a80fa48269b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:34.917885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19531fd-1990-4d4e-bf67-2a80fa48269b None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:34.925484 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 594/1189] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:07:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:07:34.931013 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f36860-d475-47b1-8048-ed8b90ebb420 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:35.028354 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f36860-d475-47b1-8048-ed8b90ebb420 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:35.060381 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58d94c-1c77-4181-83dc-b1e4048bde16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:35.060993 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58d94c-1c77-4181-83dc-b1e4048bde16 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:35.061273 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58d94c-1c77-4181-83dc-b1e4048bde16 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:35.061548 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58d94c-1c77-4181-83dc-b1e4048bde16 None admin] PATH_INFO: `/v3/users/48954147983a4f89b38cde5161ecd1d2` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:35.062651 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab58d94c-1c77-4181-83dc-b1e4048bde16 None admin] RBAC: Authorizing `identity:get_user(user_id=48954147983a4f89b38cde5161ecd1d2)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:35.064104 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab58d94c-1c77-4181-83dc-b1e4048bde16 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:35.065700 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 596/1190] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:07:34 2022] GET /identity/v3/users/48954147983a4f89b38cde5161ecd1d2 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:07:35.072207 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19531fd-1990-4d4e-bf67-2a80fa48269b None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:35.148520 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:35.168589 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19531fd-1990-4d4e-bf67-2a80fa48269b None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:35.200802 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe25d3-9a12-4433-89f4-b0d479a8f73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:35.201416 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe25d3-9a12-4433-89f4-b0d479a8f73d None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:35.201696 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe25d3-9a12-4433-89f4-b0d479a8f73d None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:35.201969 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe25d3-9a12-4433-89f4-b0d479a8f73d None admin] PATH_INFO: `/v3/projects/e4e82e3afbd349728805d0164f15488c` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:35.203063 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe25d3-9a12-4433-89f4-b0d479a8f73d None admin] RBAC: Authorizing `identity:get_project(project_id=e4e82e3afbd349728805d0164f15488c)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:35.204508 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe25d3-9a12-4433-89f4-b0d479a8f73d None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:35.206098 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 595/1191] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:07:35 2022] GET /identity/v3/projects/e4e82e3afbd349728805d0164f15488c => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:07:35.212701 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58d94c-1c77-4181-83dc-b1e4048bde16 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:35.228323 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:35.309517 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58d94c-1c77-4181-83dc-b1e4048bde16 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:35.342204 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433edaa-d1db-425c-a9f4-b2a91bece01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:35.342848 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433edaa-d1db-425c-a9f4-b2a91bece01c None admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:35.343134 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433edaa-d1db-425c-a9f4-b2a91bece01c None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:35.343443 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433edaa-d1db-425c-a9f4-b2a91bece01c None admin] PATH_INFO: `/v3/projects/e4e82e3afbd349728805d0164f15488c/users/48954147983a4f89b38cde5161ecd1d2/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:35.345319 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433edaa-d1db-425c-a9f4-b2a91bece01c None admin] RBAC: Authorizing `identity:create_grant(project_id=e4e82e3afbd349728805d0164f15488c, user_id=48954147983a4f89b38cde5161ecd1d2, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:35.346735 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433edaa-d1db-425c-a9f4-b2a91bece01c None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:35.409317 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 597/1192] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 02:07:35 2022] PUT /identity/v3/projects/e4e82e3afbd349728805d0164f15488c/users/48954147983a4f89b38cde5161ecd1d2/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:07:37.384225 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8b945-0b4e-485d-8a58-e035e4a9252a None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:37.384620 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8b945-0b4e-485d-8a58-e035e4a9252a None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:37.384952 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8b945-0b4e-485d-8a58-e035e4a9252a None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:37.386394 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 596/1193] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:07:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:07:37.391736 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b2c7a-55af-4936-b6f2-5886775d0412 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:37.392132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b2c7a-55af-4936-b6f2-5886775d0412 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:37.392282 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b2c7a-55af-4936-b6f2-5886775d0412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:37.409601 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-112b2c7a-55af-4936-b6f2-5886775d0412 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:07:37.410765 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-112b2c7a-55af-4936-b6f2-5886775d0412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:07:37.478152 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 598/1194] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:07:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 02:07:37.501336 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8b945-0b4e-485d-8a58-e035e4a9252a None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:37.598508 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8b945-0b4e-485d-8a58-e035e4a9252a None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:37.631274 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2debc377-c25d-48ee-97d9-8c6d3703b6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:37.631952 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debc377-c25d-48ee-97d9-8c6d3703b6e8 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:37.632206 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debc377-c25d-48ee-97d9-8c6d3703b6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:37.632479 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debc377-c25d-48ee-97d9-8c6d3703b6e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:37.642153 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2debc377-c25d-48ee-97d9-8c6d3703b6e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:07:37.646735 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-2debc377-c25d-48ee-97d9-8c6d3703b6e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:07:37.646735 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:07:37.646735 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:07:37.646735 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:07:37.646735 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:07:37.646735 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:07:37.646735 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:07:37.646735 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:07:37.646735 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:07:37.646735 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:07:37.646735 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:07:37.646735 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:07:37.646735 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:07:37.646735 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:07:37.646735 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:07:37.646735 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:07:37.647889 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:07:37.647889 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:07:37.647889 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:07:37.647889 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:07:37.647889 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:07:37.647889 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:07:37.647889 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:07:37.647889 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:07:37.647889 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:07:37.647889 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:07:37.647889 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:07:37.647889 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:07:37.647889 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:07:37.647889 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:07:37.647889 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:07:37.647889 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:07:37.648731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:07:37.648731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:07:37.648731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:07:37.648731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:07:37.648731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:07:37.648731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:07:37.648731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:07:37.648731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:07:37.648731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:07:37.648731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:07:37.648731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:07:37.648731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:07:37.648731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 597/1195] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 02:07:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:07:37.653783 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b2c7a-55af-4936-b6f2-5886775d0412 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:37.656850 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:37.748661 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b2c7a-55af-4936-b6f2-5886775d0412 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:37.780291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941eda1e-ffbe-4d06-92f7-b1bcffccebf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:37.780883 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941eda1e-ffbe-4d06-92f7-b1bcffccebf9 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:37.781162 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941eda1e-ffbe-4d06-92f7-b1bcffccebf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:37.781440 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941eda1e-ffbe-4d06-92f7-b1bcffccebf9 None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:37.782097 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941eda1e-ffbe-4d06-92f7-b1bcffccebf9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:07:37.782402 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941eda1e-ffbe-4d06-92f7-b1bcffccebf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:37.783783 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941eda1e-ffbe-4d06-92f7-b1bcffccebf9 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:37.791937 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 599/1196] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:07:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:07:37.797543 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2debc377-c25d-48ee-97d9-8c6d3703b6e8 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:37.807173 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:37.893812 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2debc377-c25d-48ee-97d9-8c6d3703b6e8 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:37.926318 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7d169-24f8-4e1f-81fd-50259e67a1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:37.926933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7d169-24f8-4e1f-81fd-50259e67a1bd None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:37.927216 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7d169-24f8-4e1f-81fd-50259e67a1bd None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:37.927523 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7d169-24f8-4e1f-81fd-50259e67a1bd None admin] PATH_INFO: `/v3/users/48954147983a4f89b38cde5161ecd1d2` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:37.928641 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7d169-24f8-4e1f-81fd-50259e67a1bd None admin] RBAC: Authorizing `identity:get_user(user_id=48954147983a4f89b38cde5161ecd1d2)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:37.930864 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7d169-24f8-4e1f-81fd-50259e67a1bd None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:37.932473 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 598/1197] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 02:07:37 2022] GET /identity/v3/users/48954147983a4f89b38cde5161ecd1d2 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:07:37.938314 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941eda1e-ffbe-4d06-92f7-b1bcffccebf9 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:38.001180 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:38.034085 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941eda1e-ffbe-4d06-92f7-b1bcffccebf9 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:38.065943 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dff83a-8c43-4110-92d0-712cf7ae4a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:38.066525 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dff83a-8c43-4110-92d0-712cf7ae4a71 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:38.066802 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dff83a-8c43-4110-92d0-712cf7ae4a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:38.067079 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dff83a-8c43-4110-92d0-712cf7ae4a71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:38.130461 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dff83a-8c43-4110-92d0-712cf7ae4a71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:38.131919 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dff83a-8c43-4110-92d0-712cf7ae4a71 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:38.191829 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:38.224631 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 600/1198] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:07:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:07:38.231129 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7d169-24f8-4e1f-81fd-50259e67a1bd None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:38.302177 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:38.328952 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7d169-24f8-4e1f-81fd-50259e67a1bd None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:38.362065 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90fe643-4e54-4e91-9547-598cb9c9e8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:38.362684 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90fe643-4e54-4e91-9547-598cb9c9e8ce None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:38.362964 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90fe643-4e54-4e91-9547-598cb9c9e8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:38.363241 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90fe643-4e54-4e91-9547-598cb9c9e8ce None admin] PATH_INFO: `/v3/projects/e4e82e3afbd349728805d0164f15488c` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:38.364376 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90fe643-4e54-4e91-9547-598cb9c9e8ce None admin] RBAC: Authorizing `identity:get_project(project_id=e4e82e3afbd349728805d0164f15488c)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:38.366135 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90fe643-4e54-4e91-9547-598cb9c9e8ce None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:38.367814 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 599/1199] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 02:07:38 2022] GET /identity/v3/projects/e4e82e3afbd349728805d0164f15488c => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:07:38.374054 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dff83a-8c43-4110-92d0-712cf7ae4a71 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:07:38.470491 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dff83a-8c43-4110-92d0-712cf7ae4a71 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:07:38.502466 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b3bd9-3486-4d28-b46c-d952b1515e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:07:38.503050 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b3bd9-3486-4d28-b46c-d952b1515e8d None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:07:38.503329 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b3bd9-3486-4d28-b46c-d952b1515e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:07:38.503631 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b3bd9-3486-4d28-b46c-d952b1515e8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:07:38.504334 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b3bd9-3486-4d28-b46c-d952b1515e8d None admin] RBAC: Adding query filter params (role.id=84da65a75e544d1191ec53cb6b05aa73, scope.project.id=e4e82e3afbd349728805d0164f15488c, user.id=48954147983a4f89b38cde5161ecd1d2) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:07:38.504638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b3bd9-3486-4d28-b46c-d952b1515e8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:07:38.506030 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b3bd9-3486-4d28-b46c-d952b1515e8d None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:07:38.512221 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 601/1200] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:07:38 2022] GET /identity/v3/role_assignments?user.id=48954147983a4f89b38cde5161ecd1d2&scope.project.id=e4e82e3afbd349728805d0164f15488c&role.id=84da65a75e544d1191ec53cb6b05aa73 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:07:48.357958 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=29 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:07:48.509712 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=85 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:08:53.235848 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec5b95-b43e-44b5-8715-a562e33145f2 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:53.236450 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec5b95-b43e-44b5-8715-a562e33145f2 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:53.236450 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec5b95-b43e-44b5-8715-a562e33145f2 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:53.237752 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 600/1201] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:08:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:08:53.243170 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e44bdd-1be6-401a-9e2a-faa6419f68e9 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:53.243627 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e44bdd-1be6-401a-9e2a-faa6419f68e9 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:53.243766 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e44bdd-1be6-401a-9e2a-faa6419f68e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:53.261815 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-37e44bdd-1be6-401a-9e2a-faa6419f68e9 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:08:53.263451 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-37e44bdd-1be6-401a-9e2a-faa6419f68e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:53.328317 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 602/1202] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:08:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:08:53.353280 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec5b95-b43e-44b5-8715-a562e33145f2 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:08:53.457344 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec5b95-b43e-44b5-8715-a562e33145f2 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:08:53.494677 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637e528-0855-45f8-a990-fa1e6b0054f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:08:53.501540 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637e528-0855-45f8-a990-fa1e6b0054f8 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:53.501829 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637e528-0855-45f8-a990-fa1e6b0054f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:53.502108 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637e528-0855-45f8-a990-fa1e6b0054f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:53.512614 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637e528-0855-45f8-a990-fa1e6b0054f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:08:53.514033 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637e528-0855-45f8-a990-fa1e6b0054f8 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:08:53.528732 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-c637e528-0855-45f8-a990-fa1e6b0054f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:08:53.528732 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:08:53.528732 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:08:53.528732 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:08:53.528732 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:08:53.528732 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:08:53.528732 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:08:53.528732 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:08:53.528732 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:08:53.528732 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:08:53.528732 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:08:53.528732 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:08:53.528732 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:08:53.528732 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:08:53.528732 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:08:53.528732 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:08:53.529954 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:08:53.529954 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:08:53.529954 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:08:53.529954 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:08:53.529954 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:08:53.529954 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:08:53.529954 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:08:53.529954 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:08:53.529954 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:08:53.529954 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:08:53.529954 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:08:53.529954 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:08:53.529954 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:08:53.529954 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:08:53.529954 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:08:53.529954 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:08:53.529954 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:08:53.530939 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:08:53.530939 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:08:53.530939 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:08:53.530939 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 601/1203] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:08:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:08:53.535962 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e44bdd-1be6-401a-9e2a-faa6419f68e9 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:08:53.631892 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e44bdd-1be6-401a-9e2a-faa6419f68e9 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:08:53.659471 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:08:53.665684 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd214461-f7b7-4ae6-9316-5c26091e4ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:08:53.676320 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd214461-f7b7-4ae6-9316-5c26091e4ba7 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:53.676320 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd214461-f7b7-4ae6-9316-5c26091e4ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:53.676320 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd214461-f7b7-4ae6-9316-5c26091e4ba7 None admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:53.676320 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd214461-f7b7-4ae6-9316-5c26091e4ba7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:08:53.676320 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd214461-f7b7-4ae6-9316-5c26091e4ba7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:08:53.676320 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd214461-f7b7-4ae6-9316-5c26091e4ba7 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:08:53.680084 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 603/1204] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:08:53.686054 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637e528-0855-45f8-a990-fa1e6b0054f8 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:08:53.739257 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:08:53.783815 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637e528-0855-45f8-a990-fa1e6b0054f8 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:08:53.815027 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcfdf0d-e2e7-4226-914b-b37293ae5e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:08:53.815639 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcfdf0d-e2e7-4226-914b-b37293ae5e4a None admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:53.815916 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcfdf0d-e2e7-4226-914b-b37293ae5e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:53.816182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcfdf0d-e2e7-4226-914b-b37293ae5e4a None admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:53.816813 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcfdf0d-e2e7-4226-914b-b37293ae5e4a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:08:53.818220 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcfdf0d-e2e7-4226-914b-b37293ae5e4a None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:08:53.973917 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 602/1205] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 8 02:08:53 2022] POST /identity/v3/users => generated 251 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:08:55.972130 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c6383-9c27-4e39-8e9c-d0b694849e80 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:55.972661 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c6383-9c27-4e39-8e9c-d0b694849e80 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:55.972782 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c6383-9c27-4e39-8e9c-d0b694849e80 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:55.974037 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 604/1206] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:08:55.979061 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac48bf-cc5f-457b-98dc-aeb02e842bdf None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:55.979548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac48bf-cc5f-457b-98dc-aeb02e842bdf None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:55.979651 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac48bf-cc5f-457b-98dc-aeb02e842bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:55.997694 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-94ac48bf-cc5f-457b-98dc-aeb02e842bdf None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:08:55.998913 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-94ac48bf-cc5f-457b-98dc-aeb02e842bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:08:56.065178 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 603/1207] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:08:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:08:56.088656 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c6383-9c27-4e39-8e9c-d0b694849e80 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:08:56.187824 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c6383-9c27-4e39-8e9c-d0b694849e80 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:08:56.220977 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3db38e-ea21-4b87-b88d-aa95b72349fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:08:56.221589 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3db38e-ea21-4b87-b88d-aa95b72349fc None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:56.221871 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3db38e-ea21-4b87-b88d-aa95b72349fc None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:56.222189 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3db38e-ea21-4b87-b88d-aa95b72349fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:56.231933 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3db38e-ea21-4b87-b88d-aa95b72349fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:08:56.236639 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-3a3db38e-ea21-4b87-b88d-aa95b72349fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:08:56.236639 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:08:56.236639 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:08:56.236639 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:08:56.236639 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:08:56.236639 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:08:56.236639 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:08:56.236639 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:08:56.236639 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:08:56.236639 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:08:56.236639 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:08:56.236639 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:08:56.236639 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:08:56.236639 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:08:56.236639 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:08:56.236639 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:08:56.237744 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:08:56.237744 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:08:56.237744 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:08:56.237744 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:08:56.237744 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:08:56.237744 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:08:56.237744 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:08:56.237744 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:08:56.237744 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:08:56.237744 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:08:56.237744 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:08:56.237744 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:08:56.237744 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:08:56.237744 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:08:56.237744 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:08:56.237744 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:08:56.238661 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:08:56.238661 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:08:56.238661 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:08:56.238661 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:08:56.238661 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:08:56.238661 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:08:56.238661 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:08:56.238661 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:08:56.238661 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:08:56.238661 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:08:56.238661 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:08:56.238661 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:08:56.238661 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 605/1208] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 02:08:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:08:56.243795 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac48bf-cc5f-457b-98dc-aeb02e842bdf None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:08:56.282892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:08:56.342823 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac48bf-cc5f-457b-98dc-aeb02e842bdf None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:08:56.375630 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93469837-2d76-4c40-b0ca-787d5422a015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:08:56.376247 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93469837-2d76-4c40-b0ca-787d5422a015 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:56.376524 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93469837-2d76-4c40-b0ca-787d5422a015 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:56.376822 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93469837-2d76-4c40-b0ca-787d5422a015 None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:56.377483 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93469837-2d76-4c40-b0ca-787d5422a015 None admin] RBAC: Adding query filter params (name=service) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:08:56.377787 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93469837-2d76-4c40-b0ca-787d5422a015 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:08:56.379151 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93469837-2d76-4c40-b0ca-787d5422a015 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:08:56.387734 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 604/1209] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 8 02:08:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:08:56.393453 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3db38e-ea21-4b87-b88d-aa95b72349fc None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:08:56.443052 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:08:56.489451 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3db38e-ea21-4b87-b88d-aa95b72349fc None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:08:56.522923 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890554df-62c8-4699-8080-9426ada45033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:08:56.523589 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890554df-62c8-4699-8080-9426ada45033 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:56.523867 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890554df-62c8-4699-8080-9426ada45033 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:56.524139 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890554df-62c8-4699-8080-9426ada45033 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:56.533964 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890554df-62c8-4699-8080-9426ada45033 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:08:56.535486 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890554df-62c8-4699-8080-9426ada45033 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:08:56.549434 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-890554df-62c8-4699-8080-9426ada45033 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:08:56.549434 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:08:56.549434 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:08:56.549434 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:08:56.549434 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:08:56.549434 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:08:56.549434 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:08:56.549434 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:08:56.549434 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:08:56.549434 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:08:56.549434 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:08:56.549434 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:08:56.549434 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:08:56.549434 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:08:56.549434 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:08:56.549434 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:08:56.550580 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:08:56.550580 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:08:56.550580 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:08:56.550580 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:08:56.550580 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:08:56.550580 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:08:56.550580 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:08:56.550580 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:08:56.550580 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:08:56.550580 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:08:56.550580 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:08:56.550580 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:08:56.550580 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:08:56.550580 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:08:56.550580 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:08:56.550580 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:08:56.550580 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:08:56.551700 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:08:56.551700 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:08:56.551700 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:08:56.551700 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 606/1210] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:08:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:08:56.556958 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93469837-2d76-4c40-b0ca-787d5422a015 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:08:56.652320 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:08:56.655250 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93469837-2d76-4c40-b0ca-787d5422a015 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:08:56.688717 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de04f6-3ec0-47c1-96a7-5b250d611052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:08:56.689321 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de04f6-3ec0-47c1-96a7-5b250d611052 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:56.689601 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de04f6-3ec0-47c1-96a7-5b250d611052 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:56.689930 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de04f6-3ec0-47c1-96a7-5b250d611052 None admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:56.690617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de04f6-3ec0-47c1-96a7-5b250d611052 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:08:56.691155 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de04f6-3ec0-47c1-96a7-5b250d611052 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:08:56.693082 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de04f6-3ec0-47c1-96a7-5b250d611052 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:08:56.704728 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 605/1211] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:08:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:08:56.710357 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890554df-62c8-4699-8080-9426ada45033 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:08:56.808316 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890554df-62c8-4699-8080-9426ada45033 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:08:56.810009 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:08:56.840796 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f8ee4-08b3-47d9-98be-aa970070f999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:08:56.841487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f8ee4-08b3-47d9-98be-aa970070f999 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:56.841763 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f8ee4-08b3-47d9-98be-aa970070f999 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:56.842034 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f8ee4-08b3-47d9-98be-aa970070f999 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:56.848655 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f8ee4-08b3-47d9-98be-aa970070f999 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:08:56.850567 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f8ee4-08b3-47d9-98be-aa970070f999 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:08:56.861508 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-dc7f8ee4-08b3-47d9-98be-aa970070f999 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 08 02:08:56.861508 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:08:56.861508 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:08:56.861508 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:08:56.861508 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:08:56.861508 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:08:56.861508 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:08:56.861508 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:08:56.861508 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:08:56.861508 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:08:56.861508 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:08:56.861508 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:08:56.861508 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:08:56.861508 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:08:56.861508 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:08:56.861508 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:08:56.867079 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:08:56.867079 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:08:56.867079 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:08:56.867079 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:08:56.867079 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:08:56.867079 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:08:56.867079 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:08:56.867079 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:08:56.867079 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:08:56.867079 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:08:56.867079 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:08:56.867079 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:08:56.867079 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:08:56.867079 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:08:56.867079 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:08:56.867079 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:08:56.867079 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:08:56.867079 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:08:56.868340 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:08:56.868340 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:08:56.868340 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:08:56.868340 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:08:56.868340 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:08:56.868340 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:08:56.868340 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:08:56.868340 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:08:56.868340 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 08 02:08:56.868340 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:08:56.868340 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 607/1212] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:08:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:08:56.869313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de04f6-3ec0-47c1-96a7-5b250d611052 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:08:56.966397 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de04f6-3ec0-47c1-96a7-5b250d611052 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:08:56.999538 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f14f77-ea48-43eb-929c-56e87678477b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:08:57.000125 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f14f77-ea48-43eb-929c-56e87678477b None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:57.000404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f14f77-ea48-43eb-929c-56e87678477b None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:57.000678 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f14f77-ea48-43eb-929c-56e87678477b None admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:57.001391 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f14f77-ea48-43eb-929c-56e87678477b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:08:57.001706 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f14f77-ea48-43eb-929c-56e87678477b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:08:57.003118 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f14f77-ea48-43eb-929c-56e87678477b None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:08:57.027202 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 606/1213] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Aug 8 02:08:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:08:57.033341 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f8ee4-08b3-47d9-98be-aa970070f999 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:08:57.133010 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f8ee4-08b3-47d9-98be-aa970070f999 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:08:57.166184 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa6c36a-230f-41f6-b5d7-1ba30bc76af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:08:57.166792 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6c36a-230f-41f6-b5d7-1ba30bc76af0 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:57.167075 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6c36a-230f-41f6-b5d7-1ba30bc76af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:57.167375 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6c36a-230f-41f6-b5d7-1ba30bc76af0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:57.196515 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:08:57.234729 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa6c36a-230f-41f6-b5d7-1ba30bc76af0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:08:57.236199 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa6c36a-230f-41f6-b5d7-1ba30bc76af0 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:08:57.331312 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 608/1214] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:08:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:08:57.337652 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f14f77-ea48-43eb-929c-56e87678477b None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:08:57.356866 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:08:57.434862 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f14f77-ea48-43eb-929c-56e87678477b None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:08:57.468149 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed152549-c120-484b-959e-1c578dc31f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:08:57.468765 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed152549-c120-484b-959e-1c578dc31f6e None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:57.472830 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed152549-c120-484b-959e-1c578dc31f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:57.472830 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed152549-c120-484b-959e-1c578dc31f6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:57.479712 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed152549-c120-484b-959e-1c578dc31f6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:08:57.481134 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed152549-c120-484b-959e-1c578dc31f6e None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:08:57.494995 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-ed152549-c120-484b-959e-1c578dc31f6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:08:57.494995 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:08:57.494995 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:08:57.494995 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:08:57.494995 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:08:57.494995 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:08:57.494995 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:08:57.494995 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:08:57.494995 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:08:57.494995 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:08:57.494995 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:08:57.494995 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:08:57.494995 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:08:57.494995 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:08:57.494995 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:08:57.494995 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:08:57.496124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:08:57.496124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:08:57.496124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:08:57.496124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:08:57.496124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:08:57.496124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:08:57.496124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:08:57.496124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:08:57.496124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:08:57.496124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:08:57.496124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:08:57.496124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:08:57.496124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:08:57.496124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:08:57.496124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:08:57.496124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:08:57.496124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:08:57.497007 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:08:57.497007 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:08:57.497007 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:08:57.497007 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 607/1215] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:08:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:08:57.501946 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa6c36a-230f-41f6-b5d7-1ba30bc76af0 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:08:57.561377 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:08:57.598438 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa6c36a-230f-41f6-b5d7-1ba30bc76af0 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:08:57.629898 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e7999-3b66-43cc-b882-60576b04dfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:08:57.630492 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e7999-3b66-43cc-b882-60576b04dfc2 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:57.630776 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e7999-3b66-43cc-b882-60576b04dfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:57.631591 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e7999-3b66-43cc-b882-60576b04dfc2 None admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:57.632230 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e7999-3b66-43cc-b882-60576b04dfc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:08:57.632535 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e7999-3b66-43cc-b882-60576b04dfc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:08:57.633904 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e7999-3b66-43cc-b882-60576b04dfc2 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:08:57.648644 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 609/1216] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:08:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:08:57.656530 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed152549-c120-484b-959e-1c578dc31f6e None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:08:57.725811 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:08:57.757140 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed152549-c120-484b-959e-1c578dc31f6e None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:08:57.788873 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28249e65-4bda-4f91-803f-a7e12945f935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:08:57.789486 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28249e65-4bda-4f91-803f-a7e12945f935 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:57.789764 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28249e65-4bda-4f91-803f-a7e12945f935 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:57.790031 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28249e65-4bda-4f91-803f-a7e12945f935 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:57.796460 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28249e65-4bda-4f91-803f-a7e12945f935 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:08:57.814133 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28249e65-4bda-4f91-803f-a7e12945f935 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:08:57.814133 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-28249e65-4bda-4f91-803f-a7e12945f935 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:08:57.814133 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:08:57.814133 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:08:57.814133 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:08:57.814133 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:08:57.814133 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:08:57.814133 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:08:57.814133 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:08:57.814133 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:08:57.814133 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:08:57.814133 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:08:57.814133 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:08:57.814133 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:08:57.815043 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:08:57.815043 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:08:57.815043 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:08:57.815043 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:08:57.815043 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:08:57.815043 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:08:57.815043 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:08:57.815043 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:08:57.815043 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:08:57.815043 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:08:57.815043 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:08:57.815043 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:08:57.815043 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:08:57.815043 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:08:57.815043 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:08:57.815043 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:08:57.815043 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:08:57.816071 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:08:57.816071 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:08:57.816071 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:08:57.816071 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:08:57.816071 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:08:57.816071 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:08:57.816071 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:08:57.816071 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:08:57.816071 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:08:57.816071 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:08:57.816071 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 608/1217] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:08:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:08:57.816686 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e7999-3b66-43cc-b882-60576b04dfc2 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:08:57.915020 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e7999-3b66-43cc-b882-60576b04dfc2 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:08:57.937122 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:08:57.948629 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe59a7f-f4e6-4500-8a48-c35a571e6a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:08:57.949226 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe59a7f-f4e6-4500-8a48-c35a571e6a5d None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:57.949505 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe59a7f-f4e6-4500-8a48-c35a571e6a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:57.949862 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe59a7f-f4e6-4500-8a48-c35a571e6a5d None admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:57.950549 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe59a7f-f4e6-4500-8a48-c35a571e6a5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:08:57.950851 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe59a7f-f4e6-4500-8a48-c35a571e6a5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:08:57.952295 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe59a7f-f4e6-4500-8a48-c35a571e6a5d None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:08:57.963979 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 610/1218] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 02:08:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:08:57.970217 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28249e65-4bda-4f91-803f-a7e12945f935 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:08:58.081446 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28249e65-4bda-4f91-803f-a7e12945f935 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:08:58.109216 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:08:58.114837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd27ea-de27-4ddc-a2e3-b303861b93ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:08:58.115513 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd27ea-de27-4ddc-a2e3-b303861b93ee None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:08:58.115795 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd27ea-de27-4ddc-a2e3-b303861b93ee None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:08:58.116064 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd27ea-de27-4ddc-a2e3-b303861b93ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:08:58.116774 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd27ea-de27-4ddc-a2e3-b303861b93ee None admin] RBAC: Adding query filter params (role.id=071080f2ecc948319b313f2379ea2b97, scope.project.id=ebe178f5bce64a009bf690031676c89f, user.id=43a39dd539974180a8165e34de57b552) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:08:58.117082 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd27ea-de27-4ddc-a2e3-b303861b93ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:08:58.118486 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd27ea-de27-4ddc-a2e3-b303861b93ee None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:08:58.123855 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 609/1219] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:08:57 2022] GET /identity/v3/role_assignments?user.id=43a39dd539974180a8165e34de57b552&scope.project.id=ebe178f5bce64a009bf690031676c89f&role.id=071080f2ecc948319b313f2379ea2b97 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:09:00.105019 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f120b6-2609-4f4c-9935-a7425b7cff2d None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:00.105572 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f120b6-2609-4f4c-9935-a7425b7cff2d None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:00.105674 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f120b6-2609-4f4c-9935-a7425b7cff2d None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:00.106951 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 611/1220] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:09:00.112150 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abc892-3421-4632-b088-6e2d7bff47a8 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:00.112562 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abc892-3421-4632-b088-6e2d7bff47a8 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:00.112705 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abc892-3421-4632-b088-6e2d7bff47a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:00.130652 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-52abc892-3421-4632-b088-6e2d7bff47a8 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:09:00.132441 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-52abc892-3421-4632-b088-6e2d7bff47a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:00.197771 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 610/1221] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:09:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:09:00.220047 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f120b6-2609-4f4c-9935-a7425b7cff2d None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:00.318109 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f120b6-2609-4f4c-9935-a7425b7cff2d None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:00.351067 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827cb08-f1dd-4fd5-8970-da795b110123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:00.351737 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827cb08-f1dd-4fd5-8970-da795b110123 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:00.352019 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827cb08-f1dd-4fd5-8970-da795b110123 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:00.352292 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827cb08-f1dd-4fd5-8970-da795b110123 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:00.362073 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827cb08-f1dd-4fd5-8970-da795b110123 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:09:00.367111 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-b827cb08-f1dd-4fd5-8970-da795b110123 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:09:00.367111 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:09:00.367111 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:09:00.367111 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:09:00.367111 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:09:00.367111 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:09:00.367111 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:09:00.367111 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:09:00.367111 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:09:00.367111 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:09:00.367111 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:09:00.367111 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:09:00.367111 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:09:00.367111 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:09:00.367111 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:09:00.367111 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:09:00.368217 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:09:00.368217 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:09:00.368217 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:09:00.368217 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:09:00.368217 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:09:00.368217 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:09:00.368217 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:09:00.368217 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:09:00.368217 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:09:00.368217 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:09:00.368217 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:09:00.368217 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:09:00.368217 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:09:00.368217 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:09:00.368217 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:09:00.368217 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:09:00.369215 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:09:00.369215 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:09:00.369215 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:09:00.369215 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:09:00.369215 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:09:00.369215 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:09:00.369215 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:09:00.369215 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:09:00.369215 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:09:00.369215 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:09:00.369215 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:09:00.369215 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:09:00.369215 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 612/1222] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 02:09:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:09:00.374456 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abc892-3421-4632-b088-6e2d7bff47a8 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:00.473589 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abc892-3421-4632-b088-6e2d7bff47a8 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:00.497492 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:00.507677 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05925e-ccb9-433d-8164-18ace3c79ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:00.508275 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05925e-ccb9-433d-8164-18ace3c79ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:00.508558 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05925e-ccb9-433d-8164-18ace3c79ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:00.508832 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05925e-ccb9-433d-8164-18ace3c79ec1 None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:00.509489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd05925e-ccb9-433d-8164-18ace3c79ec1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:09:00.509796 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd05925e-ccb9-433d-8164-18ace3c79ec1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:00.511163 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd05925e-ccb9-433d-8164-18ace3c79ec1 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:00.518753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 611/1223] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 8 02:09:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:09:00.524760 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827cb08-f1dd-4fd5-8970-da795b110123 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:00.568301 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:00.622297 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827cb08-f1dd-4fd5-8970-da795b110123 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:00.654179 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645e1b9-1d54-4302-a577-d6fb42081bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:00.654791 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645e1b9-1d54-4302-a577-d6fb42081bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:00.655104 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645e1b9-1d54-4302-a577-d6fb42081bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:00.655415 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645e1b9-1d54-4302-a577-d6fb42081bd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:00.665487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645e1b9-1d54-4302-a577-d6fb42081bd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:00.666969 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645e1b9-1d54-4302-a577-d6fb42081bd6 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:00.682112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-b645e1b9-1d54-4302-a577-d6fb42081bd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:09:00.682112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:09:00.682112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:09:00.682112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:09:00.682112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:09:00.682112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:09:00.682112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:09:00.682112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:09:00.682112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:09:00.682112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:09:00.682112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:09:00.682112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:09:00.682112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:09:00.682112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:09:00.682112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:09:00.682112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:09:00.683077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:09:00.683077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:09:00.683077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:09:00.683077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:09:00.683077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:09:00.683077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:09:00.683077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:09:00.683077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:09:00.683077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:09:00.683077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:09:00.683077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:09:00.683077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:09:00.683077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:09:00.683077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:09:00.683077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:09:00.683077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:09:00.683077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:09:00.684565 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:09:00.684565 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:09:00.684565 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:09:00.684565 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 613/1224] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:09:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 02:09:00.689182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05925e-ccb9-433d-8164-18ace3c79ec1 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:00.788492 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05925e-ccb9-433d-8164-18ace3c79ec1 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:00.821452 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6385e1-0162-4002-aa46-dd3b78d36d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:00.822044 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6385e1-0162-4002-aa46-dd3b78d36d43 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:00.822320 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6385e1-0162-4002-aa46-dd3b78d36d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:00.822591 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6385e1-0162-4002-aa46-dd3b78d36d43 None admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:00.823214 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6385e1-0162-4002-aa46-dd3b78d36d43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:09:00.823545 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6385e1-0162-4002-aa46-dd3b78d36d43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:00.824890 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6385e1-0162-4002-aa46-dd3b78d36d43 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:00.836106 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 612/1225] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:09:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:09:00.841869 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645e1b9-1d54-4302-a577-d6fb42081bd6 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:00.933205 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:00.939789 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645e1b9-1d54-4302-a577-d6fb42081bd6 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:00.971924 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196bc55-eb04-4e15-8f51-b54cb6ec63b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:00.972548 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196bc55-eb04-4e15-8f51-b54cb6ec63b1 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:00.975753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196bc55-eb04-4e15-8f51-b54cb6ec63b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:00.975753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196bc55-eb04-4e15-8f51-b54cb6ec63b1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:00.980360 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196bc55-eb04-4e15-8f51-b54cb6ec63b1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:00.981779 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196bc55-eb04-4e15-8f51-b54cb6ec63b1 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:00.992723 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-0196bc55-eb04-4e15-8f51-b54cb6ec63b1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 08 02:09:00.992723 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:09:00.992723 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:09:00.992723 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:09:00.992723 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:09:00.992723 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:09:00.992723 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:09:00.992723 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:09:00.992723 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:09:00.992723 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:09:00.992723 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:09:00.992723 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:09:00.992723 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:09:00.992723 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:09:00.992723 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:09:00.992723 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:09:00.993841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:09:00.993841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:09:00.993841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:09:00.993841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:09:00.993841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:09:00.993841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:09:00.993841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:09:00.993841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:09:00.993841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:09:00.993841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:09:00.993841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:09:00.993841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:09:00.993841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:09:00.993841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:09:00.993841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:09:00.993841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:09:00.993841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:09:00.993841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:09:00.994988 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:09:00.994988 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:09:00.994988 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:09:00.994988 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:09:00.994988 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:09:00.994988 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:09:00.994988 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:09:00.994988 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:09:00.994988 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 08 02:09:00.994988 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:09:00.994988 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 614/1226] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:09:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:09:00.999843 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6385e1-0162-4002-aa46-dd3b78d36d43 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:01.045732 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:01.097595 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6385e1-0162-4002-aa46-dd3b78d36d43 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:01.130732 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618805b1-679d-4584-89ac-1e7043211c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:01.131493 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618805b1-679d-4584-89ac-1e7043211c9b None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:01.131677 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618805b1-679d-4584-89ac-1e7043211c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:01.131921 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618805b1-679d-4584-89ac-1e7043211c9b None admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:01.132641 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618805b1-679d-4584-89ac-1e7043211c9b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:09:01.132944 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618805b1-679d-4584-89ac-1e7043211c9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:01.134345 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618805b1-679d-4584-89ac-1e7043211c9b None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:01.151149 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 613/1227] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Aug 8 02:09:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:09:01.156852 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196bc55-eb04-4e15-8f51-b54cb6ec63b1 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:01.253607 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196bc55-eb04-4e15-8f51-b54cb6ec63b1 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:01.287067 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e14b08-f7d5-4af6-9990-38110d4f19fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:01.289529 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e14b08-f7d5-4af6-9990-38110d4f19fa None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:01.289529 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e14b08-f7d5-4af6-9990-38110d4f19fa None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:01.289529 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e14b08-f7d5-4af6-9990-38110d4f19fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:01.298517 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e14b08-f7d5-4af6-9990-38110d4f19fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:01.299982 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e14b08-f7d5-4af6-9990-38110d4f19fa None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:01.313658 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-70e14b08-f7d5-4af6-9990-38110d4f19fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:09:01.313658 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:09:01.313658 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:09:01.313658 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:09:01.313658 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:09:01.313658 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:09:01.313658 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:09:01.313658 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:09:01.313658 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:09:01.313658 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:09:01.313658 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:09:01.313658 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:09:01.313658 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:09:01.313658 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:09:01.313658 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:09:01.313658 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:09:01.319691 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:09:01.319691 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:09:01.319691 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:09:01.319691 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:09:01.319691 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:09:01.319691 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:09:01.319691 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:09:01.319691 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:09:01.319691 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:09:01.319691 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:09:01.319691 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:09:01.319691 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:09:01.319691 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:09:01.319691 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:09:01.319691 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:09:01.319691 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:09:01.319691 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:09:01.320609 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:09:01.320609 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:09:01.320609 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:09:01.320609 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 615/1228] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:09:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:09:01.321084 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618805b1-679d-4584-89ac-1e7043211c9b None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:01.417884 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618805b1-679d-4584-89ac-1e7043211c9b None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:01.420233 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:01.451226 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0616e7-e2fa-4f22-bd8d-6b7e2c950a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:01.451847 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0616e7-e2fa-4f22-bd8d-6b7e2c950a8a None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:01.452126 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0616e7-e2fa-4f22-bd8d-6b7e2c950a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:01.452396 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0616e7-e2fa-4f22-bd8d-6b7e2c950a8a None admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:01.453019 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0616e7-e2fa-4f22-bd8d-6b7e2c950a8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:09:01.453320 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0616e7-e2fa-4f22-bd8d-6b7e2c950a8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:01.454672 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0616e7-e2fa-4f22-bd8d-6b7e2c950a8a None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:01.466186 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 614/1229] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:09:01.472193 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e14b08-f7d5-4af6-9990-38110d4f19fa None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:01.481365 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:01.567818 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e14b08-f7d5-4af6-9990-38110d4f19fa None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:01.600351 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d706a9-5ff0-4c13-867a-24bde38cb756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:01.600955 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d706a9-5ff0-4c13-867a-24bde38cb756 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:01.601237 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d706a9-5ff0-4c13-867a-24bde38cb756 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:01.601512 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d706a9-5ff0-4c13-867a-24bde38cb756 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:01.607861 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d706a9-5ff0-4c13-867a-24bde38cb756 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:01.609272 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d706a9-5ff0-4c13-867a-24bde38cb756 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:01.620747 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-86d706a9-5ff0-4c13-867a-24bde38cb756 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:09:01.620747 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:09:01.620747 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:09:01.620747 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:09:01.620747 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:09:01.620747 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:09:01.620747 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:09:01.620747 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:09:01.620747 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:09:01.620747 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:09:01.620747 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:09:01.620747 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:09:01.620747 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:09:01.620747 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:09:01.620747 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:09:01.621796 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:09:01.621796 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:09:01.621796 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:09:01.621796 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:09:01.621796 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:09:01.621796 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:09:01.621796 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:09:01.621796 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:09:01.621796 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:09:01.621796 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:09:01.621796 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:09:01.621796 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:09:01.621796 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:09:01.621796 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:09:01.621796 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:09:01.621796 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:09:01.621796 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:09:01.622882 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:09:01.622882 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:09:01.622882 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:09:01.622882 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:09:01.622882 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:09:01.622882 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:09:01.622882 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:09:01.622882 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:09:01.622882 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 616/1230] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:09:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:09:01.634645 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0616e7-e2fa-4f22-bd8d-6b7e2c950a8a None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:01.726051 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0616e7-e2fa-4f22-bd8d-6b7e2c950a8a None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:01.758597 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bb560-1006-4e42-9cea-7e2093a1fe60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:01.760428 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bb560-1006-4e42-9cea-7e2093a1fe60 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:01.760428 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bb560-1006-4e42-9cea-7e2093a1fe60 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:01.760428 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bb560-1006-4e42-9cea-7e2093a1fe60 None admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:01.760428 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8bb560-1006-4e42-9cea-7e2093a1fe60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:09:01.760824 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8bb560-1006-4e42-9cea-7e2093a1fe60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:01.762086 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8bb560-1006-4e42-9cea-7e2093a1fe60 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:01.774366 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 615/1231] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 02:09:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:09:01.780330 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d706a9-5ff0-4c13-867a-24bde38cb756 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:01.849600 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:01.884659 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d706a9-5ff0-4c13-867a-24bde38cb756 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:01.916085 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97608668-0bef-49b3-96f1-1543e4668428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:01.916724 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97608668-0bef-49b3-96f1-1543e4668428 None admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:01.917002 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97608668-0bef-49b3-96f1-1543e4668428 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:01.917271 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97608668-0bef-49b3-96f1-1543e4668428 None admin] PATH_INFO: `/v3/projects/ebe178f5bce64a009bf690031676c89f/users/43a39dd539974180a8165e34de57b552/roles/071080f2ecc948319b313f2379ea2b97` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:01.932242 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97608668-0bef-49b3-96f1-1543e4668428 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebe178f5bce64a009bf690031676c89f, user_id=43a39dd539974180a8165e34de57b552, role_id=071080f2ecc948319b313f2379ea2b97)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:01.933931 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97608668-0bef-49b3-96f1-1543e4668428 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:02.039488 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 617/1232] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 02:09:01 2022] PUT /identity/v3/projects/ebe178f5bce64a009bf690031676c89f/users/43a39dd539974180a8165e34de57b552/roles/071080f2ecc948319b313f2379ea2b97 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:09:03.996876 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab665b-c992-4b01-9e62-845984416d6c None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:03.997438 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab665b-c992-4b01-9e62-845984416d6c None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:03.997438 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab665b-c992-4b01-9e62-845984416d6c None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:03.998741 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 616/1233] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:09:04.003960 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c90859-257d-4cbb-aff5-1ac3f4cc92fb None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:04.004362 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c90859-257d-4cbb-aff5-1ac3f4cc92fb None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:04.004512 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c90859-257d-4cbb-aff5-1ac3f4cc92fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:04.022443 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-54c90859-257d-4cbb-aff5-1ac3f4cc92fb None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:09:04.023634 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-54c90859-257d-4cbb-aff5-1ac3f4cc92fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:04.088645 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 618/1234] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:09:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:09:04.112345 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab665b-c992-4b01-9e62-845984416d6c None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:04.137245 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:04.210111 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab665b-c992-4b01-9e62-845984416d6c None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:04.243098 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c814f-1fd0-44e0-b1a5-8989796267b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:04.243736 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c814f-1fd0-44e0-b1a5-8989796267b8 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:04.244016 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c814f-1fd0-44e0-b1a5-8989796267b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:04.244312 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c814f-1fd0-44e0-b1a5-8989796267b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:04.253964 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c814f-1fd0-44e0-b1a5-8989796267b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:09:04.259041 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-5a6c814f-1fd0-44e0-b1a5-8989796267b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:09:04.259041 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:09:04.259041 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:09:04.259041 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:09:04.259041 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:09:04.259041 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:09:04.259041 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:09:04.259041 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:09:04.259041 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:09:04.259041 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:09:04.259041 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:09:04.259041 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:09:04.259041 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:09:04.259041 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:09:04.259041 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:09:04.259041 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:09:04.260187 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:09:04.260187 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:09:04.260187 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:09:04.260187 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:09:04.260187 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:09:04.260187 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:09:04.260187 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:09:04.260187 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:09:04.260187 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:09:04.260187 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:09:04.260187 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:09:04.260187 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:09:04.260187 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:09:04.260187 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:09:04.260187 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:09:04.260187 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:09:04.261450 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:09:04.261450 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:09:04.261450 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:09:04.261450 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:09:04.261450 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:09:04.261450 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:09:04.261450 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:09:04.261450 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:09:04.261450 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:09:04.261450 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:09:04.261450 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 02:09:04.261450 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:09:04.261450 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 617/1235] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 02:09:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:09:04.266108 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c90859-257d-4cbb-aff5-1ac3f4cc92fb None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:04.311181 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:04.360992 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c90859-257d-4cbb-aff5-1ac3f4cc92fb None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:04.393741 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d691996b-434a-42ec-be82-3185c2b1d5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:04.394339 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691996b-434a-42ec-be82-3185c2b1d5aa None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:04.394618 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691996b-434a-42ec-be82-3185c2b1d5aa None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:04.394886 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691996b-434a-42ec-be82-3185c2b1d5aa None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:04.395576 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d691996b-434a-42ec-be82-3185c2b1d5aa None admin] RBAC: Adding query filter params (name=service) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:09:04.395878 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d691996b-434a-42ec-be82-3185c2b1d5aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:04.397778 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d691996b-434a-42ec-be82-3185c2b1d5aa None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:04.405773 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 619/1236] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 8 02:09:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:09:04.411456 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c814f-1fd0-44e0-b1a5-8989796267b8 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:04.493533 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:04.509286 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c814f-1fd0-44e0-b1a5-8989796267b8 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:04.541878 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9d7bb-4207-4bbb-82dc-a98e636f6cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:04.542493 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9d7bb-4207-4bbb-82dc-a98e636f6cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:04.542775 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9d7bb-4207-4bbb-82dc-a98e636f6cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:04.543044 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9d7bb-4207-4bbb-82dc-a98e636f6cd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:04.552482 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e9d7bb-4207-4bbb-82dc-a98e636f6cd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:04.553932 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e9d7bb-4207-4bbb-82dc-a98e636f6cd2 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:04.567886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-65e9d7bb-4207-4bbb-82dc-a98e636f6cd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:09:04.567886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:09:04.567886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:09:04.567886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:09:04.567886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:09:04.567886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:09:04.567886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:09:04.567886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:09:04.567886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:09:04.567886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:09:04.567886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:09:04.567886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:09:04.567886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:09:04.567886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:09:04.567886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:09:04.567886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:09:04.569493 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:09:04.569493 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:09:04.569493 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:09:04.569493 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:09:04.569493 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:09:04.569493 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:09:04.569493 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:09:04.569493 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:09:04.569493 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:09:04.569493 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:09:04.569493 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:09:04.569493 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:09:04.569493 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:09:04.569493 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:09:04.569493 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:09:04.569493 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:09:04.569493 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:09:04.570725 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:09:04.570725 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:09:04.570725 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:09:04.570725 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 618/1237] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:09:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:09:04.575439 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d691996b-434a-42ec-be82-3185c2b1d5aa None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:04.671091 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d691996b-434a-42ec-be82-3185c2b1d5aa None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:04.680185 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:04.704315 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d63496-f0d0-4f60-a817-5a6b6595fab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:04.704902 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d63496-f0d0-4f60-a817-5a6b6595fab5 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:04.705183 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d63496-f0d0-4f60-a817-5a6b6595fab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:04.705455 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d63496-f0d0-4f60-a817-5a6b6595fab5 None admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:04.706086 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d63496-f0d0-4f60-a817-5a6b6595fab5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:09:04.706394 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d63496-f0d0-4f60-a817-5a6b6595fab5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:04.707772 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d63496-f0d0-4f60-a817-5a6b6595fab5 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:04.719246 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 620/1238] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:09:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:09:04.725685 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9d7bb-4207-4bbb-82dc-a98e636f6cd2 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:04.823391 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9d7bb-4207-4bbb-82dc-a98e636f6cd2 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:04.855034 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1721a0-ad84-48ba-a5de-041a8706ae10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:04.855699 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1721a0-ad84-48ba-a5de-041a8706ae10 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:04.855980 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1721a0-ad84-48ba-a5de-041a8706ae10 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:04.856254 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1721a0-ad84-48ba-a5de-041a8706ae10 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:04.858811 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:04.863525 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1721a0-ad84-48ba-a5de-041a8706ae10 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:04.864955 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1721a0-ad84-48ba-a5de-041a8706ae10 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:04.875999 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-7e1721a0-ad84-48ba-a5de-041a8706ae10 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 08 02:09:04.875999 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:09:04.875999 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:09:04.875999 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:09:04.875999 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:09:04.875999 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:09:04.875999 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:09:04.875999 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:09:04.875999 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:09:04.875999 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:09:04.875999 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:09:04.875999 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:09:04.875999 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:09:04.875999 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:09:04.875999 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:09:04.875999 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:09:04.877069 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:09:04.877069 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:09:04.877069 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:09:04.877069 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:09:04.877069 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:09:04.877069 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:09:04.877069 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:09:04.877069 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:09:04.877069 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:09:04.877069 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:09:04.877069 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:09:04.877069 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:09:04.877069 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:09:04.877069 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:09:04.877069 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:09:04.877069 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:09:04.877069 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:09:04.877069 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:09:04.878221 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:09:04.878221 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:09:04.878221 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:09:04.878221 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:09:04.878221 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:09:04.878221 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:09:04.878221 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:09:04.878221 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:09:04.878221 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 08 02:09:04.878221 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:09:04.878221 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 619/1239] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:09:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:09:04.883539 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d63496-f0d0-4f60-a817-5a6b6595fab5 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:04.981754 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d63496-f0d0-4f60-a817-5a6b6595fab5 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:05.014489 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f359a3-0772-48a8-8d3f-8b6fdba8644f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:05.015091 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f359a3-0772-48a8-8d3f-8b6fdba8644f None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:05.015418 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f359a3-0772-48a8-8d3f-8b6fdba8644f None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:05.015693 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f359a3-0772-48a8-8d3f-8b6fdba8644f None admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:05.016403 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f359a3-0772-48a8-8d3f-8b6fdba8644f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:09:05.016703 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f359a3-0772-48a8-8d3f-8b6fdba8644f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:05.018132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f359a3-0772-48a8-8d3f-8b6fdba8644f None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:05.034399 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 621/1240] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Aug 8 02:09:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:09:05.042069 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1721a0-ad84-48ba-a5de-041a8706ae10 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:05.142142 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1721a0-ad84-48ba-a5de-041a8706ae10 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:05.174287 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9fcebb-1a2c-4130-9cdf-b80813c9797f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:05.174878 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9fcebb-1a2c-4130-9cdf-b80813c9797f None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:05.175156 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9fcebb-1a2c-4130-9cdf-b80813c9797f None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:05.175485 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9fcebb-1a2c-4130-9cdf-b80813c9797f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:05.234948 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:05.241881 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9fcebb-1a2c-4130-9cdf-b80813c9797f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:05.243322 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9fcebb-1a2c-4130-9cdf-b80813c9797f None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:05.338742 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 620/1241] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:09:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 08 02:09:05.344775 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f359a3-0772-48a8-8d3f-8b6fdba8644f None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:05.371587 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:05.449116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f359a3-0772-48a8-8d3f-8b6fdba8644f None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:05.482103 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d921f9d-960f-42aa-abf8-bd658f08c734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:05.482756 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d921f9d-960f-42aa-abf8-bd658f08c734 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:05.483035 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d921f9d-960f-42aa-abf8-bd658f08c734 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:05.483306 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d921f9d-960f-42aa-abf8-bd658f08c734 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:05.492963 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d921f9d-960f-42aa-abf8-bd658f08c734 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:05.494455 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d921f9d-960f-42aa-abf8-bd658f08c734 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:05.508300 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-6d921f9d-960f-42aa-abf8-bd658f08c734 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:09:05.508300 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:09:05.508300 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:09:05.508300 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:09:05.508300 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:09:05.508300 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:09:05.508300 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:09:05.508300 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:09:05.508300 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:09:05.508300 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:09:05.508300 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:09:05.508300 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:09:05.508300 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:09:05.508300 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:09:05.508300 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:09:05.508300 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:09:05.509363 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:09:05.509363 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:09:05.509363 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:09:05.509363 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:09:05.509363 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:09:05.509363 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:09:05.509363 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:09:05.509363 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:09:05.509363 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:09:05.509363 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:09:05.509363 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:09:05.509363 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:09:05.509363 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:09:05.509363 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:09:05.509363 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:09:05.509363 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:09:05.509363 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:09:05.510634 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:09:05.510634 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:09:05.510634 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:09:05.510634 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 622/1242] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:09:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:09:05.515232 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9fcebb-1a2c-4130-9cdf-b80813c9797f None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:05.606723 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:05.612455 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9fcebb-1a2c-4130-9cdf-b80813c9797f None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:05.644430 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2a464-5ffd-4a8f-8327-c9e507e24add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:05.645022 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2a464-5ffd-4a8f-8327-c9e507e24add None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:05.645298 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2a464-5ffd-4a8f-8327-c9e507e24add None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:05.645568 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2a464-5ffd-4a8f-8327-c9e507e24add None admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:05.646197 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a2a464-5ffd-4a8f-8327-c9e507e24add None admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:09:05.646496 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a2a464-5ffd-4a8f-8327-c9e507e24add None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:05.648370 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a2a464-5ffd-4a8f-8327-c9e507e24add None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:05.658957 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 621/1243] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:09:05.665142 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d921f9d-960f-42aa-abf8-bd658f08c734 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:05.740511 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:05.762401 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d921f9d-960f-42aa-abf8-bd658f08c734 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:05.794437 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb9d5ae-b2b7-4d2d-a457-4c16f1c2925f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:05.795250 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9d5ae-b2b7-4d2d-a457-4c16f1c2925f None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:05.796478 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9d5ae-b2b7-4d2d-a457-4c16f1c2925f None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:05.796478 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9d5ae-b2b7-4d2d-a457-4c16f1c2925f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:05.803652 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb9d5ae-b2b7-4d2d-a457-4c16f1c2925f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:05.805085 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb9d5ae-b2b7-4d2d-a457-4c16f1c2925f None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:05.815922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-edb9d5ae-b2b7-4d2d-a457-4c16f1c2925f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:09:05.815922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:09:05.815922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:09:05.815922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:09:05.815922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:09:05.815922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:09:05.815922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:09:05.815922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:09:05.815922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:09:05.815922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:09:05.815922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:09:05.815922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:09:05.815922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:09:05.815922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:09:05.815922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:09:05.816936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:09:05.816936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:09:05.816936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:09:05.816936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:09:05.816936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:09:05.816936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:09:05.816936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:09:05.816936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:09:05.816936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:09:05.816936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:09:05.816936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:09:05.816936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:09:05.816936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:09:05.816936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:09:05.816936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:09:05.816936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:09:05.816936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:09:05.818025 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:09:05.818025 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:09:05.818025 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:09:05.818025 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:09:05.818025 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:09:05.818025 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:09:05.818025 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:09:05.818025 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:09:05.818025 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 623/1244] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:09:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:09:05.823389 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2a464-5ffd-4a8f-8327-c9e507e24add None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:05.921735 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2a464-5ffd-4a8f-8327-c9e507e24add None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:05.954334 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef20591-e0bc-4307-b151-82bb62df2001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:05.954925 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef20591-e0bc-4307-b151-82bb62df2001 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:05.955203 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef20591-e0bc-4307-b151-82bb62df2001 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:05.955511 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef20591-e0bc-4307-b151-82bb62df2001 None admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:05.956183 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef20591-e0bc-4307-b151-82bb62df2001 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:09:05.956487 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef20591-e0bc-4307-b151-82bb62df2001 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:05.957917 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef20591-e0bc-4307-b151-82bb62df2001 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:05.970521 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 622/1245] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 02:09:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:09:05.976576 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb9d5ae-b2b7-4d2d-a457-4c16f1c2925f None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:06.077855 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb9d5ae-b2b7-4d2d-a457-4c16f1c2925f None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:06.109992 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a59697-b891-47c2-a8e8-d5018417f6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:06.110579 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a59697-b891-47c2-a8e8-d5018417f6ba None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:06.110860 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a59697-b891-47c2-a8e8-d5018417f6ba None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:06.111136 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a59697-b891-47c2-a8e8-d5018417f6ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:06.111882 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a59697-b891-47c2-a8e8-d5018417f6ba None admin] RBAC: Adding query filter params (role.id=071080f2ecc948319b313f2379ea2b97, scope.project.id=ebe178f5bce64a009bf690031676c89f, user.id=43a39dd539974180a8165e34de57b552) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:09:06.112191 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a59697-b891-47c2-a8e8-d5018417f6ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:06.113589 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a59697-b891-47c2-a8e8-d5018417f6ba None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:06.119669 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 624/1246] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:09:05 2022] GET /identity/v3/role_assignments?user.id=43a39dd539974180a8165e34de57b552&scope.project.id=ebe178f5bce64a009bf690031676c89f&role.id=071080f2ecc948319b313f2379ea2b97 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:09:08.163893 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f072b-5e11-4076-ad7e-dc787135724e None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:08.164470 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f072b-5e11-4076-ad7e-dc787135724e None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:08.164470 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f072b-5e11-4076-ad7e-dc787135724e None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:08.165883 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 623/1247] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:09:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:09:08.170974 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6c866-b12f-459a-928e-1698144ece36 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:08.171408 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6c866-b12f-459a-928e-1698144ece36 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:08.171557 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6c866-b12f-459a-928e-1698144ece36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:08.177755 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:08.190211 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-79c6c866-b12f-459a-928e-1698144ece36 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:09:08.191408 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-79c6c866-b12f-459a-928e-1698144ece36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:08.255242 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 625/1248] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:09:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:09:08.278227 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f072b-5e11-4076-ad7e-dc787135724e None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:08.296494 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:08.376431 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f072b-5e11-4076-ad7e-dc787135724e None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:08.411101 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7284f13-13d8-432a-82ea-59e8d0927781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:08.411772 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7284f13-13d8-432a-82ea-59e8d0927781 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:08.412055 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7284f13-13d8-432a-82ea-59e8d0927781 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:08.412349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7284f13-13d8-432a-82ea-59e8d0927781 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:08.426571 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7284f13-13d8-432a-82ea-59e8d0927781 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:09:08.431372 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-c7284f13-13d8-432a-82ea-59e8d0927781 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:09:08.431372 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:09:08.431372 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:09:08.431372 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:09:08.431372 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:09:08.431372 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:09:08.431372 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:09:08.431372 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:09:08.431372 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:09:08.431372 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:09:08.431372 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:09:08.431372 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:09:08.431372 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:09:08.431372 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:09:08.431372 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:09:08.431372 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:09:08.432547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:09:08.432547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:09:08.432547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:09:08.432547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:09:08.432547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:09:08.432547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:09:08.432547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:09:08.432547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:09:08.432547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:09:08.432547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:09:08.432547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:09:08.432547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:09:08.432547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:09:08.432547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:09:08.432547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:09:08.432547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:09:08.433496 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:09:08.433496 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:09:08.433496 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:09:08.433496 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:09:08.433496 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:09:08.433496 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:09:08.433496 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:09:08.433496 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:09:08.433496 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:09:08.433496 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:09:08.433496 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:09:08.433496 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:09:08.433496 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 624/1249] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 02:09:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:09:08.440583 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6c866-b12f-459a-928e-1698144ece36 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:08.546834 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6c866-b12f-459a-928e-1698144ece36 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:08.576822 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:08.581918 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6276189-30f9-4440-961d-d042226aa0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:08.582531 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6276189-30f9-4440-961d-d042226aa0f0 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:08.582817 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6276189-30f9-4440-961d-d042226aa0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:08.583103 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6276189-30f9-4440-961d-d042226aa0f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:08.583805 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6276189-30f9-4440-961d-d042226aa0f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:09:08.584113 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6276189-30f9-4440-961d-d042226aa0f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:08.585992 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6276189-30f9-4440-961d-d042226aa0f0 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:08.593827 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 626/1250] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:09:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:09:08.599696 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7284f13-13d8-432a-82ea-59e8d0927781 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:08.677479 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:08.700045 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7284f13-13d8-432a-82ea-59e8d0927781 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:08.733876 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006430b-e163-43f5-b058-4c2361fa002a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:08.734500 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006430b-e163-43f5-b058-4c2361fa002a None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:08.734786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006430b-e163-43f5-b058-4c2361fa002a None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:08.735063 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006430b-e163-43f5-b058-4c2361fa002a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:08.745087 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4006430b-e163-43f5-b058-4c2361fa002a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:08.746541 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4006430b-e163-43f5-b058-4c2361fa002a None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:08.761670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-4006430b-e163-43f5-b058-4c2361fa002a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:09:08.761670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:09:08.761670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:09:08.761670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:09:08.761670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:09:08.761670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:09:08.761670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:09:08.761670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:09:08.761670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:09:08.761670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:09:08.761670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:09:08.761670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:09:08.761670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:09:08.761670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:09:08.761670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:09:08.761670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:09:08.762679 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:09:08.762679 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:09:08.762679 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:09:08.762679 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:09:08.762679 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:09:08.762679 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:09:08.762679 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:09:08.762679 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:09:08.762679 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:09:08.762679 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:09:08.762679 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:09:08.762679 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:09:08.762679 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:09:08.762679 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:09:08.762679 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:09:08.762679 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:09:08.762679 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:09:08.763805 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:09:08.763805 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:09:08.763805 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:09:08.763805 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 625/1251] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:09:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:09:08.768560 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6276189-30f9-4440-961d-d042226aa0f0 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:08.865231 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6276189-30f9-4440-961d-d042226aa0f0 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:08.897915 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d65891-13aa-4400-b6e8-7ac5fde431d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:08.898510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d65891-13aa-4400-b6e8-7ac5fde431d4 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:08.898794 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d65891-13aa-4400-b6e8-7ac5fde431d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:08.899068 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d65891-13aa-4400-b6e8-7ac5fde431d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:08.899729 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d65891-13aa-4400-b6e8-7ac5fde431d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:09:08.900032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d65891-13aa-4400-b6e8-7ac5fde431d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:08.901482 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d65891-13aa-4400-b6e8-7ac5fde431d4 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:08.913216 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 627/1252] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:09:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:09:08.918818 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006430b-e163-43f5-b058-4c2361fa002a None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:09.014576 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006430b-e163-43f5-b058-4c2361fa002a None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:09.040191 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:09.047682 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ddceb-677b-4b48-b0ce-0fa0b97f5d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:09.048323 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ddceb-677b-4b48-b0ce-0fa0b97f5d0d None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:09.050048 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ddceb-677b-4b48-b0ce-0fa0b97f5d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:09.050048 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ddceb-677b-4b48-b0ce-0fa0b97f5d0d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:09.055945 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ddceb-677b-4b48-b0ce-0fa0b97f5d0d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:09.057369 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ddceb-677b-4b48-b0ce-0fa0b97f5d0d None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:09.068449 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-f53ddceb-677b-4b48-b0ce-0fa0b97f5d0d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 08 02:09:09.068449 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:09:09.068449 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:09:09.068449 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:09:09.068449 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:09:09.068449 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:09:09.068449 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:09:09.068449 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:09:09.068449 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:09:09.068449 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:09:09.068449 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:09:09.068449 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:09:09.068449 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:09:09.068449 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:09:09.068449 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:09:09.068449 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:09:09.069863 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:09:09.069863 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:09:09.069863 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:09:09.069863 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:09:09.069863 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:09:09.069863 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:09:09.069863 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:09:09.069863 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:09:09.069863 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:09:09.069863 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:09:09.069863 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:09:09.069863 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:09:09.069863 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:09:09.069863 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:09:09.069863 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:09:09.069863 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:09:09.069863 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:09:09.069863 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:09:09.070853 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:09:09.070853 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:09:09.070853 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:09:09.070853 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:09:09.070853 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:09:09.070853 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:09:09.070853 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:09:09.070853 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:09:09.070853 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 08 02:09:09.070853 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:09:09.070853 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 626/1253] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:09:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:09:09.075645 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d65891-13aa-4400-b6e8-7ac5fde431d4 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:09.143088 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:09.185168 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d65891-13aa-4400-b6e8-7ac5fde431d4 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:09.218696 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd7085-25aa-4ca0-861c-cad1199a12a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:09.219292 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd7085-25aa-4ca0-861c-cad1199a12a9 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:09.219602 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd7085-25aa-4ca0-861c-cad1199a12a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:09.219875 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd7085-25aa-4ca0-861c-cad1199a12a9 None admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:09.220589 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd7085-25aa-4ca0-861c-cad1199a12a9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:09:09.220890 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd7085-25aa-4ca0-861c-cad1199a12a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:09.222284 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd7085-25aa-4ca0-861c-cad1199a12a9 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:09.238461 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 628/1254] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Aug 8 02:09:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:09:09.244669 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ddceb-677b-4b48-b0ce-0fa0b97f5d0d None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:09.339741 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ddceb-677b-4b48-b0ce-0fa0b97f5d0d None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:09.371942 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cf5eb-28bd-41bb-a2a2-7aa1f69a4af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:09.372534 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cf5eb-28bd-41bb-a2a2-7aa1f69a4af3 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:09.372816 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cf5eb-28bd-41bb-a2a2-7aa1f69a4af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:09.373089 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cf5eb-28bd-41bb-a2a2-7aa1f69a4af3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:09.427303 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:09.440899 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219cf5eb-28bd-41bb-a2a2-7aa1f69a4af3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:09.442329 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219cf5eb-28bd-41bb-a2a2-7aa1f69a4af3 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:09.535420 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 627/1255] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:09:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:09:09.542777 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd7085-25aa-4ca0-861c-cad1199a12a9 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:09.639221 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd7085-25aa-4ca0-861c-cad1199a12a9 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:09.652515 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:09.672497 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc8fa9-2068-4c27-b05d-05d2dddbc73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:09.673130 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc8fa9-2068-4c27-b05d-05d2dddbc73d None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:09.673395 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc8fa9-2068-4c27-b05d-05d2dddbc73d None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:09.673669 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc8fa9-2068-4c27-b05d-05d2dddbc73d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:09.683801 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc8fa9-2068-4c27-b05d-05d2dddbc73d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:09.685226 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc8fa9-2068-4c27-b05d-05d2dddbc73d None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:09.699678 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-90bc8fa9-2068-4c27-b05d-05d2dddbc73d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:09:09.699678 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:09:09.699678 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:09:09.699678 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:09:09.699678 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:09:09.699678 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:09:09.699678 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:09:09.699678 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:09:09.699678 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:09:09.699678 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:09:09.699678 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:09:09.699678 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:09:09.699678 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:09:09.699678 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:09:09.699678 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:09:09.699678 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:09:09.700763 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:09:09.700763 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:09:09.700763 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:09:09.700763 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:09:09.700763 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:09:09.700763 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:09:09.700763 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:09:09.700763 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:09:09.700763 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:09:09.700763 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:09:09.700763 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:09:09.700763 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:09:09.700763 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:09:09.700763 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:09:09.700763 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:09:09.700763 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:09:09.700763 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:09:09.701847 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:09:09.701847 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:09:09.701847 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:09:09.701847 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 629/1256] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:09:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:09:09.706490 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cf5eb-28bd-41bb-a2a2-7aa1f69a4af3 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:09.790993 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:09.802531 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cf5eb-28bd-41bb-a2a2-7aa1f69a4af3 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:09.837019 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd914ccb-4e03-4266-ba34-b313a95e1bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:09.837611 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd914ccb-4e03-4266-ba34-b313a95e1bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:09.837887 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd914ccb-4e03-4266-ba34-b313a95e1bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:09.838206 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd914ccb-4e03-4266-ba34-b313a95e1bc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:09.838833 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd914ccb-4e03-4266-ba34-b313a95e1bc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:09:09.839157 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd914ccb-4e03-4266-ba34-b313a95e1bc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:09.840534 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd914ccb-4e03-4266-ba34-b313a95e1bc6 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:09.851316 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 628/1257] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:09:09.857016 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc8fa9-2068-4c27-b05d-05d2dddbc73d None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:09.955426 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc8fa9-2068-4c27-b05d-05d2dddbc73d None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:09.987466 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041d32c-5cb3-4e95-9513-baf5b6533461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:09.988078 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041d32c-5cb3-4e95-9513-baf5b6533461 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:09.988360 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041d32c-5cb3-4e95-9513-baf5b6533461 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:09.988633 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041d32c-5cb3-4e95-9513-baf5b6533461 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:09.995803 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c041d32c-5cb3-4e95-9513-baf5b6533461 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:09.997249 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c041d32c-5cb3-4e95-9513-baf5b6533461 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:10.009922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-c041d32c-5cb3-4e95-9513-baf5b6533461 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:09:10.009922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:09:10.009922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:09:10.009922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:09:10.009922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:09:10.009922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:09:10.009922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:09:10.009922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:09:10.009922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:09:10.009922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:09:10.009922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:09:10.009922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:09:10.009922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:09:10.009922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:09:10.009922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:09:10.011002 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:09:10.011002 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:09:10.011002 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:09:10.011002 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:09:10.011002 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:09:10.011002 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:09:10.011002 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:09:10.011002 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:09:10.011002 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:09:10.011002 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:09:10.011002 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:09:10.011002 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:09:10.011002 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:09:10.011002 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:09:10.011002 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:09:10.011002 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:09:10.011002 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:09:10.011983 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:09:10.011983 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:09:10.011983 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:09:10.011983 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:09:10.011983 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:09:10.011983 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:09:10.011983 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:09:10.011983 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:09:10.011983 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 630/1258] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:09:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:09:10.017031 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd914ccb-4e03-4266-ba34-b313a95e1bc6 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:10.114176 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd914ccb-4e03-4266-ba34-b313a95e1bc6 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:10.147813 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21786dc6-36a1-45f5-af6a-4e957ac93228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:10.148405 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21786dc6-36a1-45f5-af6a-4e957ac93228 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:10.148685 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21786dc6-36a1-45f5-af6a-4e957ac93228 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:10.148956 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21786dc6-36a1-45f5-af6a-4e957ac93228 None admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:10.149705 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21786dc6-36a1-45f5-af6a-4e957ac93228 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:09:10.150012 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21786dc6-36a1-45f5-af6a-4e957ac93228 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:10.151440 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21786dc6-36a1-45f5-af6a-4e957ac93228 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:10.162961 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 629/1259] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 02:09:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:09:10.169117 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041d32c-5cb3-4e95-9513-baf5b6533461 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:10.197291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:10.269648 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041d32c-5cb3-4e95-9513-baf5b6533461 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:10.302826 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100397f-954e-4544-a6af-f004b5e41d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:10.304010 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100397f-954e-4544-a6af-f004b5e41d0f None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:10.304301 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100397f-954e-4544-a6af-f004b5e41d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:10.304598 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100397f-954e-4544-a6af-f004b5e41d0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:10.305314 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100397f-954e-4544-a6af-f004b5e41d0f None admin] RBAC: Adding query filter params (role.id=84da65a75e544d1191ec53cb6b05aa73, scope.project.id=ebe178f5bce64a009bf690031676c89f, user.id=43a39dd539974180a8165e34de57b552) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:09:10.305620 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100397f-954e-4544-a6af-f004b5e41d0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:10.307032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100397f-954e-4544-a6af-f004b5e41d0f None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:10.312491 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 631/1260] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:09:10 2022] GET /identity/v3/role_assignments?user.id=43a39dd539974180a8165e34de57b552&scope.project.id=ebe178f5bce64a009bf690031676c89f&role.id=84da65a75e544d1191ec53cb6b05aa73 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:09:12.259176 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b122d30-4d25-43b4-b5a6-fb02e900ce01 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:12.259739 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b122d30-4d25-43b4-b5a6-fb02e900ce01 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:12.259739 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b122d30-4d25-43b4-b5a6-fb02e900ce01 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:12.261082 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 630/1261] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:09:12.266321 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610c50b-e4aa-4633-a38e-750d50cdb623 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:12.267586 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610c50b-e4aa-4633-a38e-750d50cdb623 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:12.267586 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610c50b-e4aa-4633-a38e-750d50cdb623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:12.284311 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-9610c50b-e4aa-4633-a38e-750d50cdb623 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:09:12.285510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-9610c50b-e4aa-4633-a38e-750d50cdb623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:12.352041 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 632/1262] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:09:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:09:12.374240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b122d30-4d25-43b4-b5a6-fb02e900ce01 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:12.385969 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:12.471803 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b122d30-4d25-43b4-b5a6-fb02e900ce01 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:12.505262 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c794c4-5762-4778-9847-e294611bf1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:12.505878 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c794c4-5762-4778-9847-e294611bf1db None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:12.506159 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c794c4-5762-4778-9847-e294611bf1db None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:12.506432 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c794c4-5762-4778-9847-e294611bf1db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:12.516640 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c794c4-5762-4778-9847-e294611bf1db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:09:12.521190 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-75c794c4-5762-4778-9847-e294611bf1db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:09:12.521190 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:09:12.521190 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:09:12.521190 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:09:12.521190 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:09:12.521190 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:09:12.521190 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:09:12.521190 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:09:12.521190 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:09:12.521190 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:09:12.521190 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:09:12.521190 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:09:12.521190 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:09:12.521190 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:09:12.521190 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:09:12.521190 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:09:12.533404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:09:12.533404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:09:12.533404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:09:12.533404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:09:12.533404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:09:12.533404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:09:12.533404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:09:12.533404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:09:12.533404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:09:12.533404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:09:12.533404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:09:12.533404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:09:12.533404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:09:12.533404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:09:12.533404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:09:12.533404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:09:12.534456 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:09:12.534456 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:09:12.534456 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:09:12.534456 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:09:12.534456 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:09:12.534456 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:09:12.534456 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:09:12.534456 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:09:12.534456 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:09:12.534456 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:09:12.534456 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:09:12.534456 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:09:12.534456 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 631/1263] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 02:09:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:09:12.535297 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610c50b-e4aa-4633-a38e-750d50cdb623 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:12.546928 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:12.625026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610c50b-e4aa-4633-a38e-750d50cdb623 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:12.657508 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48544d3f-7a49-4819-96fc-816d806fd56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:12.658103 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48544d3f-7a49-4819-96fc-816d806fd56f None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:12.658383 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48544d3f-7a49-4819-96fc-816d806fd56f None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:12.658655 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48544d3f-7a49-4819-96fc-816d806fd56f None admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:12.659313 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48544d3f-7a49-4819-96fc-816d806fd56f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:09:12.659650 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48544d3f-7a49-4819-96fc-816d806fd56f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:12.660989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48544d3f-7a49-4819-96fc-816d806fd56f None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:12.668676 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 633/1264] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:09:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:09:12.674509 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c794c4-5762-4778-9847-e294611bf1db None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:12.738883 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:12.770322 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c794c4-5762-4778-9847-e294611bf1db None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:12.802711 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96600365-3e95-4422-9d06-2b2a6fbd83bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:12.803408 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96600365-3e95-4422-9d06-2b2a6fbd83bb None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:12.806568 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96600365-3e95-4422-9d06-2b2a6fbd83bb None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:12.806568 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96600365-3e95-4422-9d06-2b2a6fbd83bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:12.814569 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96600365-3e95-4422-9d06-2b2a6fbd83bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:12.816037 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96600365-3e95-4422-9d06-2b2a6fbd83bb None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:12.830124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-96600365-3e95-4422-9d06-2b2a6fbd83bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:09:12.830124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:09:12.830124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:09:12.830124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:09:12.830124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:09:12.830124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:09:12.830124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:09:12.830124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:09:12.830124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:09:12.830124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:09:12.830124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:09:12.830124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:09:12.830124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:09:12.830124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:09:12.830124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:09:12.830124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:09:12.831268 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:09:12.831268 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:09:12.831268 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:09:12.831268 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:09:12.831268 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:09:12.831268 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:09:12.831268 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:09:12.831268 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:09:12.831268 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:09:12.831268 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:09:12.831268 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:09:12.831268 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:09:12.831268 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:09:12.831268 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:09:12.831268 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:09:12.831268 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:09:12.831268 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:09:12.832622 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:09:12.832622 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:09:12.832622 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:09:12.832622 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 632/1265] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:09:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:09:12.837660 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48544d3f-7a49-4819-96fc-816d806fd56f None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:12.915712 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:12.934749 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48544d3f-7a49-4819-96fc-816d806fd56f None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:12.967823 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940bcf1-2c1e-44c5-a450-f656b71eed7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:12.968418 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940bcf1-2c1e-44c5-a450-f656b71eed7f None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:12.968698 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940bcf1-2c1e-44c5-a450-f656b71eed7f None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:12.968973 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940bcf1-2c1e-44c5-a450-f656b71eed7f None admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:12.969632 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940bcf1-2c1e-44c5-a450-f656b71eed7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:09:12.969934 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940bcf1-2c1e-44c5-a450-f656b71eed7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:12.971278 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940bcf1-2c1e-44c5-a450-f656b71eed7f None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:12.982112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 634/1266] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:09:12.987908 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96600365-3e95-4422-9d06-2b2a6fbd83bb None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:13.085670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96600365-3e95-4422-9d06-2b2a6fbd83bb None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:13.104292 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:13.118577 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a155a-64a9-422d-9a8d-ff9582fc49aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:13.119207 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a155a-64a9-422d-9a8d-ff9582fc49aa None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:13.119517 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a155a-64a9-422d-9a8d-ff9582fc49aa None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:13.119794 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a155a-64a9-422d-9a8d-ff9582fc49aa None admin] PATH_INFO: `/v3/users/placement` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:13.127461 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a155a-64a9-422d-9a8d-ff9582fc49aa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:13.129163 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a155a-64a9-422d-9a8d-ff9582fc49aa None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:13.144910 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-a85a155a-64a9-422d-9a8d-ff9582fc49aa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 08 02:09:13.144910 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:09:13.144910 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:09:13.144910 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:09:13.144910 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:09:13.144910 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:09:13.144910 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:09:13.144910 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:09:13.144910 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:09:13.144910 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:09:13.144910 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:09:13.144910 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:09:13.144910 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:09:13.144910 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:09:13.144910 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:09:13.144910 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:09:13.146672 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:09:13.146672 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:09:13.146672 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:09:13.146672 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:09:13.146672 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:09:13.146672 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:09:13.146672 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:09:13.146672 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:09:13.146672 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:09:13.146672 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:09:13.146672 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:09:13.146672 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:09:13.146672 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:09:13.146672 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:09:13.146672 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:09:13.146672 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:09:13.146672 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:09:13.146672 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:09:13.148617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:09:13.148617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:09:13.148617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:09:13.148617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:09:13.148617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:09:13.148617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:09:13.148617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:09:13.148617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:09:13.148617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 08 02:09:13.148617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:09:13.151474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 633/1267] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:09:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:09:13.152863 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940bcf1-2c1e-44c5-a450-f656b71eed7f None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:13.254347 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940bcf1-2c1e-44c5-a450-f656b71eed7f None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:13.286936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad493e-138e-4028-994c-d59d062ea7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:13.287548 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad493e-138e-4028-994c-d59d062ea7ad None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:13.288324 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad493e-138e-4028-994c-d59d062ea7ad None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:13.288600 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad493e-138e-4028-994c-d59d062ea7ad None admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:13.289316 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad493e-138e-4028-994c-d59d062ea7ad None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:09:13.289618 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad493e-138e-4028-994c-d59d062ea7ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:13.291017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad493e-138e-4028-994c-d59d062ea7ad None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:13.300128 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:13.308856 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 635/1268] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Aug 8 02:09:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:09:13.314624 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a155a-64a9-422d-9a8d-ff9582fc49aa None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:13.410983 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a155a-64a9-422d-9a8d-ff9582fc49aa None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:13.444642 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a70e4-fa5c-485c-b713-eb12d98ba578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:13.445270 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a70e4-fa5c-485c-b713-eb12d98ba578 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:13.445548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a70e4-fa5c-485c-b713-eb12d98ba578 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:13.445820 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a70e4-fa5c-485c-b713-eb12d98ba578 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:13.456652 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a70e4-fa5c-485c-b713-eb12d98ba578 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:13.458126 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a70e4-fa5c-485c-b713-eb12d98ba578 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:13.471709 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-d81a70e4-fa5c-485c-b713-eb12d98ba578 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:09:13.471709 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:09:13.471709 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:09:13.471709 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:09:13.471709 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:09:13.471709 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:09:13.471709 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:09:13.471709 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:09:13.471709 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:09:13.471709 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:09:13.471709 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:09:13.471709 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:09:13.471709 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:09:13.471709 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:09:13.471709 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:09:13.471709 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:09:13.472844 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:09:13.472844 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:09:13.472844 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:09:13.472844 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:09:13.472844 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:09:13.472844 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:09:13.472844 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:09:13.472844 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:09:13.472844 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:09:13.472844 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:09:13.472844 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:09:13.472844 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:09:13.472844 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:09:13.472844 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:09:13.472844 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:09:13.472844 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:09:13.472844 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:09:13.473740 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:09:13.473740 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:09:13.473740 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:09:13.473740 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 634/1269] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:09:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:09:13.479192 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad493e-138e-4028-994c-d59d062ea7ad None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:13.576554 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad493e-138e-4028-994c-d59d062ea7ad None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:13.610403 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d4ec3-e536-4dd3-8260-31c7c49fa606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:13.611001 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d4ec3-e536-4dd3-8260-31c7c49fa606 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:13.611284 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d4ec3-e536-4dd3-8260-31c7c49fa606 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:13.611591 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d4ec3-e536-4dd3-8260-31c7c49fa606 None admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:13.612228 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7d4ec3-e536-4dd3-8260-31c7c49fa606 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:09:13.612530 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7d4ec3-e536-4dd3-8260-31c7c49fa606 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:13.613876 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7d4ec3-e536-4dd3-8260-31c7c49fa606 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:13.625502 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 636/1270] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:09:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:09:13.631275 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a70e4-fa5c-485c-b713-eb12d98ba578 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:13.662243 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:13.727562 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a70e4-fa5c-485c-b713-eb12d98ba578 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:13.761108 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab817cb-1e2f-4e9d-8530-6b4e8045adcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:13.761720 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab817cb-1e2f-4e9d-8530-6b4e8045adcb None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:13.761999 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab817cb-1e2f-4e9d-8530-6b4e8045adcb None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:13.762271 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab817cb-1e2f-4e9d-8530-6b4e8045adcb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:13.768929 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab817cb-1e2f-4e9d-8530-6b4e8045adcb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:13.770543 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab817cb-1e2f-4e9d-8530-6b4e8045adcb None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:13.781775 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-dab817cb-1e2f-4e9d-8530-6b4e8045adcb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:09:13.781775 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:09:13.781775 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:09:13.781775 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:09:13.781775 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:09:13.781775 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:09:13.781775 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:09:13.781775 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:09:13.781775 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:09:13.781775 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:09:13.781775 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:09:13.781775 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:09:13.781775 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:09:13.781775 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:09:13.781775 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:09:13.782816 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:09:13.782816 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:09:13.782816 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:09:13.782816 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:09:13.782816 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:09:13.782816 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:09:13.782816 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:09:13.782816 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:09:13.782816 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:09:13.782816 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:09:13.782816 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:09:13.782816 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:09:13.782816 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:09:13.782816 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:09:13.782816 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:09:13.782816 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:09:13.782816 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:09:13.783947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:09:13.783947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:09:13.783947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:09:13.783947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:09:13.783947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:09:13.783947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:09:13.783947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:09:13.783947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:09:13.783947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 635/1271] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:09:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:09:13.789168 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d4ec3-e536-4dd3-8260-31c7c49fa606 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:13.845872 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:13.890595 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d4ec3-e536-4dd3-8260-31c7c49fa606 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:13.923118 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad68e4-5d2d-405e-9569-8a6dd4198029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:13.923746 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad68e4-5d2d-405e-9569-8a6dd4198029 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:13.924026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad68e4-5d2d-405e-9569-8a6dd4198029 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:13.924295 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad68e4-5d2d-405e-9569-8a6dd4198029 None admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:13.924974 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad68e4-5d2d-405e-9569-8a6dd4198029 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:09:13.925276 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad68e4-5d2d-405e-9569-8a6dd4198029 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:13.926673 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad68e4-5d2d-405e-9569-8a6dd4198029 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:13.939208 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 637/1272] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 02:09:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:09:13.945987 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab817cb-1e2f-4e9d-8530-6b4e8045adcb None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:14.033301 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:14.042500 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab817cb-1e2f-4e9d-8530-6b4e8045adcb None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:14.075116 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2bb876-603c-4f2a-b9dd-42de17049f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:14.075804 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bb876-603c-4f2a-b9dd-42de17049f84 None admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:14.076085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bb876-603c-4f2a-b9dd-42de17049f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:14.076358 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bb876-603c-4f2a-b9dd-42de17049f84 None admin] PATH_INFO: `/v3/projects/ebe178f5bce64a009bf690031676c89f/users/43a39dd539974180a8165e34de57b552/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:14.078397 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2bb876-603c-4f2a-b9dd-42de17049f84 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebe178f5bce64a009bf690031676c89f, user_id=43a39dd539974180a8165e34de57b552, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:14.079734 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2bb876-603c-4f2a-b9dd-42de17049f84 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:14.162248 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 636/1273] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 02:09:13 2022] PUT /identity/v3/projects/ebe178f5bce64a009bf690031676c89f/users/43a39dd539974180a8165e34de57b552/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:09:16.136873 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203d47d-d0a2-4293-9418-17248b6a46b5 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:16.137478 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203d47d-d0a2-4293-9418-17248b6a46b5 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:16.137478 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203d47d-d0a2-4293-9418-17248b6a46b5 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:16.138792 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 638/1274] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:09:16.144012 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193886fa-c4e6-4a64-b6bd-272f0c818475 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:16.144465 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193886fa-c4e6-4a64-b6bd-272f0c818475 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:16.144603 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193886fa-c4e6-4a64-b6bd-272f0c818475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:16.161905 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-193886fa-c4e6-4a64-b6bd-272f0c818475 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:09:16.163067 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-193886fa-c4e6-4a64-b6bd-272f0c818475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:16.227509 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 637/1275] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:09:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:09:16.250406 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203d47d-d0a2-4293-9418-17248b6a46b5 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:16.348000 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203d47d-d0a2-4293-9418-17248b6a46b5 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:16.364908 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:16.381429 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74e9ba-d138-45d4-859d-f532fdfba93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:16.382140 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74e9ba-d138-45d4-859d-f532fdfba93d None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:16.382343 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74e9ba-d138-45d4-859d-f532fdfba93d None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:16.382618 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74e9ba-d138-45d4-859d-f532fdfba93d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:16.392870 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74e9ba-d138-45d4-859d-f532fdfba93d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 02:09:16.397424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-0c74e9ba-d138-45d4-859d-f532fdfba93d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:09:16.397424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:09:16.397424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:09:16.397424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:09:16.397424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:09:16.397424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:09:16.397424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:09:16.397424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:09:16.397424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:09:16.397424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:09:16.397424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:09:16.397424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:09:16.397424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 02:09:16.397424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 02:09:16.397424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 02:09:16.397424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 02:09:16.409600 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 02:09:16.409600 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 02:09:16.409600 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 02:09:16.409600 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 02:09:16.409600 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:09:16.409600 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:09:16.409600 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:09:16.409600 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:09:16.409600 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:09:16.409600 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:09:16.409600 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:09:16.409600 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:09:16.409600 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:09:16.409600 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:09:16.409600 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:09:16.409600 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:09:16.410424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:09:16.410424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:09:16.410424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:09:16.410424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:09:16.410424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 02:09:16.410424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 02:09:16.410424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 02:09:16.410424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 02:09:16.410424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 02:09:16.410424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 02:09:16.410424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 02:09:16.410424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:09:16.410424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 639/1276] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 02:09:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:09:16.411195 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193886fa-c4e6-4a64-b6bd-272f0c818475 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:16.485626 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:16.503086 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193886fa-c4e6-4a64-b6bd-272f0c818475 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:16.536611 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08cce09-3c76-44c7-b48e-9d821379598f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:16.537213 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cce09-3c76-44c7-b48e-9d821379598f None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:16.537496 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cce09-3c76-44c7-b48e-9d821379598f None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:16.537774 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cce09-3c76-44c7-b48e-9d821379598f None admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:16.538424 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08cce09-3c76-44c7-b48e-9d821379598f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:09:16.538725 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08cce09-3c76-44c7-b48e-9d821379598f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:16.540103 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08cce09-3c76-44c7-b48e-9d821379598f None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:16.548174 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 638/1277] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 02:09:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:09:16.554179 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74e9ba-d138-45d4-859d-f532fdfba93d None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:16.651642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74e9ba-d138-45d4-859d-f532fdfba93d None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:16.685233 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c301b24-8687-4d32-ab90-061872528b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:16.685847 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c301b24-8687-4d32-ab90-061872528b9d None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:16.686129 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c301b24-8687-4d32-ab90-061872528b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:16.686403 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c301b24-8687-4d32-ab90-061872528b9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:16.696707 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c301b24-8687-4d32-ab90-061872528b9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:16.698133 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c301b24-8687-4d32-ab90-061872528b9d None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:16.712016 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-7c301b24-8687-4d32-ab90-061872528b9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:09:16.712016 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:09:16.712016 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:09:16.712016 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:09:16.712016 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:09:16.712016 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:09:16.712016 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:09:16.712016 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:09:16.712016 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:09:16.712016 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:09:16.712016 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:09:16.712016 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:09:16.712016 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:09:16.712016 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:09:16.712016 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:09:16.712016 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:09:16.715017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:09:16.715017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:09:16.715017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:09:16.715017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:09:16.715017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:09:16.715017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:09:16.715017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:09:16.715017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:09:16.715017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:09:16.715017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:09:16.715017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:09:16.715017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:09:16.715017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:09:16.715017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:09:16.715017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:09:16.715017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:09:16.715017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:09:16.716029 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:09:16.716029 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:09:16.716029 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:09:16.716029 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 640/1278] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:09:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:09:16.719043 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08cce09-3c76-44c7-b48e-9d821379598f None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:16.816073 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08cce09-3c76-44c7-b48e-9d821379598f None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:16.848906 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaad730-bed8-4052-9880-c984e2e383cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:16.849504 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaad730-bed8-4052-9880-c984e2e383cc None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:16.849784 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaad730-bed8-4052-9880-c984e2e383cc None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:16.850056 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaad730-bed8-4052-9880-c984e2e383cc None admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:16.850693 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaad730-bed8-4052-9880-c984e2e383cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:09:16.850996 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaad730-bed8-4052-9880-c984e2e383cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:16.852386 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaad730-bed8-4052-9880-c984e2e383cc None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:16.863730 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 639/1279] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:09:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:09:16.870002 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c301b24-8687-4d32-ab90-061872528b9d None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:16.900093 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:16.966661 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c301b24-8687-4d32-ab90-061872528b9d None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:17.000436 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aaf854-a1d7-4fd3-9c08-60cc5c45bb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:17.001050 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aaf854-a1d7-4fd3-9c08-60cc5c45bb79 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:17.001329 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aaf854-a1d7-4fd3-9c08-60cc5c45bb79 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:17.001601 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aaf854-a1d7-4fd3-9c08-60cc5c45bb79 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:17.008475 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aaf854-a1d7-4fd3-9c08-60cc5c45bb79 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:17.010020 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aaf854-a1d7-4fd3-9c08-60cc5c45bb79 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:17.021626 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-b6aaf854-a1d7-4fd3-9c08-60cc5c45bb79 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 08 02:09:17.021626 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:09:17.021626 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:09:17.021626 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:09:17.021626 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:09:17.021626 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:09:17.021626 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:09:17.021626 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:09:17.021626 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:09:17.021626 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:09:17.021626 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:09:17.021626 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:09:17.021626 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 02:09:17.021626 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 02:09:17.021626 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 02:09:17.021626 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 02:09:17.022704 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:09:17.022704 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:09:17.022704 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 02:09:17.022704 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:09:17.022704 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 02:09:17.022704 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 02:09:17.022704 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:09:17.022704 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:09:17.022704 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:09:17.022704 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:09:17.022704 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:09:17.022704 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:09:17.022704 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:09:17.022704 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:09:17.022704 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:09:17.022704 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:09:17.022704 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:09:17.022704 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:09:17.023682 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:09:17.023682 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:09:17.023682 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 02:09:17.023682 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 02:09:17.023682 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 02:09:17.023682 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 02:09:17.023682 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 02:09:17.023682 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 02:09:17.023682 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 08 02:09:17.023682 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:09:17.023682 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 641/1280] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:09:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:09:17.028803 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaad730-bed8-4052-9880-c984e2e383cc None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:17.032612 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:17.124376 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaad730-bed8-4052-9880-c984e2e383cc None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:17.157269 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6edfb0-220b-4516-a4a9-8637e20f65d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:17.157963 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6edfb0-220b-4516-a4a9-8637e20f65d1 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:17.158136 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6edfb0-220b-4516-a4a9-8637e20f65d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:17.158407 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6edfb0-220b-4516-a4a9-8637e20f65d1 None admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:17.159121 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6edfb0-220b-4516-a4a9-8637e20f65d1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:09:17.159454 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6edfb0-220b-4516-a4a9-8637e20f65d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:17.160875 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6edfb0-220b-4516-a4a9-8637e20f65d1 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:17.177125 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 640/1281] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Aug 8 02:09:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:09:17.184883 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aaf854-a1d7-4fd3-9c08-60cc5c45bb79 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:17.275201 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:17.284356 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aaf854-a1d7-4fd3-9c08-60cc5c45bb79 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:17.316350 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bcc605-0f70-4399-be75-3376b2b9a764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:17.316945 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bcc605-0f70-4399-be75-3376b2b9a764 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:17.317226 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bcc605-0f70-4399-be75-3376b2b9a764 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:17.317502 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bcc605-0f70-4399-be75-3376b2b9a764 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:17.383301 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bcc605-0f70-4399-be75-3376b2b9a764 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:17.384870 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bcc605-0f70-4399-be75-3376b2b9a764 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:17.469353 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:17.479066 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 642/1282] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 02:09:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 02:09:17.485227 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6edfb0-220b-4516-a4a9-8637e20f65d1 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:17.546234 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:17.583919 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6edfb0-220b-4516-a4a9-8637e20f65d1 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:17.614975 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230bb85-6453-424b-947e-16a234670d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:17.615617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230bb85-6453-424b-947e-16a234670d68 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:17.616388 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230bb85-6453-424b-947e-16a234670d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:17.616662 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230bb85-6453-424b-947e-16a234670d68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:17.626495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8230bb85-6453-424b-947e-16a234670d68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:17.627982 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8230bb85-6453-424b-947e-16a234670d68 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:17.641815 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-8230bb85-6453-424b-947e-16a234670d68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:09:17.641815 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:09:17.641815 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:09:17.641815 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:09:17.641815 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:09:17.641815 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:09:17.641815 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:09:17.641815 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:09:17.641815 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:09:17.641815 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:09:17.641815 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:09:17.641815 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:09:17.641815 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 02:09:17.641815 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 02:09:17.641815 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 02:09:17.641815 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 02:09:17.642862 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:09:17.642862 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:09:17.642862 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:09:17.642862 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:09:17.642862 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:09:17.642862 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:09:17.642862 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:09:17.642862 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:09:17.642862 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:09:17.642862 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:09:17.642862 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:09:17.642862 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:09:17.642862 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:09:17.642862 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:09:17.642862 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:09:17.642862 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:09:17.642862 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 02:09:17.644058 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 02:09:17.644058 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 02:09:17.644058 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:09:17.644058 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 641/1283] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:09:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:09:17.648764 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bcc605-0f70-4399-be75-3376b2b9a764 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:17.747792 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bcc605-0f70-4399-be75-3376b2b9a764 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:17.780095 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715dd0f-603a-452c-8de5-b8843b292ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:17.780723 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715dd0f-603a-452c-8de5-b8843b292ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:17.780962 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715dd0f-603a-452c-8de5-b8843b292ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:17.781234 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715dd0f-603a-452c-8de5-b8843b292ad1 None admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:17.781863 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7715dd0f-603a-452c-8de5-b8843b292ad1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:09:17.782162 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7715dd0f-603a-452c-8de5-b8843b292ad1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:17.783539 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7715dd0f-603a-452c-8de5-b8843b292ad1 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:17.794936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 643/1284] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 02:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:09:17.801509 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230bb85-6453-424b-947e-16a234670d68 None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:17.900541 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230bb85-6453-424b-947e-16a234670d68 None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:17.914056 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:17.933561 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c277c-58e1-484b-93d0-11e1740fc8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:17.934423 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c277c-58e1-484b-93d0-11e1740fc8fe None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:17.934702 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c277c-58e1-484b-93d0-11e1740fc8fe None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:17.934976 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c277c-58e1-484b-93d0-11e1740fc8fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:17.941324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c277c-58e1-484b-93d0-11e1740fc8fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:17.942762 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c277c-58e1-484b-93d0-11e1740fc8fe None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:17.954254 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application [None req-ff1c277c-58e1-484b-93d0-11e1740fc8fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:09:17.954254 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:09:17.954254 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:09:17.954254 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:09:17.954254 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:09:17.954254 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:09:17.954254 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:09:17.954254 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:09:17.954254 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:09:17.954254 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:09:17.954254 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:09:17.954254 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:09:17.954254 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 02:09:17.954254 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 02:09:17.954254 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 02:09:17.955178 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 02:09:17.955178 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:09:17.955178 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:09:17.955178 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:09:17.955178 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:09:17.955178 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:09:17.955178 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:09:17.955178 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:09:17.955178 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application with Lock( Aug 08 02:09:17.955178 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:09:17.955178 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:09:17.955178 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:09:17.955178 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:09:17.955178 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:09:17.955178 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:09:17.955178 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:09:17.955178 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:09:17.958196 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 02:09:17.958196 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 02:09:17.958196 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 02:09:17.958196 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 02:09:17.958196 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 02:09:17.958196 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 02:09:17.958196 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 02:09:17.958196 dv-cinder-740146-18-smb devstack@keystone.service[80637]: ERROR keystone.server.flask.application Aug 08 02:09:17.959347 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 642/1285] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 02:09:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:09:17.961741 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715dd0f-603a-452c-8de5-b8843b292ad1 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:18.009983 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:18.058036 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715dd0f-603a-452c-8de5-b8843b292ad1 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:18.090091 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab8d48-05b6-4942-942a-68afa7dfd1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:18.090681 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab8d48-05b6-4942-942a-68afa7dfd1a2 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:18.090961 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab8d48-05b6-4942-942a-68afa7dfd1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:18.091234 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab8d48-05b6-4942-942a-68afa7dfd1a2 None admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:18.091943 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab8d48-05b6-4942-942a-68afa7dfd1a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:09:18.092314 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab8d48-05b6-4942-942a-68afa7dfd1a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:18.093651 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab8d48-05b6-4942-942a-68afa7dfd1a2 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:18.106317 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 644/1286] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 02:09:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:09:18.111922 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c277c-58e1-484b-93d0-11e1740fc8fe None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:18.207876 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c277c-58e1-484b-93d0-11e1740fc8fe None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:18.241185 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0b98c-01a9-4a82-a16b-088df0aef1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:18.241773 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0b98c-01a9-4a82-a16b-088df0aef1f7 None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:18.242059 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0b98c-01a9-4a82-a16b-088df0aef1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:18.242335 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0b98c-01a9-4a82-a16b-088df0aef1f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:18.243044 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0b98c-01a9-4a82-a16b-088df0aef1f7 None admin] RBAC: Adding query filter params (role.id=84da65a75e544d1191ec53cb6b05aa73, scope.project.id=ebe178f5bce64a009bf690031676c89f, user.id=43a39dd539974180a8165e34de57b552) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:09:18.243378 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0b98c-01a9-4a82-a16b-088df0aef1f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:18.244797 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0b98c-01a9-4a82-a16b-088df0aef1f7 None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:18.250324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 643/1287] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 02:09:18 2022] GET /identity/v3/role_assignments?user.id=43a39dd539974180a8165e34de57b552&scope.project.id=ebe178f5bce64a009bf690031676c89f&role.id=84da65a75e544d1191ec53cb6b05aa73 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:09:20.243097 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d548c-e077-4a64-b65e-972e798daa39 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:20.243714 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d548c-e077-4a64-b65e-972e798daa39 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:20.243714 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d548c-e077-4a64-b65e-972e798daa39 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:20.245016 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 645/1288] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:09:20.250272 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca9bb4-9a16-435d-a448-574fce945284 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:20.250709 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca9bb4-9a16-435d-a448-574fce945284 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:20.250848 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca9bb4-9a16-435d-a448-574fce945284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:20.268471 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-f5ca9bb4-9a16-435d-a448-574fce945284 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:09:20.269650 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-f5ca9bb4-9a16-435d-a448-574fce945284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:20.298051 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:20.333401 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 644/1289] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:09:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:09:20.356282 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d548c-e077-4a64-b65e-972e798daa39 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:20.453989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d548c-e077-4a64-b65e-972e798daa39 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:20.464915 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:20.486373 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c034fc-d090-42d9-b2d6-801ea40317c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:20.486981 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c034fc-d090-42d9-b2d6-801ea40317c2 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:20.487260 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c034fc-d090-42d9-b2d6-801ea40317c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:20.487562 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c034fc-d090-42d9-b2d6-801ea40317c2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:20.488132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c034fc-d090-42d9-b2d6-801ea40317c2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:20.489506 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c034fc-d090-42d9-b2d6-801ea40317c2 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:20.498312 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-a6c034fc-d090-42d9-b2d6-801ea40317c2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 02:09:20.498312 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:09:20.498312 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:09:20.498312 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:09:20.498312 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:09:20.498312 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:09:20.498312 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:09:20.498312 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:09:20.498312 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 02:09:20.498312 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:09:20.498312 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:09:20.498312 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:09:20.498312 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:09:20.498312 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:09:20.498312 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:09:20.498312 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:09:20.498312 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:09:20.499591 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:09:20.499591 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:09:20.499591 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:09:20.499591 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:09:20.499591 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:09:20.499591 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:09:20.499591 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:09:20.499591 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:09:20.499591 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:09:20.499591 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:09:20.499591 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:09:20.499591 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:09:20.499591 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:09:20.499591 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:09:20.499591 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:09:20.499591 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:09:20.500655 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:09:20.500655 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:09:20.500655 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:09:20.500655 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:09:20.500655 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:09:20.500655 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:09:20.500655 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:09:20.500655 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:09:20.500655 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:09:20.500655 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:09:20.500655 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:09:20.500655 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:09:20.500655 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 02:09:20.500655 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:09:20.503503 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 646/1290] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Aug 8 02:09:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:09:20.505431 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca9bb4-9a16-435d-a448-574fce945284 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:20.600816 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca9bb4-9a16-435d-a448-574fce945284 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:20.634210 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562d207-205d-4e44-ae6b-aa5abc7a453e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:20.634943 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562d207-205d-4e44-ae6b-aa5abc7a453e None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:20.635228 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562d207-205d-4e44-ae6b-aa5abc7a453e None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:20.635529 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562d207-205d-4e44-ae6b-aa5abc7a453e None admin] PATH_INFO: `/v3/services` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:20.636154 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562d207-205d-4e44-ae6b-aa5abc7a453e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:09:20.636460 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562d207-205d-4e44-ae6b-aa5abc7a453e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:20.637820 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562d207-205d-4e44-ae6b-aa5abc7a453e None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:20.642515 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 645/1291] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Aug 8 02:09:20 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:09:20.648262 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c034fc-d090-42d9-b2d6-801ea40317c2 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:20.748931 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c034fc-d090-42d9-b2d6-801ea40317c2 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:20.781248 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf96086-dada-4191-98b5-13180f414432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:20.781848 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf96086-dada-4191-98b5-13180f414432 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:20.782133 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf96086-dada-4191-98b5-13180f414432 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:20.782487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf96086-dada-4191-98b5-13180f414432 None admin] PATH_INFO: `/v3/services` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:20.783113 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf96086-dada-4191-98b5-13180f414432 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:09:20.783521 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf96086-dada-4191-98b5-13180f414432 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:20.784869 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf96086-dada-4191-98b5-13180f414432 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:20.789672 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 647/1292] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Aug 8 02:09:20 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:09:22.763799 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404bbbb-c91e-44a8-a76c-5bae50259198 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:22.764398 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404bbbb-c91e-44a8-a76c-5bae50259198 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:22.764398 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404bbbb-c91e-44a8-a76c-5bae50259198 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:22.765686 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 646/1293] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:09:22.771067 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef12b4-c9cb-42ae-a778-27c59bed885c None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:22.771534 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef12b4-c9cb-42ae-a778-27c59bed885c None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:22.771717 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef12b4-c9cb-42ae-a778-27c59bed885c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:22.789510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-69ef12b4-c9cb-42ae-a778-27c59bed885c None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:09:22.790685 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-69ef12b4-c9cb-42ae-a778-27c59bed885c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:22.825409 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:22.867773 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 648/1294] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:09:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:09:22.890712 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404bbbb-c91e-44a8-a76c-5bae50259198 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:22.920806 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:22.988322 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404bbbb-c91e-44a8-a76c-5bae50259198 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:23.020770 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db711579-c002-4d79-8faf-97d0914be85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:23.021300 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db711579-c002-4d79-8faf-97d0914be85c None admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:23.021581 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db711579-c002-4d79-8faf-97d0914be85c None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:23.021932 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db711579-c002-4d79-8faf-97d0914be85c None admin] PATH_INFO: `/v3/services` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:23.022525 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db711579-c002-4d79-8faf-97d0914be85c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:23.023913 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db711579-c002-4d79-8faf-97d0914be85c None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:23.204742 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 647/1295] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Aug 8 02:09:22 2022] POST /identity/v3/services => generated 246 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:09:25.172714 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3050b-4bfc-4a29-802b-0d7b5fd6fa6a None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:25.173249 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3050b-4bfc-4a29-802b-0d7b5fd6fa6a None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:25.173249 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3050b-4bfc-4a29-802b-0d7b5fd6fa6a None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:25.174598 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 649/1296] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:09:25.179891 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b7f85-beee-49af-8641-3fdca3b1ccb5 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:25.180336 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b7f85-beee-49af-8641-3fdca3b1ccb5 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:25.180440 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b7f85-beee-49af-8641-3fdca3b1ccb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:25.198124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-626b7f85-beee-49af-8641-3fdca3b1ccb5 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:09:25.199294 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-626b7f85-beee-49af-8641-3fdca3b1ccb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:25.275021 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 648/1297] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:09:25 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:09:25.297285 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3050b-4bfc-4a29-802b-0d7b5fd6fa6a None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:25.398641 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3050b-4bfc-4a29-802b-0d7b5fd6fa6a None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:25.431402 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2a651-548d-43aa-91c6-b2d936562452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:25.431972 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2a651-548d-43aa-91c6-b2d936562452 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:25.432256 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2a651-548d-43aa-91c6-b2d936562452 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:25.432534 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2a651-548d-43aa-91c6-b2d936562452 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:25.433111 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae2a651-548d-43aa-91c6-b2d936562452 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:25.434736 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae2a651-548d-43aa-91c6-b2d936562452 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:25.443506 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-dae2a651-548d-43aa-91c6-b2d936562452 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 02:09:25.443506 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:09:25.443506 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:09:25.443506 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:09:25.443506 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:09:25.443506 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:09:25.443506 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:09:25.443506 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:09:25.443506 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 02:09:25.443506 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:09:25.443506 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:09:25.443506 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:09:25.443506 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:09:25.443506 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:09:25.443506 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:09:25.443506 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:09:25.443506 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:09:25.447038 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:09:25.447038 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:09:25.447038 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:09:25.447038 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:09:25.447038 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:09:25.447038 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:09:25.447038 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:09:25.447038 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:09:25.447038 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:09:25.447038 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:09:25.447038 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:09:25.447038 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:09:25.447038 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:09:25.447038 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:09:25.447038 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:09:25.447038 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:09:25.448132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:09:25.448132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:09:25.448132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:09:25.448132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:09:25.448132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:09:25.448132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:09:25.448132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:09:25.448132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:09:25.448132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:09:25.448132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:09:25.448132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:09:25.448132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:09:25.448132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 02:09:25.448132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:09:25.448132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 650/1298] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Aug 8 02:09:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:09:25.451531 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b7f85-beee-49af-8641-3fdca3b1ccb5 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:25.470333 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:25.545583 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b7f85-beee-49af-8641-3fdca3b1ccb5 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:25.579988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9537e5b-83e1-4ae1-a0a0-0c60743ac52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:25.580587 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9537e5b-83e1-4ae1-a0a0-0c60743ac52d None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:25.580863 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9537e5b-83e1-4ae1-a0a0-0c60743ac52d None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:25.581133 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9537e5b-83e1-4ae1-a0a0-0c60743ac52d None admin] PATH_INFO: `/v3/services` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:25.581861 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9537e5b-83e1-4ae1-a0a0-0c60743ac52d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:09:25.582164 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9537e5b-83e1-4ae1-a0a0-0c60743ac52d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:25.583606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9537e5b-83e1-4ae1-a0a0-0c60743ac52d None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:25.589970 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 649/1299] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Aug 8 02:09:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:09:25.595315 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2a651-548d-43aa-91c6-b2d936562452 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:25.626074 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:25.691691 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2a651-548d-43aa-91c6-b2d936562452 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:25.724837 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d9b30-21c7-4f2d-a1a9-fca34deba4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:25.725426 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d9b30-21c7-4f2d-a1a9-fca34deba4c5 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:25.725704 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d9b30-21c7-4f2d-a1a9-fca34deba4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:25.725974 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d9b30-21c7-4f2d-a1a9-fca34deba4c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:25.726664 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52d9b30-21c7-4f2d-a1a9-fca34deba4c5 None admin] RBAC: Adding query filter params (interface=public, service_id=34f381f006ad4e4c95ffb0a3fa324f38, region_id=RegionOne) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:09:25.726970 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52d9b30-21c7-4f2d-a1a9-fca34deba4c5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:25.728340 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52d9b30-21c7-4f2d-a1a9-fca34deba4c5 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:25.733407 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 651/1300] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Aug 8 02:09:25 2022] GET /identity/v3/endpoints?service_id=34f381f006ad4e4c95ffb0a3fa324f38&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:09:25.738818 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9537e5b-83e1-4ae1-a0a0-0c60743ac52d None admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:25.819944 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:25.837538 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9537e5b-83e1-4ae1-a0a0-0c60743ac52d None admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:25.870093 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f839ccd-306c-4fe2-917b-a7a843daf6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:25.870693 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f839ccd-306c-4fe2-917b-a7a843daf6de None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:25.870973 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f839ccd-306c-4fe2-917b-a7a843daf6de None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:25.871271 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f839ccd-306c-4fe2-917b-a7a843daf6de None admin] PATH_INFO: `/v3/services` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:25.871888 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f839ccd-306c-4fe2-917b-a7a843daf6de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:25.873253 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f839ccd-306c-4fe2-917b-a7a843daf6de None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:25.879875 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 650/1301] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Aug 8 02:09:25 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:09:27.899896 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161d39a-040c-4c98-ae1d-86dccdbb35d2 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:27.900439 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161d39a-040c-4c98-ae1d-86dccdbb35d2 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:27.900439 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161d39a-040c-4c98-ae1d-86dccdbb35d2 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:27.901790 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 652/1302] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:09:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:09:27.907019 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1a07c-9a29-49c5-932c-3582b0088a32 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:27.907447 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1a07c-9a29-49c5-932c-3582b0088a32 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:27.907609 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1a07c-9a29-49c5-932c-3582b0088a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:27.925225 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-22b1a07c-9a29-49c5-932c-3582b0088a32 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:09:27.926401 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-22b1a07c-9a29-49c5-932c-3582b0088a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:09:27.993549 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 651/1303] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:09:27 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 02:09:28.016597 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8161d39a-040c-4c98-ae1d-86dccdbb35d2 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:28.108637 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:28.115115 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8161d39a-040c-4c98-ae1d-86dccdbb35d2 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:28.152629 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d77ff-ab94-4728-b63a-4c189905fad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:28.153465 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d77ff-ab94-4728-b63a-4c189905fad1 None admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:28.153741 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d77ff-ab94-4728-b63a-4c189905fad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:28.154010 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d77ff-ab94-4728-b63a-4c189905fad1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:28.154584 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d77ff-ab94-4728-b63a-4c189905fad1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:28.155999 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d77ff-ab94-4728-b63a-4c189905fad1 None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:28.164625 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application [None req-ac5d77ff-ab94-4728-b63a-4c189905fad1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 02:09:28.164625 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:09:28.164625 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 02:09:28.164625 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 02:09:28.164625 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 02:09:28.164625 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 02:09:28.164625 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 02:09:28.164625 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:09:28.164625 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 02:09:28.164625 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:09:28.164625 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 02:09:28.164625 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:09:28.164625 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 02:09:28.164625 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 02:09:28.164625 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 02:09:28.164625 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 02:09:28.164625 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 02:09:28.165799 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 02:09:28.165799 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 02:09:28.165799 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 02:09:28.165799 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 02:09:28.165799 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 02:09:28.165799 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 02:09:28.165799 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 02:09:28.165799 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 02:09:28.165799 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 02:09:28.165799 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 02:09:28.165799 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 02:09:28.165799 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 02:09:28.165799 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 02:09:28.165799 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 02:09:28.165799 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 02:09:28.165799 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 02:09:28.166994 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 02:09:28.166994 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application with Lock( Aug 08 02:09:28.166994 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 02:09:28.166994 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self._enter() Aug 08 02:09:28.166994 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 02:09:28.166994 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 02:09:28.166994 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 02:09:28.166994 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application return self.creator() Aug 08 02:09:28.166994 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 02:09:28.166994 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application created_value = creator( Aug 08 02:09:28.166994 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 02:09:28.166994 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 02:09:28.166994 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 02:09:28.166994 dv-cinder-740146-18-smb devstack@keystone.service[80638]: ERROR keystone.server.flask.application Aug 08 02:09:28.166994 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 653/1304] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Aug 8 02:09:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 02:09:28.171874 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1a07c-9a29-49c5-932c-3582b0088a32 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:28.246198 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:28.267655 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1a07c-9a29-49c5-932c-3582b0088a32 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:28.299985 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5e67c-c242-42bf-87b4-ef8d9cc66bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:28.300581 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5e67c-c242-42bf-87b4-ef8d9cc66bca None admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:28.300861 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5e67c-c242-42bf-87b4-ef8d9cc66bca None admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:28.301161 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5e67c-c242-42bf-87b4-ef8d9cc66bca None admin] PATH_INFO: `/v3/services` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:28.301778 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5e67c-c242-42bf-87b4-ef8d9cc66bca None admin] RBAC: Adding query filter params (name=placement) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:09:28.302079 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5e67c-c242-42bf-87b4-ef8d9cc66bca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:28.304038 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5e67c-c242-42bf-87b4-ef8d9cc66bca None admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:28.309251 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 652/1305] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Aug 8 02:09:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:09:28.315046 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d77ff-ab94-4728-b63a-4c189905fad1 None admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:09:28.409600 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d77ff-ab94-4728-b63a-4c189905fad1 None admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:09:28.442821 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15343d71-c9f0-484d-9276-a6972958f50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:09:28.443441 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15343d71-c9f0-484d-9276-a6972958f50b None admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:09:28.444214 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15343d71-c9f0-484d-9276-a6972958f50b None admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:09:28.444485 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15343d71-c9f0-484d-9276-a6972958f50b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:09:28.445133 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15343d71-c9f0-484d-9276-a6972958f50b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:09:28.446588 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15343d71-c9f0-484d-9276-a6972958f50b None admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:09:28.537042 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 654/1306] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:09:28 2022] POST /identity/v3/endpoints => generated 331 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:09:38.322105 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=30 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:09:38.532007 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:17:01.993439 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e8f8c-d72c-4956-bf4a-8df81cb2d3a4 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:01.993912 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e8f8c-d72c-4956-bf4a-8df81cb2d3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:01.993999 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e8f8c-d72c-4956-bf4a-8df81cb2d3a4 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:02.000792 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff172720-0016-45eb-8cc5-4405845b3f48 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:02.001908 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff172720-0016-45eb-8cc5-4405845b3f48 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:02.002432 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff172720-0016-45eb-8cc5-4405845b3f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:02.004803 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 653/1307] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:17:01 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:17:02.113752 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-ff172720-0016-45eb-8cc5-4405845b3f48 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:17:02.113752 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-ff172720-0016-45eb-8cc5-4405845b3f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:02.304198 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 655/1308] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:17:02.353181 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ab388-b53e-48c0-9959-a98d1953b191 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:02.353470 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ab388-b53e-48c0-9959-a98d1953b191 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:02.353920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ab388-b53e-48c0-9959-a98d1953b191 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:02.355902 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 654/1309] 10.222.0.23 () {54 vars in 965 bytes} [Mon Aug 8 02:17:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:17:02.363558 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d086f16-f598-45a8-821b-b2531cc15936 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:02.363977 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d086f16-f598-45a8-821b-b2531cc15936 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:02.364398 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d086f16-f598-45a8-821b-b2531cc15936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:02.506831 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-2d086f16-f598-45a8-821b-b2531cc15936 None None] MFA Rules not processed for user `fa4c5732acb844369140e8d970577f94`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:17:02.508062 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-2d086f16-f598-45a8-821b-b2531cc15936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:02.532909 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:17:02.620732 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ab388-b53e-48c0-9959-a98d1953b191 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:17:02.622638 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-806ab388-b53e-48c0-9959-a98d1953b191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:02.631746 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 656/1310] 10.222.0.23 () {58 vars in 1062 bytes} [Mon Aug 8 02:17:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:17:02.744649 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ab388-b53e-48c0-9959-a98d1953b191 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:17:02.831688 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25182f8-b4d8-4240-9684-d42ab788cc8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:17:02.832657 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25182f8-b4d8-4240-9684-d42ab788cc8e service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:02.833112 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25182f8-b4d8-4240-9684-d42ab788cc8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:02.833565 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25182f8-b4d8-4240-9684-d42ab788cc8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:02.835659 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-a25182f8-b4d8-4240-9684-d42ab788cc8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:02.906520 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:17:02.974958 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25182f8-b4d8-4240-9684-d42ab788cc8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:17:02.976732 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25182f8-b4d8-4240-9684-d42ab788cc8e service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:17:02.998894 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 655/1311] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:17:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:17:05.403389 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ec759-e313-4f8f-b403-24674d6ffae9 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:05.403914 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ec759-e313-4f8f-b403-24674d6ffae9 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:05.404012 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ec759-e313-4f8f-b403-24674d6ffae9 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:05.405794 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 657/1312] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:17:05.411150 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bba1e-d9d0-41d9-a99d-cb121ad489f3 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:05.411565 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bba1e-d9d0-41d9-a99d-cb121ad489f3 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:05.411874 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bba1e-d9d0-41d9-a99d-cb121ad489f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:05.481741 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-3c6bba1e-d9d0-41d9-a99d-cb121ad489f3 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:17:05.483565 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-3c6bba1e-d9d0-41d9-a99d-cb121ad489f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:05.582660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 656/1313] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:17:05.623413 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ec759-e313-4f8f-b403-24674d6ffae9 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:17:05.625092 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-485ec759-e313-4f8f-b403-24674d6ffae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:05.736108 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ec759-e313-4f8f-b403-24674d6ffae9 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:17:05.807729 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:17:05.810006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199cd0b-8c42-4eea-997c-e2fbd910944b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:17:05.811134 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199cd0b-8c42-4eea-997c-e2fbd910944b service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:05.811448 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199cd0b-8c42-4eea-997c-e2fbd910944b service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:05.811723 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199cd0b-8c42-4eea-997c-e2fbd910944b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:05.813297 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-e199cd0b-8c42-4eea-997c-e2fbd910944b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:05.921754 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e199cd0b-8c42-4eea-997c-e2fbd910944b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:17:05.923203 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e199cd0b-8c42-4eea-997c-e2fbd910944b service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:17:05.941490 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 658/1314] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:17:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:17:08.449716 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be964828-3bab-4337-9a75-d5b6f9f9146c None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:08.450257 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be964828-3bab-4337-9a75-d5b6f9f9146c None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:08.450257 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be964828-3bab-4337-9a75-d5b6f9f9146c None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:08.452283 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 657/1315] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:17:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:17:08.457385 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f1635-c163-4d78-a20c-8737a3394d18 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:08.457793 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f1635-c163-4d78-a20c-8737a3394d18 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:08.457936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f1635-c163-4d78-a20c-8737a3394d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:08.521994 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-ba6f1635-c163-4d78-a20c-8737a3394d18 None None] MFA Rules not processed for user `450125842ade4df78abacc89d27d87bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:17:08.523186 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-ba6f1635-c163-4d78-a20c-8737a3394d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:08.573230 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:17:08.615867 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 659/1316] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:17:08 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:17:08.655389 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be964828-3bab-4337-9a75-d5b6f9f9146c None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:17:08.657389 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-be964828-3bab-4337-9a75-d5b6f9f9146c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:08.671571 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:17:08.762390 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be964828-3bab-4337-9a75-d5b6f9f9146c None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:17:08.834442 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc895259-d290-4eab-8d61-0b98adecfca1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:17:08.835046 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc895259-d290-4eab-8d61-0b98adecfca1 service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:08.835336 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc895259-d290-4eab-8d61-0b98adecfca1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:08.835709 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc895259-d290-4eab-8d61-0b98adecfca1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:08.837308 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-dc895259-d290-4eab-8d61-0b98adecfca1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:08.898532 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:17:08.944756 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc895259-d290-4eab-8d61-0b98adecfca1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:17:08.946178 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc895259-d290-4eab-8d61-0b98adecfca1 service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:17:08.963919 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 658/1317] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:17:08 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:17:11.821177 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379de006-b546-4c8e-b3cf-acca761f4a99 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:11.821718 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379de006-b546-4c8e-b3cf-acca761f4a99 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:11.821718 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379de006-b546-4c8e-b3cf-acca761f4a99 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:11.823077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 660/1318] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:17:11.828270 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f00ae3-04a5-4145-9929-ec72b3502317 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:11.828640 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f00ae3-04a5-4145-9929-ec72b3502317 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:11.828824 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f00ae3-04a5-4145-9929-ec72b3502317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:11.895894 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-b0f00ae3-04a5-4145-9929-ec72b3502317 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:17:11.897112 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-b0f00ae3-04a5-4145-9929-ec72b3502317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:11.989797 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 659/1319] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:17:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:17:12.028139 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379de006-b546-4c8e-b3cf-acca761f4a99 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:17:12.030206 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-379de006-b546-4c8e-b3cf-acca761f4a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:12.129926 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379de006-b546-4c8e-b3cf-acca761f4a99 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:17:12.203334 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda6f34-4652-4a22-8157-ff8bde84286f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:17:12.203955 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda6f34-4652-4a22-8157-ff8bde84286f service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:12.204237 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda6f34-4652-4a22-8157-ff8bde84286f service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:12.204508 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda6f34-4652-4a22-8157-ff8bde84286f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:12.206105 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-9eda6f34-4652-4a22-8157-ff8bde84286f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:12.213383 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:17:12.311016 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda6f34-4652-4a22-8157-ff8bde84286f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:17:12.312465 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda6f34-4652-4a22-8157-ff8bde84286f service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:17:12.330503 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 661/1320] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:17:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:17:15.359376 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd22639-5f7a-4c8d-ab46-167b3c6a7b96 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:15.359973 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd22639-5f7a-4c8d-ab46-167b3c6a7b96 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:15.359973 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd22639-5f7a-4c8d-ab46-167b3c6a7b96 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:15.361297 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 660/1321] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:17:15.366490 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438931e5-b023-4daa-b38d-9f050be08f33 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:15.366983 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438931e5-b023-4daa-b38d-9f050be08f33 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:15.367093 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438931e5-b023-4daa-b38d-9f050be08f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:15.431937 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-438931e5-b023-4daa-b38d-9f050be08f33 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:17:15.433138 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-438931e5-b023-4daa-b38d-9f050be08f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:15.491887 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:17:15.531730 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 662/1322] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:17:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:17:15.568701 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd22639-5f7a-4c8d-ab46-167b3c6a7b96 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:17:15.570334 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-4bd22639-5f7a-4c8d-ab46-167b3c6a7b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:15.591907 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:17:15.682353 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd22639-5f7a-4c8d-ab46-167b3c6a7b96 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:17:15.759143 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22139fbb-c80d-4322-8e2d-af0bfc144599 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:17:15.759799 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22139fbb-c80d-4322-8e2d-af0bfc144599 service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:15.760078 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22139fbb-c80d-4322-8e2d-af0bfc144599 service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:15.760350 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22139fbb-c80d-4322-8e2d-af0bfc144599 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:15.762049 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-22139fbb-c80d-4322-8e2d-af0bfc144599 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:15.836528 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:17:15.873874 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22139fbb-c80d-4322-8e2d-af0bfc144599 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:17:15.875316 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22139fbb-c80d-4322-8e2d-af0bfc144599 service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:17:15.895058 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 661/1323] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:17:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:17:17.959936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea1f91-b511-4e0e-860d-652d6c4b11de None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:17.960528 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea1f91-b511-4e0e-860d-652d6c4b11de None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:17.960528 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea1f91-b511-4e0e-860d-652d6c4b11de None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:17.961981 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 663/1324] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:17:17.967129 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bcd2e-7ccb-49af-9cb9-e0cd7ffb5699 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:17.967614 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bcd2e-7ccb-49af-9cb9-e0cd7ffb5699 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:17.967806 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bcd2e-7ccb-49af-9cb9-e0cd7ffb5699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:18.032437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-000bcd2e-7ccb-49af-9cb9-e0cd7ffb5699 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:17:18.033642 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-000bcd2e-7ccb-49af-9cb9-e0cd7ffb5699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:18.126238 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 662/1325] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:17:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:17:18.161807 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea1f91-b511-4e0e-860d-652d6c4b11de None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:17:18.163397 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-0cea1f91-b511-4e0e-860d-652d6c4b11de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:18.267859 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea1f91-b511-4e0e-860d-652d6c4b11de None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:17:18.341400 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63647b9-d768-4990-8649-e4802cf96e8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:17:18.342086 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63647b9-d768-4990-8649-e4802cf96e8a service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:18.342359 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63647b9-d768-4990-8649-e4802cf96e8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:18.342632 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63647b9-d768-4990-8649-e4802cf96e8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:18.344253 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-a63647b9-d768-4990-8649-e4802cf96e8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:18.361773 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:17:18.455145 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63647b9-d768-4990-8649-e4802cf96e8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:17:18.456719 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63647b9-d768-4990-8649-e4802cf96e8a service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:17:18.479837 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 664/1326] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:17:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:17:20.534534 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22f7db-57df-4806-b08b-858cdcce509b None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:20.535091 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22f7db-57df-4806-b08b-858cdcce509b None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:20.535091 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22f7db-57df-4806-b08b-858cdcce509b None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:20.536470 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 663/1327] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:17:20.541690 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9ac79-a2e7-4539-82d2-c54a9b922eae None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:20.542116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9ac79-a2e7-4539-82d2-c54a9b922eae None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:20.542359 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9ac79-a2e7-4539-82d2-c54a9b922eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:20.607338 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-34b9ac79-a2e7-4539-82d2-c54a9b922eae None None] MFA Rules not processed for user `450125842ade4df78abacc89d27d87bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:17:20.608553 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-34b9ac79-a2e7-4539-82d2-c54a9b922eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:20.671784 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:17:20.703625 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 665/1328] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:17:20 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:17:20.743658 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22f7db-57df-4806-b08b-858cdcce509b None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:17:20.745318 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-7a22f7db-57df-4806-b08b-858cdcce509b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:20.776376 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:17:20.847494 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22f7db-57df-4806-b08b-858cdcce509b None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:17:20.921774 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce7f41-928c-4e92-a3e6-bd25f0caf1c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:17:20.922473 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce7f41-928c-4e92-a3e6-bd25f0caf1c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:20.922817 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce7f41-928c-4e92-a3e6-bd25f0caf1c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:20.923181 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce7f41-928c-4e92-a3e6-bd25f0caf1c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:20.924814 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-dbce7f41-928c-4e92-a3e6-bd25f0caf1c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:21.003019 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:17:21.037431 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce7f41-928c-4e92-a3e6-bd25f0caf1c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:17:21.038883 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce7f41-928c-4e92-a3e6-bd25f0caf1c6 service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:17:21.057545 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 664/1329] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:17:20 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:17:23.539570 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b90d8-f6ec-45fa-8768-9ee622b1aca0 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:23.540094 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b90d8-f6ec-45fa-8768-9ee622b1aca0 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:23.540094 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b90d8-f6ec-45fa-8768-9ee622b1aca0 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:23.541542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 666/1330] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:17:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:17:23.547129 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9f5a8-7277-44a7-8499-68b9ad19ab82 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:23.547554 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9f5a8-7277-44a7-8499-68b9ad19ab82 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:23.547710 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9f5a8-7277-44a7-8499-68b9ad19ab82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:23.612259 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-ded9f5a8-7277-44a7-8499-68b9ad19ab82 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:17:23.613449 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-ded9f5a8-7277-44a7-8499-68b9ad19ab82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:23.706402 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 665/1331] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:17:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:17:23.742603 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b90d8-f6ec-45fa-8768-9ee622b1aca0 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:17:23.744246 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-2b7b90d8-f6ec-45fa-8768-9ee622b1aca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:23.846835 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b90d8-f6ec-45fa-8768-9ee622b1aca0 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:17:23.918226 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd8360-9007-45c4-9c3a-6bd3d8efecd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:17:23.918823 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd8360-9007-45c4-9c3a-6bd3d8efecd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:23.919108 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd8360-9007-45c4-9c3a-6bd3d8efecd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:23.919404 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd8360-9007-45c4-9c3a-6bd3d8efecd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:23.921046 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-24dd8360-9007-45c4-9c3a-6bd3d8efecd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:23.947472 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:17:24.027378 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dd8360-9007-45c4-9c3a-6bd3d8efecd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:17:24.028818 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dd8360-9007-45c4-9c3a-6bd3d8efecd5 service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:17:24.050354 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 667/1332] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:17:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:17:26.096441 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d5b5b-8294-4f63-ae65-4443ff746528 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:26.096994 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d5b5b-8294-4f63-ae65-4443ff746528 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:26.097090 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d5b5b-8294-4f63-ae65-4443ff746528 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:26.098364 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 666/1333] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:17:26.103499 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e692c-132b-4e12-9140-6ef38da87353 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:26.103917 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e692c-132b-4e12-9140-6ef38da87353 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:26.104063 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e692c-132b-4e12-9140-6ef38da87353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:26.169392 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-7a6e692c-132b-4e12-9140-6ef38da87353 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:17:26.170575 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-7a6e692c-132b-4e12-9140-6ef38da87353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:26.242362 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:17:26.264847 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 668/1334] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:17:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:17:26.304506 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d5b5b-8294-4f63-ae65-4443ff746528 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:17:26.306113 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-127d5b5b-8294-4f63-ae65-4443ff746528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:26.345891 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:17:26.408054 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d5b5b-8294-4f63-ae65-4443ff746528 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:17:26.478144 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe81c3b-aa21-45fb-89b6-d8bd4e6a12d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:17:26.478739 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe81c3b-aa21-45fb-89b6-d8bd4e6a12d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:26.479016 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe81c3b-aa21-45fb-89b6-d8bd4e6a12d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:26.479286 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe81c3b-aa21-45fb-89b6-d8bd4e6a12d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:26.480880 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-ebe81c3b-aa21-45fb-89b6-d8bd4e6a12d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:26.559859 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:17:26.585760 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe81c3b-aa21-45fb-89b6-d8bd4e6a12d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:17:26.587267 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe81c3b-aa21-45fb-89b6-d8bd4e6a12d5 service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:17:26.605909 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 667/1335] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:17:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:17:29.480904 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44036eb-d9b6-4313-ad1a-bc795e908b15 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:29.481418 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44036eb-d9b6-4313-ad1a-bc795e908b15 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:29.481418 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44036eb-d9b6-4313-ad1a-bc795e908b15 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:29.482773 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 669/1336] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:17:29.487867 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849451c-e8ba-42af-90ae-faf5386d46a0 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:29.488263 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849451c-e8ba-42af-90ae-faf5386d46a0 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:29.488425 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849451c-e8ba-42af-90ae-faf5386d46a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:29.554698 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-a849451c-e8ba-42af-90ae-faf5386d46a0 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:17:29.555916 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-a849451c-e8ba-42af-90ae-faf5386d46a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:29.649101 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 668/1337] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:17:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:17:29.686117 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44036eb-d9b6-4313-ad1a-bc795e908b15 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:17:29.687682 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-e44036eb-d9b6-4313-ad1a-bc795e908b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:29.787900 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44036eb-d9b6-4313-ad1a-bc795e908b15 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:17:29.859641 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f491e3f-07df-4f3c-9661-b0f1a953b0c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:17:29.860233 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f491e3f-07df-4f3c-9661-b0f1a953b0c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:29.860512 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f491e3f-07df-4f3c-9661-b0f1a953b0c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:29.860785 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f491e3f-07df-4f3c-9661-b0f1a953b0c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:29.862380 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-5f491e3f-07df-4f3c-9661-b0f1a953b0c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:29.896876 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:17:29.968251 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f491e3f-07df-4f3c-9661-b0f1a953b0c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:17:29.969668 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f491e3f-07df-4f3c-9661-b0f1a953b0c3 service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:17:29.987504 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 670/1338] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:17:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:17:34.131546 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0af36-71dd-4c6f-972f-b67dac67edfd None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:34.132548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0af36-71dd-4c6f-972f-b67dac67edfd None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:34.132548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0af36-71dd-4c6f-972f-b67dac67edfd None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:34.133445 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 669/1339] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:17:34.139102 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0c7f7-5c9a-42db-888c-44117e3ca4c8 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:34.139525 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0c7f7-5c9a-42db-888c-44117e3ca4c8 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:34.139692 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0c7f7-5c9a-42db-888c-44117e3ca4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:34.207634 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-75a0c7f7-5c9a-42db-888c-44117e3ca4c8 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:17:34.208952 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-75a0c7f7-5c9a-42db-888c-44117e3ca4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:34.292965 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:17:34.304487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 671/1340] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:17:34.344249 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0af36-71dd-4c6f-972f-b67dac67edfd None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:17:34.345819 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-0dd0af36-71dd-4c6f-972f-b67dac67edfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:34.397240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:17:34.453134 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0af36-71dd-4c6f-972f-b67dac67edfd None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:17:34.527901 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51bcab7-8f0a-4ba6-abca-b182d317d2a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:17:34.528697 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bcab7-8f0a-4ba6-abca-b182d317d2a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:34.529502 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bcab7-8f0a-4ba6-abca-b182d317d2a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:34.529784 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bcab7-8f0a-4ba6-abca-b182d317d2a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:34.531526 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-b51bcab7-8f0a-4ba6-abca-b182d317d2a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:34.624485 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:17:34.641010 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51bcab7-8f0a-4ba6-abca-b182d317d2a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:17:34.642669 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51bcab7-8f0a-4ba6-abca-b182d317d2a3 service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:17:34.660864 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 670/1341] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:17:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:17:37.709186 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e3249-a21c-419d-acc7-149f0c3c3887 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:37.709752 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e3249-a21c-419d-acc7-149f0c3c3887 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:37.709752 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e3249-a21c-419d-acc7-149f0c3c3887 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:37.711112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 672/1342] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:17:37.716395 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a751b-254b-4fbf-8338-50758e678b00 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:37.716865 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a751b-254b-4fbf-8338-50758e678b00 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:37.716980 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a751b-254b-4fbf-8338-50758e678b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:37.784568 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-463a751b-254b-4fbf-8338-50758e678b00 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:17:37.784568 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-463a751b-254b-4fbf-8338-50758e678b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:37.881925 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 671/1343] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:17:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:17:37.919414 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e3249-a21c-419d-acc7-149f0c3c3887 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:17:37.921509 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-c98e3249-a21c-419d-acc7-149f0c3c3887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:38.025440 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e3249-a21c-419d-acc7-149f0c3c3887 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:17:38.100623 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d3429-e602-44a8-ab69-ae10143181fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:17:38.101225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d3429-e602-44a8-ab69-ae10143181fb service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:38.101507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d3429-e602-44a8-ab69-ae10143181fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:38.101784 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d3429-e602-44a8-ab69-ae10143181fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:38.103405 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-ac5d3429-e602-44a8-ab69-ae10143181fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:38.154644 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:17:38.220913 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d3429-e602-44a8-ab69-ae10143181fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:17:38.222371 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d3429-e602-44a8-ab69-ae10143181fb service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:17:38.240572 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 673/1344] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:17:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:17:42.420720 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630319d-eab3-4604-b2c4-18a1406579f9 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:42.421282 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630319d-eab3-4604-b2c4-18a1406579f9 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:42.421427 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630319d-eab3-4604-b2c4-18a1406579f9 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:42.422872 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 672/1345] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:17:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:17:42.428374 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a086b-6432-4b8d-b573-9cd3c81206e5 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:42.428868 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a086b-6432-4b8d-b573-9cd3c81206e5 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:42.428961 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a086b-6432-4b8d-b573-9cd3c81206e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:42.499734 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-8d5a086b-6432-4b8d-b573-9cd3c81206e5 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:17:42.500969 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-8d5a086b-6432-4b8d-b573-9cd3c81206e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:42.601763 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:17:42.604439 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 674/1346] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:17:42.675511 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630319d-eab3-4604-b2c4-18a1406579f9 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:17:42.675511 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-0630319d-eab3-4604-b2c4-18a1406579f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:42.707236 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:17:42.762016 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630319d-eab3-4604-b2c4-18a1406579f9 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:17:42.838304 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c82fd-f70d-4371-9dd2-7d2c73a6652d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:17:42.838914 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c82fd-f70d-4371-9dd2-7d2c73a6652d service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:42.839205 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c82fd-f70d-4371-9dd2-7d2c73a6652d service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:42.839516 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c82fd-f70d-4371-9dd2-7d2c73a6652d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:42.841273 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-602c82fd-f70d-4371-9dd2-7d2c73a6652d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:42.959423 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:17:42.962948 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c82fd-f70d-4371-9dd2-7d2c73a6652d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:17:42.964426 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c82fd-f70d-4371-9dd2-7d2c73a6652d service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:17:42.982349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 673/1347] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:17:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:17:48.006914 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46f1cd-c4d3-45cc-b1ad-1bca064c6c5f None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:48.007434 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46f1cd-c4d3-45cc-b1ad-1bca064c6c5f None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:48.007434 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46f1cd-c4d3-45cc-b1ad-1bca064c6c5f None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:48.009106 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 675/1348] 10.222.0.23 () {54 vars in 921 bytes} [Mon Aug 8 02:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:17:48.014887 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69831214-8efc-4247-abe3-cc0385f3a17f None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:48.015292 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69831214-8efc-4247-abe3-cc0385f3a17f None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:48.019380 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69831214-8efc-4247-abe3-cc0385f3a17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:48.104616 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-69831214-8efc-4247-abe3-cc0385f3a17f None None] MFA Rules not processed for user `43a39dd539974180a8165e34de57b552`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:17:48.105825 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-69831214-8efc-4247-abe3-cc0385f3a17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:48.223322 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 674/1349] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Aug 8 02:17:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:17:52.111473 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4bc24-0f89-4306-b107-6a38c1add3bd None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:52.112054 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4bc24-0f89-4306-b107-6a38c1add3bd None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:52.112054 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4bc24-0f89-4306-b107-6a38c1add3bd None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:52.113512 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 676/1350] 10.222.0.23 () {54 vars in 921 bytes} [Mon Aug 8 02:17:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:17:52.118337 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03902a67-0708-4056-9ada-bcd84d871f7a None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:52.118824 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03902a67-0708-4056-9ada-bcd84d871f7a None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:52.119211 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03902a67-0708-4056-9ada-bcd84d871f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:52.173155 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:17:52.196211 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-03902a67-0708-4056-9ada-bcd84d871f7a None None] MFA Rules not processed for user `43a39dd539974180a8165e34de57b552`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:17:52.197594 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-03902a67-0708-4056-9ada-bcd84d871f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:52.309752 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 675/1351] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Aug 8 02:17:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:17:53.838617 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1269ae-b435-4476-a522-834d3629b8fe None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:53.839206 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1269ae-b435-4476-a522-834d3629b8fe None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:53.839206 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1269ae-b435-4476-a522-834d3629b8fe None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:53.840550 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 677/1352] 10.222.0.23 () {54 vars in 921 bytes} [Mon Aug 8 02:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:17:53.846035 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3c74e-f8cd-4a26-bb6c-faf3b13f7f1b None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:53.846475 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3c74e-f8cd-4a26-bb6c-faf3b13f7f1b None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:53.846589 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3c74e-f8cd-4a26-bb6c-faf3b13f7f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:53.924063 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-d0d3c74e-f8cd-4a26-bb6c-faf3b13f7f1b None None] MFA Rules not processed for user `43a39dd539974180a8165e34de57b552`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:17:53.925287 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-d0d3c74e-f8cd-4a26-bb6c-faf3b13f7f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:53.968421 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:17:54.034710 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 676/1353] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Aug 8 02:17:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:17:57.518330 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad31a53-2bdc-49a7-a1ca-d66a95103cde None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:57.519202 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad31a53-2bdc-49a7-a1ca-d66a95103cde None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:57.519679 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad31a53-2bdc-49a7-a1ca-d66a95103cde None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:57.525145 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 678/1354] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:17:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:17:57.526817 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d286d5f-ad18-4437-ae64-7610c8c31a1e None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:57.527237 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d286d5f-ad18-4437-ae64-7610c8c31a1e None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:57.527667 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d286d5f-ad18-4437-ae64-7610c8c31a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:57.605610 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-3d286d5f-ad18-4437-ae64-7610c8c31a1e None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:17:57.607518 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-3d286d5f-ad18-4437-ae64-7610c8c31a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:57.717075 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 677/1355] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:17:57.772076 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05322d50-c1f5-4b4d-b9dd-e12117e39d2f None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:57.777014 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05322d50-c1f5-4b4d-b9dd-e12117e39d2f None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:57.777014 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05322d50-c1f5-4b4d-b9dd-e12117e39d2f None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:57.777014 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 679/1356] 10.222.0.23 () {54 vars in 962 bytes} [Mon Aug 8 02:17:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:17:57.781471 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbd768-b011-47d0-be13-ec741973b7aa None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:57.781763 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbd768-b011-47d0-be13-ec741973b7aa None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:57.782034 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbd768-b011-47d0-be13-ec741973b7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:57.799078 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:17:57.864790 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-c0dbd768-b011-47d0-be13-ec741973b7aa None None] MFA Rules not processed for user `5d89e0c7d62444e4b75d3f4da49b2bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:17:57.866252 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-c0dbd768-b011-47d0-be13-ec741973b7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:57.989261 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 678/1357] 10.222.0.23 () {58 vars in 1059 bytes} [Mon Aug 8 02:17:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:17:57.998904 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05322d50-c1f5-4b4d-b9dd-e12117e39d2f None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:17:58.001101 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-05322d50-c1f5-4b4d-b9dd-e12117e39d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:58.165788 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05322d50-c1f5-4b4d-b9dd-e12117e39d2f None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:17:58.242071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:17:58.290237 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0a7f5-95fb-41ed-ad5b-68e661bd564b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:17:58.290982 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0a7f5-95fb-41ed-ad5b-68e661bd564b service nova] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:17:58.291548 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0a7f5-95fb-41ed-ad5b-68e661bd564b service nova] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:17:58.291788 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0a7f5-95fb-41ed-ad5b-68e661bd564b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:17:58.293551 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-98c0a7f5-95fb-41ed-ad5b-68e661bd564b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:17:58.395417 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0a7f5-95fb-41ed-ad5b-68e661bd564b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:17:58.397096 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0a7f5-95fb-41ed-ad5b-68e661bd564b service nova] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:17:58.416309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 680/1358] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:17:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:18:00.637449 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db56a1-59f1-40fd-9a54-2ad34ce609c2 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:00.637974 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db56a1-59f1-40fd-9a54-2ad34ce609c2 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:00.637974 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db56a1-59f1-40fd-9a54-2ad34ce609c2 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:00.639835 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 679/1359] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:00.645300 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83881dfb-1c80-4057-9c4a-4860c68887cc None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:00.645795 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83881dfb-1c80-4057-9c4a-4860c68887cc None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:00.645875 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83881dfb-1c80-4057-9c4a-4860c68887cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:00.714592 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-83881dfb-1c80-4057-9c4a-4860c68887cc None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:00.715812 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-83881dfb-1c80-4057-9c4a-4860c68887cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:00.754306 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:00.815949 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 681/1360] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:18:00.861692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db56a1-59f1-40fd-9a54-2ad34ce609c2 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:00.863417 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-16db56a1-59f1-40fd-9a54-2ad34ce609c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:00.936836 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:01.031628 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db56a1-59f1-40fd-9a54-2ad34ce609c2 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:01.288883 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f208d0-7039-446a-bddc-59093f6f7e08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:01.289492 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f208d0-7039-446a-bddc-59093f6f7e08 service nova] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:01.289771 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f208d0-7039-446a-bddc-59093f6f7e08 service nova] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:01.290045 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f208d0-7039-446a-bddc-59093f6f7e08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:01.291664 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-94f208d0-7039-446a-bddc-59093f6f7e08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:01.315304 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:01.409874 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f208d0-7039-446a-bddc-59093f6f7e08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:01.411812 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f208d0-7039-446a-bddc-59093f6f7e08 service nova] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:01.433961 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 680/1361] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:18:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:18:03.871556 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63c216-7442-422d-8600-65b9a041e6f9 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:03.872155 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63c216-7442-422d-8600-65b9a041e6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:03.872155 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63c216-7442-422d-8600-65b9a041e6f9 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:03.873997 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 682/1362] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:18:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:03.879398 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200315a-0da8-4f27-9845-139116824821 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:03.880166 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200315a-0da8-4f27-9845-139116824821 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:03.880470 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200315a-0da8-4f27-9845-139116824821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:03.948406 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-d200315a-0da8-4f27-9845-139116824821 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:03.949620 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-d200315a-0da8-4f27-9845-139116824821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:04.057647 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:04.061563 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 681/1363] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:18:04.109460 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a040e19-591a-463d-8475-960e374bf738 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:04.109868 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a040e19-591a-463d-8475-960e374bf738 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:04.110345 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a040e19-591a-463d-8475-960e374bf738 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:04.113011 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 683/1364] 10.222.0.23 () {54 vars in 962 bytes} [Mon Aug 8 02:18:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:04.118133 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9af292-2e90-47f2-86b6-8769aa0879fc None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:04.118526 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9af292-2e90-47f2-86b6-8769aa0879fc None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:04.119106 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9af292-2e90-47f2-86b6-8769aa0879fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:04.213910 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-bc9af292-2e90-47f2-86b6-8769aa0879fc None None] MFA Rules not processed for user `5d89e0c7d62444e4b75d3f4da49b2bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:04.215138 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-bc9af292-2e90-47f2-86b6-8769aa0879fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:04.340194 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 682/1365] 10.222.0.23 () {58 vars in 1059 bytes} [Mon Aug 8 02:18:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:18:04.348044 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a040e19-591a-463d-8475-960e374bf738 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:04.349566 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-6a040e19-591a-463d-8475-960e374bf738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:04.505338 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a040e19-591a-463d-8475-960e374bf738 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:04.527421 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:04.629379 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9f993-9b20-491a-b722-b5f62211f27d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:04.630390 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9f993-9b20-491a-b722-b5f62211f27d service nova] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:04.630885 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9f993-9b20-491a-b722-b5f62211f27d service nova] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:04.631413 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9f993-9b20-491a-b722-b5f62211f27d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:04.633791 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-40e9f993-9b20-491a-b722-b5f62211f27d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:04.732139 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9f993-9b20-491a-b722-b5f62211f27d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:04.733903 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9f993-9b20-491a-b722-b5f62211f27d service nova] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:04.753605 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 684/1366] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:18:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:18:05.600869 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e8571-8249-4d91-85d6-7714eb1ff892 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:05.601410 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e8571-8249-4d91-85d6-7714eb1ff892 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:05.601410 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e8571-8249-4d91-85d6-7714eb1ff892 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:05.602793 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 683/1367] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:05.607981 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720ddc3-29bf-4768-a385-a526335ab501 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:05.608421 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720ddc3-29bf-4768-a385-a526335ab501 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:05.608531 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720ddc3-29bf-4768-a385-a526335ab501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:05.641876 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:05.676932 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-9720ddc3-29bf-4768-a385-a526335ab501 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:05.678171 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-9720ddc3-29bf-4768-a385-a526335ab501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:05.780833 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 685/1368] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:18:06.131429 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012344c-0e46-497f-b6fc-a6217fe1cfed None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:06.131617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012344c-0e46-497f-b6fc-a6217fe1cfed None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:06.131864 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012344c-0e46-497f-b6fc-a6217fe1cfed None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:06.133349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 684/1369] 10.222.0.23 () {54 vars in 964 bytes} [Mon Aug 8 02:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:06.138681 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9df53-bad4-4909-8533-65c2d7d199d7 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:06.138968 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9df53-bad4-4909-8533-65c2d7d199d7 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:06.139244 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9df53-bad4-4909-8533-65c2d7d199d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:06.222469 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-85e9df53-bad4-4909-8533-65c2d7d199d7 None None] MFA Rules not processed for user `c63640b6bedd4e64b16657a34eb40f3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:06.224349 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-85e9df53-bad4-4909-8533-65c2d7d199d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:06.273642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:06.306217 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 686/1370] 10.222.0.23 () {58 vars in 1061 bytes} [Mon Aug 8 02:18:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:18:06.316294 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012344c-0e46-497f-b6fc-a6217fe1cfed None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:06.318165 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-e012344c-0e46-497f-b6fc-a6217fe1cfed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:06.373873 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:06.429354 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012344c-0e46-497f-b6fc-a6217fe1cfed None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:06.505594 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad188b5-54b2-471d-a0b9-d04c3ea50e24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:06.506197 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad188b5-54b2-471d-a0b9-d04c3ea50e24 service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:06.506474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad188b5-54b2-471d-a0b9-d04c3ea50e24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:06.506741 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad188b5-54b2-471d-a0b9-d04c3ea50e24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:06.508350 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-4ad188b5-54b2-471d-a0b9-d04c3ea50e24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:06.610346 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:06.627057 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad188b5-54b2-471d-a0b9-d04c3ea50e24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:06.629073 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad188b5-54b2-471d-a0b9-d04c3ea50e24 service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:06.658261 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 685/1371] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:18:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:18:07.079055 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854bff2-c3fe-4be5-a659-3b27185b1f47 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:07.079626 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854bff2-c3fe-4be5-a659-3b27185b1f47 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:07.079626 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854bff2-c3fe-4be5-a659-3b27185b1f47 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:07.081185 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 687/1372] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:18:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:07.086276 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e642f-5156-4e7d-a851-4f33e3dd3ef3 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:07.086880 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e642f-5156-4e7d-a851-4f33e3dd3ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:07.086880 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e642f-5156-4e7d-a851-4f33e3dd3ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:07.154280 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-1a8e642f-5156-4e7d-a851-4f33e3dd3ef3 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:07.155436 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-1a8e642f-5156-4e7d-a851-4f33e3dd3ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:07.256211 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 686/1373] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:18:07.301018 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854bff2-c3fe-4be5-a659-3b27185b1f47 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:07.302526 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-7854bff2-c3fe-4be5-a659-3b27185b1f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:07.455617 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854bff2-c3fe-4be5-a659-3b27185b1f47 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:07.507789 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:07.569530 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ad5d4-70a9-4bbd-bea9-5a7fa811524c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:07.570223 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ad5d4-70a9-4bbd-bea9-5a7fa811524c service nova] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:07.570566 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ad5d4-70a9-4bbd-bea9-5a7fa811524c service nova] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:07.570906 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ad5d4-70a9-4bbd-bea9-5a7fa811524c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:07.572632 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-2f9ad5d4-70a9-4bbd-bea9-5a7fa811524c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:07.659958 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ad5d4-70a9-4bbd-bea9-5a7fa811524c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:07.661621 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ad5d4-70a9-4bbd-bea9-5a7fa811524c service nova] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:07.680297 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 688/1374] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:18:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:18:09.869740 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c49b8-a3e1-489e-ab76-b0b2a67970bb None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:09.870322 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c49b8-a3e1-489e-ab76-b0b2a67970bb None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:09.870322 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c49b8-a3e1-489e-ab76-b0b2a67970bb None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:09.871657 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 687/1375] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:09.877211 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5bed18-d4d8-407e-8114-1a6f3b937a30 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:09.877634 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5bed18-d4d8-407e-8114-1a6f3b937a30 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:09.877811 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5bed18-d4d8-407e-8114-1a6f3b937a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:09.942649 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-9c5bed18-d4d8-407e-8114-1a6f3b937a30 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:09.944114 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-9c5bed18-d4d8-407e-8114-1a6f3b937a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:09.950615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:10.039629 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 689/1376] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:18:10.089802 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c49b8-a3e1-489e-ab76-b0b2a67970bb None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:10.091434 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-567c49b8-a3e1-489e-ab76-b0b2a67970bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:10.154123 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:10.262872 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c49b8-a3e1-489e-ab76-b0b2a67970bb None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:10.419994 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389c653-deb1-4606-8589-20190c9d8643 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:10.420605 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389c653-deb1-4606-8589-20190c9d8643 service nova] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:10.420886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389c653-deb1-4606-8589-20190c9d8643 service nova] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:10.421160 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389c653-deb1-4606-8589-20190c9d8643 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:10.422750 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-2389c653-deb1-4606-8589-20190c9d8643 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:10.442110 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:10.517340 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389c653-deb1-4606-8589-20190c9d8643 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:10.518991 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389c653-deb1-4606-8589-20190c9d8643 service nova] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:10.546037 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 688/1377] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:18:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:18:12.726060 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e179834-0882-4e75-a6ce-2a8b075fdf39 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:12.726630 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e179834-0882-4e75-a6ce-2a8b075fdf39 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:12.726630 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e179834-0882-4e75-a6ce-2a8b075fdf39 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:12.727959 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 690/1378] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:12.733126 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e1601-b6bc-4437-b947-44c12d95154b None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:12.733573 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e1601-b6bc-4437-b947-44c12d95154b None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:12.733678 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e1601-b6bc-4437-b947-44c12d95154b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:12.800572 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-d63e1601-b6bc-4437-b947-44c12d95154b None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:12.801720 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-d63e1601-b6bc-4437-b947-44c12d95154b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:12.903067 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:12.909733 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 689/1379] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:18:12.954730 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e179834-0882-4e75-a6ce-2a8b075fdf39 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:12.956424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-5e179834-0882-4e75-a6ce-2a8b075fdf39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:13.103216 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:13.115705 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e179834-0882-4e75-a6ce-2a8b075fdf39 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:13.247907 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e65db-8840-4562-9d44-afef8819ba9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:13.248498 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e65db-8840-4562-9d44-afef8819ba9b service nova] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:13.248779 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e65db-8840-4562-9d44-afef8819ba9b service nova] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:13.249054 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e65db-8840-4562-9d44-afef8819ba9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:13.250648 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-b07e65db-8840-4562-9d44-afef8819ba9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:13.355988 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e65db-8840-4562-9d44-afef8819ba9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:13.358072 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e65db-8840-4562-9d44-afef8819ba9b service nova] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:13.368676 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:13.377444 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 691/1380] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:18:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:18:15.574722 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e47e0-758b-4b0d-8ab0-22c6bf6f0eee None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:15.575246 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e47e0-758b-4b0d-8ab0-22c6bf6f0eee None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:15.575246 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e47e0-758b-4b0d-8ab0-22c6bf6f0eee None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:15.577551 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 690/1381] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:18:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:18:15.582994 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fe12b-9355-491f-9b7b-ce53a6c70caa None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:15.583431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fe12b-9355-491f-9b7b-ce53a6c70caa None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:15.583633 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fe12b-9355-491f-9b7b-ce53a6c70caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:15.653144 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-5e8fe12b-9355-491f-9b7b-ce53a6c70caa None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:15.654888 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-5e8fe12b-9355-491f-9b7b-ce53a6c70caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:15.767011 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 692/1382] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:18:15.808816 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e47e0-758b-4b0d-8ab0-22c6bf6f0eee None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:15.811004 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-ea2e47e0-758b-4b0d-8ab0-22c6bf6f0eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:15.980483 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e47e0-758b-4b0d-8ab0-22c6bf6f0eee None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:16.063676 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:16.111763 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d377f43-9146-4cb3-b2f0-e1abaca515c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:16.112390 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d377f43-9146-4cb3-b2f0-e1abaca515c0 service nova] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:16.112679 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d377f43-9146-4cb3-b2f0-e1abaca515c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:16.112973 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d377f43-9146-4cb3-b2f0-e1abaca515c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:16.114617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-4d377f43-9146-4cb3-b2f0-e1abaca515c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:16.208547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d377f43-9146-4cb3-b2f0-e1abaca515c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:16.210207 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d377f43-9146-4cb3-b2f0-e1abaca515c0 service nova] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:16.227734 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 691/1383] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:18:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:18:18.307736 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef8089-58ea-4067-a100-7ef7e9a51dd9 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:18.308215 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef8089-58ea-4067-a100-7ef7e9a51dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:18.308321 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef8089-58ea-4067-a100-7ef7e9a51dd9 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:18.309733 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 693/1384] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:18:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:18.315179 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754a02e-2338-4432-a136-e6072e875078 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:18.315777 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754a02e-2338-4432-a136-e6072e875078 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:18.315777 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754a02e-2338-4432-a136-e6072e875078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:18.387130 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-1754a02e-2338-4432-a136-e6072e875078 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:18.389526 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-1754a02e-2338-4432-a136-e6072e875078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:18.430283 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:18.499239 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 692/1385] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:18:18.544761 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef8089-58ea-4067-a100-7ef7e9a51dd9 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:18.546277 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-40ef8089-58ea-4067-a100-7ef7e9a51dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:18.621693 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:18.693587 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef8089-58ea-4067-a100-7ef7e9a51dd9 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:18.933210 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f67f9-79bc-41ab-a77a-c018be2fd62e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:18.933772 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f67f9-79bc-41ab-a77a-c018be2fd62e service nova] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:18.934054 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f67f9-79bc-41ab-a77a-c018be2fd62e service nova] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:18.934331 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f67f9-79bc-41ab-a77a-c018be2fd62e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:18.935997 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-245f67f9-79bc-41ab-a77a-c018be2fd62e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:18.975376 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:19.027331 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f67f9-79bc-41ab-a77a-c018be2fd62e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:19.029551 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f67f9-79bc-41ab-a77a-c018be2fd62e service nova] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:19.048864 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 694/1386] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:18:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:18:21.278734 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45e581-0941-46d0-a4ea-5c88b44b3ec2 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:21.279669 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45e581-0941-46d0-a4ea-5c88b44b3ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:21.279669 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45e581-0941-46d0-a4ea-5c88b44b3ec2 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:21.280633 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 693/1387] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:21.286887 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4a553-d62f-4751-b89c-f2569c57b7e0 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:21.286887 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4a553-d62f-4751-b89c-f2569c57b7e0 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:21.286887 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4a553-d62f-4751-b89c-f2569c57b7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:21.350835 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-f2a4a553-d62f-4751-b89c-f2569c57b7e0 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:21.352079 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-f2a4a553-d62f-4751-b89c-f2569c57b7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:21.457542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 695/1388] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:18:21.502117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45e581-0941-46d0-a4ea-5c88b44b3ec2 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:21.503673 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-8b45e581-0941-46d0-a4ea-5c88b44b3ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:21.646326 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45e581-0941-46d0-a4ea-5c88b44b3ec2 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:21.662853 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:21.758827 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b088c-5a1e-43bc-b936-4b6ebe602a4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:21.759454 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b088c-5a1e-43bc-b936-4b6ebe602a4d service nova] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:21.759734 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b088c-5a1e-43bc-b936-4b6ebe602a4d service nova] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:21.760008 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b088c-5a1e-43bc-b936-4b6ebe602a4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:21.761590 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-8c3b088c-5a1e-43bc-b936-4b6ebe602a4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:21.852770 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b088c-5a1e-43bc-b936-4b6ebe602a4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:21.854356 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b088c-5a1e-43bc-b936-4b6ebe602a4d service nova] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:21.873462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 694/1389] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:18:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:18:22.021141 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82972c-597b-462f-a96e-479936645b82 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:22.021455 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82972c-597b-462f-a96e-479936645b82 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:22.021738 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82972c-597b-462f-a96e-479936645b82 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:22.023164 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 696/1390] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:22.029061 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb28259-bb63-4d35-8870-f949fd72675c None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:22.029344 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb28259-bb63-4d35-8870-f949fd72675c None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:22.029617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb28259-bb63-4d35-8870-f949fd72675c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:22.054639 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:22.099755 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-1fb28259-bb63-4d35-8870-f949fd72675c None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:22.101014 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-1fb28259-bb63-4d35-8870-f949fd72675c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:22.212489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 695/1391] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:18:22.269862 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2916dd-6767-4a8b-8051-ea11f7a8c2e6 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:22.270152 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2916dd-6767-4a8b-8051-ea11f7a8c2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:22.270433 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2916dd-6767-4a8b-8051-ea11f7a8c2e6 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:22.271895 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 697/1392] 10.222.0.23 () {54 vars in 966 bytes} [Mon Aug 8 02:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:22.276965 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4111c-127b-4527-9991-3ca340c03941 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:22.277260 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4111c-127b-4527-9991-3ca340c03941 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:22.277539 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4111c-127b-4527-9991-3ca340c03941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:22.355191 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-18f4111c-127b-4527-9991-3ca340c03941 None None] MFA Rules not processed for user `aae574170d6f4eb8ab70805d8b5f4f08`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:22.356469 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-18f4111c-127b-4527-9991-3ca340c03941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:22.397250 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:22.432801 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 696/1393] 10.222.0.23 () {58 vars in 1063 bytes} [Mon Aug 8 02:18:22 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:18:22.440824 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2916dd-6767-4a8b-8051-ea11f7a8c2e6 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:22.442457 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-7b2916dd-6767-4a8b-8051-ea11f7a8c2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:22.457448 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:22.551612 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2916dd-6767-4a8b-8051-ea11f7a8c2e6 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:22.627922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6f291-d917-49ef-8edb-184fb1a97cb5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aae574170d6f4eb8ab70805d8b5f4f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:22.628518 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6f291-d917-49ef-8edb-184fb1a97cb5 service glance] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:22.628797 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6f291-d917-49ef-8edb-184fb1a97cb5 service glance] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:22.629071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6f291-d917-49ef-8edb-184fb1a97cb5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:22.630645 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-aea6f291-d917-49ef-8edb-184fb1a97cb5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:22.697348 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:22.739638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea6f291-d917-49ef-8edb-184fb1a97cb5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:22.741104 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea6f291-d917-49ef-8edb-184fb1a97cb5 service glance] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:22.759333 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 698/1394] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:18:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:18:23.621475 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30ea0b-d622-4064-82ac-23888a12a115 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:23.621952 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30ea0b-d622-4064-82ac-23888a12a115 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:23.622057 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30ea0b-d622-4064-82ac-23888a12a115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:23.688589 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-3f30ea0b-d622-4064-82ac-23888a12a115 None None] MFA Rules not processed for user `1d39439278814d4faac4cfb1e71aa4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:23.689793 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-3f30ea0b-d622-4064-82ac-23888a12a115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:23.774335 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 697/1395] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 8 02:18:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:18:23.820865 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a2b8e-85bc-460f-a10f-8e0506e1695d None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:23.821338 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a2b8e-85bc-460f-a10f-8e0506e1695d None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:23.821432 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a2b8e-85bc-460f-a10f-8e0506e1695d None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:23.822788 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 699/1396] 10.222.0.23 () {54 vars in 943 bytes} [Mon Aug 8 02:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:23.830765 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c93c6-4e9f-440c-a9de-27bdd48ca6b5 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:23.831125 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c93c6-4e9f-440c-a9de-27bdd48ca6b5 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:23.831502 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c93c6-4e9f-440c-a9de-27bdd48ca6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:23.901253 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:23.909800 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-d77c93c6-4e9f-440c-a9de-27bdd48ca6b5 None None] MFA Rules not processed for user `6c212009b6a44e1bad92769630116408`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:23.910416 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-d77c93c6-4e9f-440c-a9de-27bdd48ca6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:24.018705 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 698/1397] 10.222.0.23 () {58 vars in 1040 bytes} [Mon Aug 8 02:18:23 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:18:24.028228 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a2b8e-85bc-460f-a10f-8e0506e1695d None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:24.030258 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-9b5a2b8e-85bc-460f-a10f-8e0506e1695d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:24.043176 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222a2bf-bc55-4443-a9a0-06a96c6b2710 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:24.043649 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222a2bf-bc55-4443-a9a0-06a96c6b2710 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:24.044837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222a2bf-bc55-4443-a9a0-06a96c6b2710 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:24.046168 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 699/1398] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:18:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:18:24.051760 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875510a-64fa-4cd7-8530-74bc77282fc2 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:24.052478 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875510a-64fa-4cd7-8530-74bc77282fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:24.052742 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875510a-64fa-4cd7-8530-74bc77282fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:24.117366 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-6875510a-64fa-4cd7-8530-74bc77282fc2 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:24.118581 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-6875510a-64fa-4cd7-8530-74bc77282fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:24.177673 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a2b8e-85bc-460f-a10f-8e0506e1695d None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:24.183651 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:24.222450 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:24.232700 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 700/1399] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:18:24.277611 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875510a-64fa-4cd7-8530-74bc77282fc2 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:24.279337 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-6875510a-64fa-4cd7-8530-74bc77282fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:24.298407 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38903d-9c97-4a9a-b498-efc73fba45b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c212009b6a44e1bad92769630116408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:24.299075 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38903d-9c97-4a9a-b498-efc73fba45b3 service swift] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:24.299375 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38903d-9c97-4a9a-b498-efc73fba45b3 service swift] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:24.299657 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38903d-9c97-4a9a-b498-efc73fba45b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:24.301312 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-4a38903d-9c97-4a9a-b498-efc73fba45b3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:24.396026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a38903d-9c97-4a9a-b498-efc73fba45b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:24.397603 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a38903d-9c97-4a9a-b498-efc73fba45b3 service swift] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:24.406749 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 700/1400] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 8 02:18:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 08 02:18:24.406945 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875510a-64fa-4cd7-8530-74bc77282fc2 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:24.488234 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:24.527688 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507019e-a28a-4381-9262-c1175ba0f63c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:24.528290 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507019e-a28a-4381-9262-c1175ba0f63c service nova] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:24.528569 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507019e-a28a-4381-9262-c1175ba0f63c service nova] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:24.528843 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507019e-a28a-4381-9262-c1175ba0f63c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:24.530429 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-d507019e-a28a-4381-9262-c1175ba0f63c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:24.619668 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507019e-a28a-4381-9262-c1175ba0f63c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:24.621263 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507019e-a28a-4381-9262-c1175ba0f63c service nova] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:24.640082 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 701/1401] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:18:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:18:27.142395 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9b2a7-4d26-473e-aec6-6d8dac0928ae None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:27.143005 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9b2a7-4d26-473e-aec6-6d8dac0928ae None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:27.143005 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9b2a7-4d26-473e-aec6-6d8dac0928ae None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:27.144446 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 701/1402] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:27.149504 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc6047-a50b-49a6-9e17-411376825c65 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:27.149951 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc6047-a50b-49a6-9e17-411376825c65 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:27.150058 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc6047-a50b-49a6-9e17-411376825c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:27.220256 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-89fc6047-a50b-49a6-9e17-411376825c65 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:27.221479 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-89fc6047-a50b-49a6-9e17-411376825c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:27.266183 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:27.335915 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 702/1403] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:18:27.381242 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9b2a7-4d26-473e-aec6-6d8dac0928ae None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:27.453217 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-4eb9b2a7-4d26-473e-aec6-6d8dac0928ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:27.499146 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:27.583964 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9b2a7-4d26-473e-aec6-6d8dac0928ae None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:27.708796 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77be15-f625-445b-aa08-96b7223ce89a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:27.709324 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77be15-f625-445b-aa08-96b7223ce89a service nova] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:27.709747 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77be15-f625-445b-aa08-96b7223ce89a service nova] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:27.710025 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77be15-f625-445b-aa08-96b7223ce89a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:27.711711 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-6b77be15-f625-445b-aa08-96b7223ce89a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:27.814748 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77be15-f625-445b-aa08-96b7223ce89a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:27.817210 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77be15-f625-445b-aa08-96b7223ce89a service nova] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:27.839862 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 702/1404] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:18:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:18:28.113637 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:30.545982 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70519350-b734-4c48-8aec-73c9c7e4b112 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:30.546553 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70519350-b734-4c48-8aec-73c9c7e4b112 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:30.547001 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70519350-b734-4c48-8aec-73c9c7e4b112 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:30.548480 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 703/1405] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:18:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:30.553795 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba4b1b-e509-4957-a081-86ad83325757 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:30.554234 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba4b1b-e509-4957-a081-86ad83325757 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:30.554350 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba4b1b-e509-4957-a081-86ad83325757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:30.627576 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-44ba4b1b-e509-4957-a081-86ad83325757 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:30.628921 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-44ba4b1b-e509-4957-a081-86ad83325757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:30.738081 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 703/1406] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:18:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:18:30.784715 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70519350-b734-4c48-8aec-73c9c7e4b112 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:30.784715 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-70519350-b734-4c48-8aec-73c9c7e4b112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:30.949398 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70519350-b734-4c48-8aec-73c9c7e4b112 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:30.975721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:31.081988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba217a-9d94-49fa-883b-7a5cc1821e5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:31.082506 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba217a-9d94-49fa-883b-7a5cc1821e5e service nova] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:31.082787 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba217a-9d94-49fa-883b-7a5cc1821e5e service nova] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:31.083064 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba217a-9d94-49fa-883b-7a5cc1821e5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:31.084716 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-d3ba217a-9d94-49fa-883b-7a5cc1821e5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:31.180682 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba217a-9d94-49fa-883b-7a5cc1821e5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:31.182286 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba217a-9d94-49fa-883b-7a5cc1821e5e service nova] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:31.202754 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 704/1407] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:18:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:18:40.736195 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=97 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:41.199886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=88 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:48.209465 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a6674-351a-416c-9e70-28f3fe0addbe None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:48.210002 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a6674-351a-416c-9e70-28f3fe0addbe None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:48.210002 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a6674-351a-416c-9e70-28f3fe0addbe None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:48.211365 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 704/1408] 10.222.0.23 () {54 vars in 918 bytes} [Mon Aug 8 02:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:48.216556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16668f-cb79-468c-9bd0-67fbc859575f None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:48.217002 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16668f-cb79-468c-9bd0-67fbc859575f None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:48.217110 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16668f-cb79-468c-9bd0-67fbc859575f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:48.290247 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-6f16668f-cb79-468c-9bd0-67fbc859575f None None] MFA Rules not processed for user `43a39dd539974180a8165e34de57b552`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:48.291477 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-6f16668f-cb79-468c-9bd0-67fbc859575f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:48.395280 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 705/1409] 10.222.0.23 () {58 vars in 1015 bytes} [Mon Aug 8 02:18:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:18:48.409877 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163756c-fd4e-4dac-9aa2-f703fe90660c None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:48.410164 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163756c-fd4e-4dac-9aa2-f703fe90660c None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:48.410441 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163756c-fd4e-4dac-9aa2-f703fe90660c None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:48.411989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 705/1410] 10.222.0.23 () {54 vars in 918 bytes} [Mon Aug 8 02:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:48.416769 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437880a7-5ef1-4a33-b594-f39d2d904378 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:48.417056 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437880a7-5ef1-4a33-b594-f39d2d904378 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:48.417350 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437880a7-5ef1-4a33-b594-f39d2d904378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:48.488280 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:48.490660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-437880a7-5ef1-4a33-b594-f39d2d904378 None None] MFA Rules not processed for user `5d89e0c7d62444e4b75d3f4da49b2bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:48.491888 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-437880a7-5ef1-4a33-b594-f39d2d904378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:48.604067 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 706/1411] 10.222.0.23 () {58 vars in 1015 bytes} [Mon Aug 8 02:18:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:18:51.069589 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3487354-e11c-42b4-8f9d-b1d9ec829b2f None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:51.070102 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3487354-e11c-42b4-8f9d-b1d9ec829b2f None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:51.070102 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3487354-e11c-42b4-8f9d-b1d9ec829b2f None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:51.071393 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 706/1412] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:51.076577 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb12fb5-658d-421f-bcd5-e02024ba4090 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:51.077016 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb12fb5-658d-421f-bcd5-e02024ba4090 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:51.077166 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb12fb5-658d-421f-bcd5-e02024ba4090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:51.141273 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-fbb12fb5-658d-421f-bcd5-e02024ba4090 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:51.142479 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-fbb12fb5-658d-421f-bcd5-e02024ba4090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:51.196888 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:51.237931 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 707/1413] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:18:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:18:51.280541 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3487354-e11c-42b4-8f9d-b1d9ec829b2f None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:51.282047 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-e3487354-e11c-42b4-8f9d-b1d9ec829b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:51.424603 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3487354-e11c-42b4-8f9d-b1d9ec829b2f None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:51.494817 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:51.535049 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f98ac2-8342-4000-b2f5-218d808e64b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:51.535676 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f98ac2-8342-4000-b2f5-218d808e64b3 service nova] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:51.535952 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f98ac2-8342-4000-b2f5-218d808e64b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:51.536222 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f98ac2-8342-4000-b2f5-218d808e64b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:51.537795 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-95f98ac2-8342-4000-b2f5-218d808e64b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:51.625511 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f98ac2-8342-4000-b2f5-218d808e64b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:51.627082 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f98ac2-8342-4000-b2f5-218d808e64b3 service nova] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:51.645289 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 707/1414] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:18:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:18:52.538882 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a192dc-4817-47ad-8e76-31ed29f29ae7 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:52.539483 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a192dc-4817-47ad-8e76-31ed29f29ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:52.539483 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a192dc-4817-47ad-8e76-31ed29f29ae7 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:52.540792 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 708/1415] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 02:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:52.546311 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b9160-76f7-44ce-ac87-b2c32accdb74 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:52.546709 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b9160-76f7-44ce-ac87-b2c32accdb74 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:52.546861 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b9160-76f7-44ce-ac87-b2c32accdb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:52.620724 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-822b9160-76f7-44ce-ac87-b2c32accdb74 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:52.621927 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-822b9160-76f7-44ce-ac87-b2c32accdb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:52.648991 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:52.716413 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 708/1416] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 02:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:18:52.865873 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a192dc-4817-47ad-8e76-31ed29f29ae7 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:52.867569 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-b9a192dc-4817-47ad-8e76-31ed29f29ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:53.008993 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a192dc-4817-47ad-8e76-31ed29f29ae7 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:53.048882 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:53.125048 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b14f5a0-4b1d-40b9-a617-c5053d59bcde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:53.125663 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14f5a0-4b1d-40b9-a617-c5053d59bcde service nova] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:53.125944 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14f5a0-4b1d-40b9-a617-c5053d59bcde service nova] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:53.126218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14f5a0-4b1d-40b9-a617-c5053d59bcde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:53.127854 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-2b14f5a0-4b1d-40b9-a617-c5053d59bcde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:53.215465 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b14f5a0-4b1d-40b9-a617-c5053d59bcde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:53.217074 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b14f5a0-4b1d-40b9-a617-c5053d59bcde service nova] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:53.234572 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 709/1417] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:18:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:18:54.118532 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b190b-a189-4706-a521-1b6eb5d6e7b3 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:54.118970 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b190b-a189-4706-a521-1b6eb5d6e7b3 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:54.119081 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b190b-a189-4706-a521-1b6eb5d6e7b3 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:54.120478 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 709/1418] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 02:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:54.125559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e165a-8ae3-4b7c-8bb7-6d3699211632 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:54.125965 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e165a-8ae3-4b7c-8bb7-6d3699211632 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:54.126135 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e165a-8ae3-4b7c-8bb7-6d3699211632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:54.180245 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:54.203138 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-a39e165a-8ae3-4b7c-8bb7-6d3699211632 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:54.204365 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-a39e165a-8ae3-4b7c-8bb7-6d3699211632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:54.297351 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 710/1419] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 02:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:18:54.454946 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b190b-a189-4706-a521-1b6eb5d6e7b3 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:54.456603 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-196b190b-a189-4706-a521-1b6eb5d6e7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:54.602507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b190b-a189-4706-a521-1b6eb5d6e7b3 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:54.614729 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:54.714750 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c7aeb-67a9-4559-a0dc-a4cbc9e7eba0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:54.715346 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c7aeb-67a9-4559-a0dc-a4cbc9e7eba0 service nova] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:54.715651 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c7aeb-67a9-4559-a0dc-a4cbc9e7eba0 service nova] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:54.715917 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c7aeb-67a9-4559-a0dc-a4cbc9e7eba0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:54.718064 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-f74c7aeb-67a9-4559-a0dc-a4cbc9e7eba0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:54.805951 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c7aeb-67a9-4559-a0dc-a4cbc9e7eba0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:54.807630 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c7aeb-67a9-4559-a0dc-a4cbc9e7eba0 service nova] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:54.825648 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 710/1420] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:18:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:18:55.680027 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17eb2bc-8263-463d-882e-d427ea2039ca None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:55.680882 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17eb2bc-8263-463d-882e-d427ea2039ca None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:55.680882 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17eb2bc-8263-463d-882e-d427ea2039ca None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:55.682394 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 711/1421] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 02:18:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:55.687476 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008590d-cc3d-4b8a-94fd-7b71af9b9d5e None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:55.687885 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008590d-cc3d-4b8a-94fd-7b71af9b9d5e None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:55.688034 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008590d-cc3d-4b8a-94fd-7b71af9b9d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:55.707652 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:55.763370 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-f008590d-cc3d-4b8a-94fd-7b71af9b9d5e None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:55.765110 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-f008590d-cc3d-4b8a-94fd-7b71af9b9d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:55.858378 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 711/1422] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 02:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:18:56.007033 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17eb2bc-8263-463d-882e-d427ea2039ca None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:56.008529 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-b17eb2bc-8263-463d-882e-d427ea2039ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:56.116331 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:56.151977 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17eb2bc-8263-463d-882e-d427ea2039ca None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:56.261154 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428273ed-23e6-44b8-acac-7d88116c6dcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:56.261687 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428273ed-23e6-44b8-acac-7d88116c6dcf service nova] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:56.261970 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428273ed-23e6-44b8-acac-7d88116c6dcf service nova] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:56.262243 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428273ed-23e6-44b8-acac-7d88116c6dcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:56.263860 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-428273ed-23e6-44b8-acac-7d88116c6dcf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:56.338337 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:56.351851 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428273ed-23e6-44b8-acac-7d88116c6dcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:56.353449 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428273ed-23e6-44b8-acac-7d88116c6dcf service nova] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:56.371650 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 712/1423] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:18:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:18:57.272567 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1b325-4c3e-47ec-9206-6957b630ba62 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:57.273143 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1b325-4c3e-47ec-9206-6957b630ba62 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:57.273143 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1b325-4c3e-47ec-9206-6957b630ba62 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:57.274538 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 712/1424] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 02:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:57.279469 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ac8f7-ee42-4637-a6a3-d4097f6c3c65 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:57.279862 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ac8f7-ee42-4637-a6a3-d4097f6c3c65 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:57.280101 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ac8f7-ee42-4637-a6a3-d4097f6c3c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:57.357281 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-542ac8f7-ee42-4637-a6a3-d4097f6c3c65 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:57.358559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-542ac8f7-ee42-4637-a6a3-d4097f6c3c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:57.452526 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 713/1425] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 02:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:18:57.603482 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1b325-4c3e-47ec-9206-6957b630ba62 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:57.605381 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-6ff1b325-4c3e-47ec-9206-6957b630ba62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:57.698574 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:57.762187 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1b325-4c3e-47ec-9206-6957b630ba62 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:57.872937 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb974d-21b4-4ff7-ab6a-e02dc1c7b40e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:57.873452 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb974d-21b4-4ff7-ab6a-e02dc1c7b40e service nova] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:57.874228 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb974d-21b4-4ff7-ab6a-e02dc1c7b40e service nova] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:57.874495 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb974d-21b4-4ff7-ab6a-e02dc1c7b40e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:57.876114 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-52cb974d-21b4-4ff7-ab6a-e02dc1c7b40e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:57.922912 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:57.963471 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb974d-21b4-4ff7-ab6a-e02dc1c7b40e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:57.965017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb974d-21b4-4ff7-ab6a-e02dc1c7b40e service nova] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:57.982221 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 713/1426] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:18:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:18:58.849184 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d8e0e-ec17-4498-a51f-687c51f02558 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:58.849783 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d8e0e-ec17-4498-a51f-687c51f02558 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:58.849783 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d8e0e-ec17-4498-a51f-687c51f02558 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:58.851066 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 714/1427] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 02:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:18:58.855986 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93d3da-1c4a-4f36-8558-883f143f8d1f None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:58.856376 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93d3da-1c4a-4f36-8558-883f143f8d1f None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:58.856543 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93d3da-1c4a-4f36-8558-883f143f8d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:58.931042 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-9c93d3da-1c4a-4f36-8558-883f143f8d1f None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:18:58.932273 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-9c93d3da-1c4a-4f36-8558-883f143f8d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:59.029021 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 714/1428] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 02:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:18:59.178954 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d8e0e-ec17-4498-a51f-687c51f02558 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:18:59.181618 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-ba6d8e0e-ec17-4498-a51f-687c51f02558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:59.229552 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:59.323299 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d8e0e-ec17-4498-a51f-687c51f02558 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:18:59.434425 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6cf05-d00e-4d0f-a237-14dc9d646671 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:18:59.434960 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6cf05-d00e-4d0f-a237-14dc9d646671 service nova] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:18:59.435238 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6cf05-d00e-4d0f-a237-14dc9d646671 service nova] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:18:59.435546 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6cf05-d00e-4d0f-a237-14dc9d646671 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:18:59.437777 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-8eb6cf05-d00e-4d0f-a237-14dc9d646671 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:18:59.444837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:59.537340 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb6cf05-d00e-4d0f-a237-14dc9d646671 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:18:59.538932 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb6cf05-d00e-4d0f-a237-14dc9d646671 service nova] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:18:59.557681 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 715/1429] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:18:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:19:00.459941 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590d1d6-18c3-450b-a037-24fb7a1094eb None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:00.460521 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590d1d6-18c3-450b-a037-24fb7a1094eb None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:00.460521 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590d1d6-18c3-450b-a037-24fb7a1094eb None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:00.461868 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 715/1430] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 02:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:00.467260 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c8a21-54ac-4236-b32a-33b27c8dc4a6 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:00.468326 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c8a21-54ac-4236-b32a-33b27c8dc4a6 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:00.468440 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c8a21-54ac-4236-b32a-33b27c8dc4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:00.545128 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-f40c8a21-54ac-4236-b32a-33b27c8dc4a6 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:00.546658 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-f40c8a21-54ac-4236-b32a-33b27c8dc4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:00.613026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:00.641624 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 716/1431] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 02:19:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:19:00.792062 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590d1d6-18c3-450b-a037-24fb7a1094eb None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:00.793584 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-0590d1d6-18c3-450b-a037-24fb7a1094eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:00.811650 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:00.935186 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590d1d6-18c3-450b-a037-24fb7a1094eb None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:01.024215 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:01.049374 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6838a-e852-4282-8373-8ef19a67f2d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:01.049968 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6838a-e852-4282-8373-8ef19a67f2d7 service nova] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:01.050245 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6838a-e852-4282-8373-8ef19a67f2d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:01.050516 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6838a-e852-4282-8373-8ef19a67f2d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:01.052123 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-eba6838a-e852-4282-8373-8ef19a67f2d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:01.138101 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba6838a-e852-4282-8373-8ef19a67f2d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:01.140224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba6838a-e852-4282-8373-8ef19a67f2d7 service nova] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:01.158105 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 716/1432] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:19:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:19:02.038552 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba553d0-fb76-495b-a7e0-ec67368cc6ab None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:02.039092 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba553d0-fb76-495b-a7e0-ec67368cc6ab None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:02.039092 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba553d0-fb76-495b-a7e0-ec67368cc6ab None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:02.040470 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 717/1433] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 02:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:02.045209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14adb9d9-5486-4a5c-b269-3b80e3b90e20 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:02.046099 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14adb9d9-5486-4a5c-b269-3b80e3b90e20 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:02.046300 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14adb9d9-5486-4a5c-b269-3b80e3b90e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:02.120718 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-14adb9d9-5486-4a5c-b269-3b80e3b90e20 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:02.121924 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-14adb9d9-5486-4a5c-b269-3b80e3b90e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:02.162738 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:02.223577 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 717/1434] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 02:19:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:19:02.374508 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba553d0-fb76-495b-a7e0-ec67368cc6ab None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:02.375982 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-3ba553d0-fb76-495b-a7e0-ec67368cc6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:02.520079 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba553d0-fb76-495b-a7e0-ec67368cc6ab None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:02.572277 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:02.629473 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab2fc9-2c32-4d1e-bc46-715788d91889 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:02.629994 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab2fc9-2c32-4d1e-bc46-715788d91889 service nova] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:02.630296 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab2fc9-2c32-4d1e-bc46-715788d91889 service nova] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:02.630566 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab2fc9-2c32-4d1e-bc46-715788d91889 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:02.632178 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-49ab2fc9-2c32-4d1e-bc46-715788d91889 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:02.717264 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab2fc9-2c32-4d1e-bc46-715788d91889 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:02.719315 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab2fc9-2c32-4d1e-bc46-715788d91889 service nova] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:02.736820 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 718/1435] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:19:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:19:03.609936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111dd95-7817-4ecf-b6aa-06cba3b130fd None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:03.610510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111dd95-7817-4ecf-b6aa-06cba3b130fd None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:03.610510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111dd95-7817-4ecf-b6aa-06cba3b130fd None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:03.611938 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 718/1436] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 02:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:03.617085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729e559-6278-492d-aef5-2f5fa0eeae44 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:03.617488 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729e559-6278-492d-aef5-2f5fa0eeae44 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:03.617632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729e559-6278-492d-aef5-2f5fa0eeae44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:03.692347 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-6729e559-6278-492d-aef5-2f5fa0eeae44 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:03.693538 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-6729e559-6278-492d-aef5-2f5fa0eeae44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:03.695786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:03.789814 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 719/1437] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 02:19:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:19:03.941296 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111dd95-7817-4ecf-b6aa-06cba3b130fd None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:03.950101 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-c111dd95-7817-4ecf-b6aa-06cba3b130fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:04.085914 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111dd95-7817-4ecf-b6aa-06cba3b130fd None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:04.113867 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:04.196653 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec05fee-4ef6-4873-945b-9c22a808bee5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:04.197293 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec05fee-4ef6-4873-945b-9c22a808bee5 service nova] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:04.197578 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec05fee-4ef6-4873-945b-9c22a808bee5 service nova] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:04.197855 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec05fee-4ef6-4873-945b-9c22a808bee5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:04.199513 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-cec05fee-4ef6-4873-945b-9c22a808bee5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:04.287695 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec05fee-4ef6-4873-945b-9c22a808bee5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:04.289267 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec05fee-4ef6-4873-945b-9c22a808bee5 service nova] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:04.307426 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 719/1438] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:19:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:19:06.178803 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53dbaaa-aab5-4dfa-b1f5-8c4f3aa7ba47 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:06.179388 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53dbaaa-aab5-4dfa-b1f5-8c4f3aa7ba47 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:06.179503 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53dbaaa-aab5-4dfa-b1f5-8c4f3aa7ba47 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:06.180790 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 720/1439] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:19:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:06.186056 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d6099-8b03-4c6e-a78d-d393506cce7b None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:06.186446 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d6099-8b03-4c6e-a78d-d393506cce7b None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:06.186611 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d6099-8b03-4c6e-a78d-d393506cce7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:06.226712 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:06.253238 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-3a3d6099-8b03-4c6e-a78d-d393506cce7b None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:06.254721 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-3a3d6099-8b03-4c6e-a78d-d393506cce7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:06.349480 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 720/1440] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:19:06.387770 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53dbaaa-aab5-4dfa-b1f5-8c4f3aa7ba47 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:06.389819 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-d53dbaaa-aab5-4dfa-b1f5-8c4f3aa7ba47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:06.490475 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53dbaaa-aab5-4dfa-b1f5-8c4f3aa7ba47 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:06.521896 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:06.562577 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9c177-492c-440a-a7a6-61db0f7dc725 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:06.563192 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9c177-492c-440a-a7a6-61db0f7dc725 service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:06.565210 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9c177-492c-440a-a7a6-61db0f7dc725 service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:06.565210 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9c177-492c-440a-a7a6-61db0f7dc725 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:06.566344 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-efb9c177-492c-440a-a7a6-61db0f7dc725 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:06.671318 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb9c177-492c-440a-a7a6-61db0f7dc725 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:06.672762 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb9c177-492c-440a-a7a6-61db0f7dc725 service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:06.690391 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 721/1441] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:19:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:19:08.888247 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc224be0-560b-4fc1-b5ae-fd59d9f97143 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:08.888826 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc224be0-560b-4fc1-b5ae-fd59d9f97143 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:08.888826 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc224be0-560b-4fc1-b5ae-fd59d9f97143 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:08.890178 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 721/1442] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:08.895412 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8754181-52b1-48f0-bfd5-4843f80f5769 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:08.895855 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8754181-52b1-48f0-bfd5-4843f80f5769 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:08.895971 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8754181-52b1-48f0-bfd5-4843f80f5769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:08.960510 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-a8754181-52b1-48f0-bfd5-4843f80f5769 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:08.961699 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-a8754181-52b1-48f0-bfd5-4843f80f5769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:08.974366 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:09.055605 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 722/1443] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:19:09.109138 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f37afa-efaa-4dca-a6fe-7a6b964c76f3 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:09.109427 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f37afa-efaa-4dca-a6fe-7a6b964c76f3 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:09.109732 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f37afa-efaa-4dca-a6fe-7a6b964c76f3 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:09.111111 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 722/1444] 10.222.0.23 () {54 vars in 965 bytes} [Mon Aug 8 02:19:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:09.116795 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09a906-b47d-4313-af99-42200fa0f8af None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:09.117091 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09a906-b47d-4313-af99-42200fa0f8af None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:09.117373 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09a906-b47d-4313-af99-42200fa0f8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:09.190659 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-6b09a906-b47d-4313-af99-42200fa0f8af None None] MFA Rules not processed for user `fa4c5732acb844369140e8d970577f94`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:09.191898 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-6b09a906-b47d-4313-af99-42200fa0f8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:09.266258 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 723/1445] 10.222.0.23 () {58 vars in 1062 bytes} [Mon Aug 8 02:19:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:19:09.275272 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f37afa-efaa-4dca-a6fe-7a6b964c76f3 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:09.276865 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-65f37afa-efaa-4dca-a6fe-7a6b964c76f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:09.380710 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f37afa-efaa-4dca-a6fe-7a6b964c76f3 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:09.393410 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:09.454793 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64379bc6-ad2c-401a-bb78-c9a6c47d2886 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:09.455431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64379bc6-ad2c-401a-bb78-c9a6c47d2886 service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:09.455742 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64379bc6-ad2c-401a-bb78-c9a6c47d2886 service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:09.456017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64379bc6-ad2c-401a-bb78-c9a6c47d2886 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:09.457617 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-64379bc6-ad2c-401a-bb78-c9a6c47d2886 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:09.566537 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64379bc6-ad2c-401a-bb78-c9a6c47d2886 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:09.568000 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64379bc6-ad2c-401a-bb78-c9a6c47d2886 service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:09.586666 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 723/1446] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:19:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:19:12.392017 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf7c9a-cbef-48f3-8f89-f0068f6a32c2 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:12.392458 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf7c9a-cbef-48f3-8f89-f0068f6a32c2 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:12.392575 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf7c9a-cbef-48f3-8f89-f0068f6a32c2 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:12.393899 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:12.399170 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181d13c-1586-4e19-9bcb-d8ddf89744b8 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:12.399620 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181d13c-1586-4e19-9bcb-d8ddf89744b8 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:12.399790 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181d13c-1586-4e19-9bcb-d8ddf89744b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:12.447427 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:12.465593 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-6181d13c-1586-4e19-9bcb-d8ddf89744b8 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:12.466801 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-6181d13c-1586-4e19-9bcb-d8ddf89744b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:12.562147 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:19:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:19:12.601771 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf7c9a-cbef-48f3-8f89-f0068f6a32c2 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:12.603299 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-1cbf7c9a-cbef-48f3-8f89-f0068f6a32c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:12.611328 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:12.703905 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf7c9a-cbef-48f3-8f89-f0068f6a32c2 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:12.773673 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3a034-37dc-4142-8c16-83418014e87e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:12.774266 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3a034-37dc-4142-8c16-83418014e87e service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:12.774541 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3a034-37dc-4142-8c16-83418014e87e service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:12.774810 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3a034-37dc-4142-8c16-83418014e87e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:12.776403 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-1cc3a034-37dc-4142-8c16-83418014e87e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:12.835564 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:12.882722 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc3a034-37dc-4142-8c16-83418014e87e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:12.884179 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc3a034-37dc-4142-8c16-83418014e87e service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:12.902636 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 725/1449] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:19:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:19:15.110739 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7203b-a0c8-40be-adce-129786efd4d0 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:15.111330 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7203b-a0c8-40be-adce-129786efd4d0 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:15.111330 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7203b-a0c8-40be-adce-129786efd4d0 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:15.112663 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:15.117990 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10e68f-270f-4d05-b53e-bae8945ee3ec None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:15.118668 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10e68f-270f-4d05-b53e-bae8945ee3ec None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:15.118668 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10e68f-270f-4d05-b53e-bae8945ee3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:15.183253 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-0c10e68f-270f-4d05-b53e-bae8945ee3ec None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:15.184470 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-0c10e68f-270f-4d05-b53e-bae8945ee3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:15.278046 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:19:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:19:15.317995 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7203b-a0c8-40be-adce-129786efd4d0 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:15.319831 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-f1b7203b-a0c8-40be-adce-129786efd4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:15.423886 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7203b-a0c8-40be-adce-129786efd4d0 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:15.445171 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:15.499316 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71c761-f94c-4207-a382-2b4f01e1dc2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:15.499941 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71c761-f94c-4207-a382-2b4f01e1dc2c service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:15.500223 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71c761-f94c-4207-a382-2b4f01e1dc2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:15.500500 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71c761-f94c-4207-a382-2b4f01e1dc2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:15.502096 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-af71c761-f94c-4207-a382-2b4f01e1dc2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:15.611099 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71c761-f94c-4207-a382-2b4f01e1dc2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:15.612548 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71c761-f94c-4207-a382-2b4f01e1dc2c service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:15.630615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 726/1452] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:19:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:19:17.682655 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c7506-10b7-4038-8248-69a85adcaad1 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:17.683226 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c7506-10b7-4038-8248-69a85adcaad1 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:17.683226 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c7506-10b7-4038-8248-69a85adcaad1 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:17.684590 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:17.690576 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9c241-c6fd-4d65-a821-277b2943d6be None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:17.690984 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9c241-c6fd-4d65-a821-277b2943d6be None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:17.691127 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9c241-c6fd-4d65-a821-277b2943d6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:17.756104 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:17.758749 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-c1b9c241-c6fd-4d65-a821-277b2943d6be None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:17.759984 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-c1b9c241-c6fd-4d65-a821-277b2943d6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:17.855671 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:19:17.893764 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c7506-10b7-4038-8248-69a85adcaad1 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:17.895288 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-9c6c7506-10b7-4038-8248-69a85adcaad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:17.913266 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:17.997702 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c7506-10b7-4038-8248-69a85adcaad1 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:18.067604 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2b638-4a92-4cda-b853-c7ada8370c78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:18.068198 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2b638-4a92-4cda-b853-c7ada8370c78 service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:18.068472 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2b638-4a92-4cda-b853-c7ada8370c78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:18.068743 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2b638-4a92-4cda-b853-c7ada8370c78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:18.070571 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-5ea2b638-4a92-4cda-b853-c7ada8370c78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:18.137735 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:18.176711 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2b638-4a92-4cda-b853-c7ada8370c78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:18.178142 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2b638-4a92-4cda-b853-c7ada8370c78 service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:18.197434 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 728/1455] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:19:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:19:20.286354 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefa7f2-7d3d-489e-af06-87f8b748b462 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:20.286918 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefa7f2-7d3d-489e-af06-87f8b748b462 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:20.286918 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefa7f2-7d3d-489e-af06-87f8b748b462 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:20.288313 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:20.293737 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f33d3-2067-458c-b2f2-31169c27afa1 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:20.294129 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f33d3-2067-458c-b2f2-31169c27afa1 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:20.298596 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f33d3-2067-458c-b2f2-31169c27afa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:20.360527 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-4d1f33d3-2067-458c-b2f2-31169c27afa1 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:20.361654 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-4d1f33d3-2067-458c-b2f2-31169c27afa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:20.458167 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:19:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:19:20.496652 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afefa7f2-7d3d-489e-af06-87f8b748b462 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:20.498192 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-afefa7f2-7d3d-489e-af06-87f8b748b462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:20.599150 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afefa7f2-7d3d-489e-af06-87f8b748b462 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:20.626153 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:20.669481 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2cb0e0-f991-4bf0-ba3b-be4977ce1c64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:20.670076 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2cb0e0-f991-4bf0-ba3b-be4977ce1c64 service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:20.670379 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2cb0e0-f991-4bf0-ba3b-be4977ce1c64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:20.670649 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2cb0e0-f991-4bf0-ba3b-be4977ce1c64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:20.672259 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-4c2cb0e0-f991-4bf0-ba3b-be4977ce1c64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:20.778986 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2cb0e0-f991-4bf0-ba3b-be4977ce1c64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:20.780972 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2cb0e0-f991-4bf0-ba3b-be4977ce1c64 service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:20.798760 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 729/1458] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:19:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:19:22.835813 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2e73c-5c92-4787-9fa8-732be92f8085 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:22.836378 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2e73c-5c92-4787-9fa8-732be92f8085 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:22.836378 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2e73c-5c92-4787-9fa8-732be92f8085 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:22.837743 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:22.842877 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd205753-c9ef-48b6-b4d2-dd8d3f0e352f None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:22.843297 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd205753-c9ef-48b6-b4d2-dd8d3f0e352f None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:22.843434 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd205753-c9ef-48b6-b4d2-dd8d3f0e352f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:22.906659 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-cd205753-c9ef-48b6-b4d2-dd8d3f0e352f None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:22.907883 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-cd205753-c9ef-48b6-b4d2-dd8d3f0e352f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:22.915878 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:23.005287 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:19:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:19:23.043032 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2e73c-5c92-4787-9fa8-732be92f8085 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:23.044598 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-75f2e73c-5c92-4787-9fa8-732be92f8085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:23.072370 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:23.146815 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2e73c-5c92-4787-9fa8-732be92f8085 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:23.217718 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5189a-db47-43c8-8091-19ea81f654f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:23.218323 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5189a-db47-43c8-8091-19ea81f654f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:23.218608 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5189a-db47-43c8-8091-19ea81f654f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:23.218881 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5189a-db47-43c8-8091-19ea81f654f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:23.220506 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-1ce5189a-db47-43c8-8091-19ea81f654f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:23.294766 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:23.326697 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5189a-db47-43c8-8091-19ea81f654f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:23.328148 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5189a-db47-43c8-8091-19ea81f654f4 service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:23.346258 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 731/1461] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:19:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:19:25.371476 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81808e1e-ae6a-432d-995b-fa1400878d58 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:25.372039 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81808e1e-ae6a-432d-995b-fa1400878d58 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:25.372039 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81808e1e-ae6a-432d-995b-fa1400878d58 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:25.373971 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:19:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:25.379070 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbfad4-5d06-4d32-a1cc-bf8cf98a3ec7 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:25.379557 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbfad4-5d06-4d32-a1cc-bf8cf98a3ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:25.379662 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbfad4-5d06-4d32-a1cc-bf8cf98a3ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:25.445895 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-bcdbfad4-5d06-4d32-a1cc-bf8cf98a3ec7 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:25.447104 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-bcdbfad4-5d06-4d32-a1cc-bf8cf98a3ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:25.540627 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:19:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:19:25.578411 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81808e1e-ae6a-432d-995b-fa1400878d58 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:25.579996 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-81808e1e-ae6a-432d-995b-fa1400878d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:25.680286 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81808e1e-ae6a-432d-995b-fa1400878d58 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:25.717938 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:25.753349 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a5798-f613-43b7-a245-c1fe6b07f557 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:25.753995 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a5798-f613-43b7-a245-c1fe6b07f557 service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:25.754278 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a5798-f613-43b7-a245-c1fe6b07f557 service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:25.754553 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a5798-f613-43b7-a245-c1fe6b07f557 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:25.756188 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-344a5798-f613-43b7-a245-c1fe6b07f557 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:25.865064 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a5798-f613-43b7-a245-c1fe6b07f557 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:25.866493 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a5798-f613-43b7-a245-c1fe6b07f557 service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:25.884997 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 732/1464] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:19:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:19:27.891040 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd920f6e-79ec-4dcb-a086-223876935143 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:27.891655 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd920f6e-79ec-4dcb-a086-223876935143 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:27.891655 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd920f6e-79ec-4dcb-a086-223876935143 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:27.893018 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:19:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:27.898236 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e2dca-06e5-4f35-ab3b-5587393f05e7 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:27.898666 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e2dca-06e5-4f35-ab3b-5587393f05e7 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:27.898763 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e2dca-06e5-4f35-ab3b-5587393f05e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:27.964135 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-5f5e2dca-06e5-4f35-ab3b-5587393f05e7 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:27.965327 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-5f5e2dca-06e5-4f35-ab3b-5587393f05e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:27.984242 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:28.061671 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:19:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:19:28.098723 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd920f6e-79ec-4dcb-a086-223876935143 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:28.100376 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-fd920f6e-79ec-4dcb-a086-223876935143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:28.135835 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:28.200539 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd920f6e-79ec-4dcb-a086-223876935143 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:28.272295 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb9321c-2d2e-4026-8ed2-c632024f8d5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:28.272891 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9321c-2d2e-4026-8ed2-c632024f8d5a service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:28.273171 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9321c-2d2e-4026-8ed2-c632024f8d5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:28.273445 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9321c-2d2e-4026-8ed2-c632024f8d5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:28.275035 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-5bb9321c-2d2e-4026-8ed2-c632024f8d5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:28.354807 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:28.381083 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb9321c-2d2e-4026-8ed2-c632024f8d5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:28.382510 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb9321c-2d2e-4026-8ed2-c632024f8d5a service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:28.401370 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 734/1467] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:19:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:19:30.399540 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a3f6e-d803-49fb-8e36-6c8eb3e6a021 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:30.400078 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a3f6e-d803-49fb-8e36-6c8eb3e6a021 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:30.400078 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a3f6e-d803-49fb-8e36-6c8eb3e6a021 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:30.401506 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:30.407344 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8984f56-ef3a-4730-97a7-4adf5e43ad45 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:30.407826 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8984f56-ef3a-4730-97a7-4adf5e43ad45 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:30.407934 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8984f56-ef3a-4730-97a7-4adf5e43ad45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:30.474470 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-d8984f56-ef3a-4730-97a7-4adf5e43ad45 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:30.476006 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-d8984f56-ef3a-4730-97a7-4adf5e43ad45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:30.575749 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:19:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:19:30.612072 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a3f6e-d803-49fb-8e36-6c8eb3e6a021 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:30.613596 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-7e4a3f6e-d803-49fb-8e36-6c8eb3e6a021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:30.714680 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a3f6e-d803-49fb-8e36-6c8eb3e6a021 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:30.761353 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:30.787099 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb385f46-cfac-4d71-b545-9158c48f4892 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:30.787726 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb385f46-cfac-4d71-b545-9158c48f4892 service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:30.788006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb385f46-cfac-4d71-b545-9158c48f4892 service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:30.788278 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb385f46-cfac-4d71-b545-9158c48f4892 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:30.789870 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-bb385f46-cfac-4d71-b545-9158c48f4892 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:30.899865 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb385f46-cfac-4d71-b545-9158c48f4892 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:30.901281 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb385f46-cfac-4d71-b545-9158c48f4892 service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:30.921241 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 735/1470] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:19:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:19:40.573986 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=81 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:40.918308 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=66 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:50.453560 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc0497-9d2b-42e9-9a61-ef59002ad7fb None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:50.454086 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc0497-9d2b-42e9-9a61-ef59002ad7fb None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:50.454086 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc0497-9d2b-42e9-9a61-ef59002ad7fb None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:50.455611 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 736/1471] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:19:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:50.460676 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219ec6c-3e7c-47c7-8ce3-0509d6602f38 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:50.461089 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219ec6c-3e7c-47c7-8ce3-0509d6602f38 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:50.461235 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219ec6c-3e7c-47c7-8ce3-0509d6602f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:50.525327 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-d219ec6c-3e7c-47c7-8ce3-0509d6602f38 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:50.526527 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-d219ec6c-3e7c-47c7-8ce3-0509d6602f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:50.624885 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 736/1472] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:19:50.708128 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6dfc4-242d-4136-b8f2-e6d2de3c3e7c None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:50.708415 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6dfc4-242d-4136-b8f2-e6d2de3c3e7c None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:50.708690 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6dfc4-242d-4136-b8f2-e6d2de3c3e7c None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:50.709999 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 737/1473] 10.222.0.23 () {54 vars in 966 bytes} [Mon Aug 8 02:19:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:50.714735 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24bd52-bf66-49e9-a161-36a33ef9ceb3 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:50.715032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24bd52-bf66-49e9-a161-36a33ef9ceb3 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:50.715317 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24bd52-bf66-49e9-a161-36a33ef9ceb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:50.790522 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-1c24bd52-bf66-49e9-a161-36a33ef9ceb3 None None] MFA Rules not processed for user `aae574170d6f4eb8ab70805d8b5f4f08`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:50.794475 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-1c24bd52-bf66-49e9-a161-36a33ef9ceb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:50.812817 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:50.866772 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 737/1474] 10.222.0.23 () {58 vars in 1063 bytes} [Mon Aug 8 02:19:50 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:19:50.874993 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6dfc4-242d-4136-b8f2-e6d2de3c3e7c None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:50.876538 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-2ce6dfc4-242d-4136-b8f2-e6d2de3c3e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:50.976464 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6dfc4-242d-4136-b8f2-e6d2de3c3e7c None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:51.047032 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2febe2-fef8-440d-97d4-18d05ba8191c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aae574170d6f4eb8ab70805d8b5f4f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:51.047662 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2febe2-fef8-440d-97d4-18d05ba8191c service glance] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:51.047943 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2febe2-fef8-440d-97d4-18d05ba8191c service glance] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:51.048221 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2febe2-fef8-440d-97d4-18d05ba8191c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:51.049798 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-bd2febe2-fef8-440d-97d4-18d05ba8191c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:51.101546 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:51.155118 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2febe2-fef8-440d-97d4-18d05ba8191c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:51.156591 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2febe2-fef8-440d-97d4-18d05ba8191c service glance] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:51.174777 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 738/1475] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:19:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:19:53.279199 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c61b5-a577-4024-bf77-cd222b6d176d None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:53.279786 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c61b5-a577-4024-bf77-cd222b6d176d None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:53.279786 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c61b5-a577-4024-bf77-cd222b6d176d None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:53.281151 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 738/1476] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:19:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:53.286476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f1198-4496-4f07-a22b-bffa1f9a44da None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:53.286910 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f1198-4496-4f07-a22b-bffa1f9a44da None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:53.287019 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f1198-4496-4f07-a22b-bffa1f9a44da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:53.351169 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-831f1198-4496-4f07-a22b-bffa1f9a44da None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:53.352399 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-831f1198-4496-4f07-a22b-bffa1f9a44da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:53.448144 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 739/1477] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:19:53.471767 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c61b5-a577-4024-bf77-cd222b6d176d None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:53.473294 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-8b9c61b5-a577-4024-bf77-cd222b6d176d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:53.597965 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c61b5-a577-4024-bf77-cd222b6d176d None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:53.648348 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:53.692623 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d68ee-2916-4812-84ca-d67b176f5a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:53.693231 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d68ee-2916-4812-84ca-d67b176f5a2d admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:53.693515 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d68ee-2916-4812-84ca-d67b176f5a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:53.693792 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d68ee-2916-4812-84ca-d67b176f5a2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:53.694429 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d68ee-2916-4812-84ca-d67b176f5a2d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:53.696435 dv-cinder-740146-18-smb devstack@keystone.service[80638]: WARNING py.warnings [None req-d28d68ee-2916-4812-84ca-d67b176f5a2d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:19:53.696435 dv-cinder-740146-18-smb devstack@keystone.service[80638]: warnings.warn(msg) Aug 08 02:19:53.696435 dv-cinder-740146-18-smb devstack@keystone.service[80638]: Aug 08 02:19:53.697579 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d68ee-2916-4812-84ca-d67b176f5a2d admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:53.716173 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 739/1478] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 02:19:53 2022] GET /identity/v3/projects => generated 2553 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:19:55.702708 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800292f8-e251-40a8-8ce4-eec05f080676 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:55.703252 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800292f8-e251-40a8-8ce4-eec05f080676 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:55.703252 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800292f8-e251-40a8-8ce4-eec05f080676 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:55.704607 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 740/1479] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:19:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:55.709652 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcfdb2-2229-487c-81c7-5bc5c262764c None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:55.710081 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcfdb2-2229-487c-81c7-5bc5c262764c None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:55.710245 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcfdb2-2229-487c-81c7-5bc5c262764c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:55.774791 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-18dcfdb2-2229-487c-81c7-5bc5c262764c None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:55.776034 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-18dcfdb2-2229-487c-81c7-5bc5c262764c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:55.871708 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 740/1480] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:19:55.914013 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800292f8-e251-40a8-8ce4-eec05f080676 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:55.915555 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-800292f8-e251-40a8-8ce4-eec05f080676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:55.925730 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:56.058942 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800292f8-e251-40a8-8ce4-eec05f080676 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:56.137106 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:56.180980 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36863e-068c-4495-8461-6b30079af5e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:56.181585 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36863e-068c-4495-8461-6b30079af5e0 service nova] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:56.181869 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36863e-068c-4495-8461-6b30079af5e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:56.182146 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36863e-068c-4495-8461-6b30079af5e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:56.183781 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-1c36863e-068c-4495-8461-6b30079af5e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:56.281153 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c36863e-068c-4495-8461-6b30079af5e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:56.282724 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c36863e-068c-4495-8461-6b30079af5e0 service nova] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:56.300860 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 741/1481] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:19:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:19:58.458215 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3057d-2eac-439b-b843-e813d80edbe3 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:58.458857 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3057d-2eac-439b-b843-e813d80edbe3 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:58.458857 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3057d-2eac-439b-b843-e813d80edbe3 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:58.460145 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 741/1482] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:19:58.465193 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183114e1-0fee-445a-9ea8-150f52ab1081 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:58.465614 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183114e1-0fee-445a-9ea8-150f52ab1081 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:58.465736 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183114e1-0fee-445a-9ea8-150f52ab1081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:58.533819 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-183114e1-0fee-445a-9ea8-150f52ab1081 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:19:58.535040 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-183114e1-0fee-445a-9ea8-150f52ab1081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:58.580938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:58.632249 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 742/1483] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:19:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:19:58.670770 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3057d-2eac-439b-b843-e813d80edbe3 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:19:58.672419 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-74c3057d-2eac-439b-b843-e813d80edbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:58.698649 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:58.788711 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3057d-2eac-439b-b843-e813d80edbe3 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:19:58.869107 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c3179b-55e9-4cd4-a829-936e3da12085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:19:58.869712 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3179b-55e9-4cd4-a829-936e3da12085 service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:19:58.869991 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3179b-55e9-4cd4-a829-936e3da12085 service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:19:58.870263 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3179b-55e9-4cd4-a829-936e3da12085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:19:58.871902 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-42c3179b-55e9-4cd4-a829-936e3da12085 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:19:58.952619 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:58.990938 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c3179b-55e9-4cd4-a829-936e3da12085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:19:58.992407 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c3179b-55e9-4cd4-a829-936e3da12085 service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:19:59.010837 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 742/1484] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:19:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:20:01.069099 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f62c49-1e46-4794-87f7-7f7ade21fbe3 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:01.069669 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f62c49-1e46-4794-87f7-7f7ade21fbe3 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:01.069669 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f62c49-1e46-4794-87f7-7f7ade21fbe3 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:01.071250 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 743/1485] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:20:01.076800 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c5083-e6d0-4934-a4e8-1fdc0498ba13 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:01.077237 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c5083-e6d0-4934-a4e8-1fdc0498ba13 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:01.077343 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c5083-e6d0-4934-a4e8-1fdc0498ba13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:01.141562 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-241c5083-e6d0-4934-a4e8-1fdc0498ba13 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:01.142763 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-241c5083-e6d0-4934-a4e8-1fdc0498ba13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:01.239039 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 743/1486] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:20:01.276774 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f62c49-1e46-4794-87f7-7f7ade21fbe3 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:01.278315 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-d8f62c49-1e46-4794-87f7-7f7ade21fbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:01.382632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f62c49-1e46-4794-87f7-7f7ade21fbe3 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:01.454593 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:01.463225 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f6be2-906a-4126-95ea-708a7ea5e535 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:01.463225 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f6be2-906a-4126-95ea-708a7ea5e535 service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:01.463225 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f6be2-906a-4126-95ea-708a7ea5e535 service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:01.463225 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f6be2-906a-4126-95ea-708a7ea5e535 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:01.463676 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-0c4f6be2-906a-4126-95ea-708a7ea5e535 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:01.565885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f6be2-906a-4126-95ea-708a7ea5e535 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:01.567318 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f6be2-906a-4126-95ea-708a7ea5e535 service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:01.586259 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 744/1487] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:20:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:20:03.683828 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9bd2e-9499-4c3b-b677-87294302499a None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:03.684417 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9bd2e-9499-4c3b-b677-87294302499a None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:03.684417 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9bd2e-9499-4c3b-b677-87294302499a None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:03.685737 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 744/1488] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:03.691094 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f8d82-dbd4-49c6-b714-12439bf98e47 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:03.691567 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f8d82-dbd4-49c6-b714-12439bf98e47 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:03.691676 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f8d82-dbd4-49c6-b714-12439bf98e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:03.757602 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-d96f8d82-dbd4-49c6-b714-12439bf98e47 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:03.758813 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-d96f8d82-dbd4-49c6-b714-12439bf98e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:03.810450 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:03.854189 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 745/1489] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:20:03.894345 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9bd2e-9499-4c3b-b677-87294302499a None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:03.895948 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-9ed9bd2e-9499-4c3b-b677-87294302499a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:03.932361 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:04.006947 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9bd2e-9499-4c3b-b677-87294302499a None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:04.080193 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552af38f-d8fa-4452-a57e-6f4bd90c7196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:04.080796 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552af38f-d8fa-4452-a57e-6f4bd90c7196 service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:04.081081 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552af38f-d8fa-4452-a57e-6f4bd90c7196 service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:04.081363 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552af38f-d8fa-4452-a57e-6f4bd90c7196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:04.082962 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-552af38f-d8fa-4452-a57e-6f4bd90c7196 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:04.164676 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:04.194661 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552af38f-d8fa-4452-a57e-6f4bd90c7196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:04.196436 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552af38f-d8fa-4452-a57e-6f4bd90c7196 service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:04.214731 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 745/1490] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:20:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:20:06.561253 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4499bec-f85d-418c-b58a-8d8a16796c26 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:06.561828 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4499bec-f85d-418c-b58a-8d8a16796c26 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:06.561828 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4499bec-f85d-418c-b58a-8d8a16796c26 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:06.563147 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 746/1491] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 02:20:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:20:06.568237 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a4de6-6e1c-4a02-8a27-b6516c4c21f7 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:06.568670 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a4de6-6e1c-4a02-8a27-b6516c4c21f7 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:06.568784 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a4de6-6e1c-4a02-8a27-b6516c4c21f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:06.634679 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-b93a4de6-6e1c-4a02-8a27-b6516c4c21f7 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:20:06.635853 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-b93a4de6-6e1c-4a02-8a27-b6516c4c21f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:06.730138 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 746/1492] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 02:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:20:06.768958 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4499bec-f85d-418c-b58a-8d8a16796c26 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:20:06.770482 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-c4499bec-f85d-418c-b58a-8d8a16796c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:06.874849 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4499bec-f85d-418c-b58a-8d8a16796c26 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:20:06.946578 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6703f193-56f4-4db6-b10d-7775d50295ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:20:06.947171 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703f193-56f4-4db6-b10d-7775d50295ba service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:20:06.947543 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703f193-56f4-4db6-b10d-7775d50295ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:20:06.947821 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703f193-56f4-4db6-b10d-7775d50295ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:20:06.949675 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-6703f193-56f4-4db6-b10d-7775d50295ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:20:06.958479 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:07.057622 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6703f193-56f4-4db6-b10d-7775d50295ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:20:07.059054 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6703f193-56f4-4db6-b10d-7775d50295ba service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:20:07.077544 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 747/1493] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:20:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:20:16.728363 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=82 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:17.074716 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=50 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:21:27.333440 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85461206-bca9-4fb6-8a89-df3359d308b1 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:27.334047 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85461206-bca9-4fb6-8a89-df3359d308b1 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:27.334047 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85461206-bca9-4fb6-8a89-df3359d308b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:27.411935 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-85461206-bca9-4fb6-8a89-df3359d308b1 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:21:27.413137 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-85461206-bca9-4fb6-8a89-df3359d308b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:21:27.506129 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 747/1494] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:21:27.514719 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8085a47-fe74-4e4a-a3b7-e5d0f9e73139 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:27.515206 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8085a47-fe74-4e4a-a3b7-e5d0f9e73139 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:27.515313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8085a47-fe74-4e4a-a3b7-e5d0f9e73139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:27.589272 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-b8085a47-fe74-4e4a-a3b7-e5d0f9e73139 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:21:27.590433 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-b8085a47-fe74-4e4a-a3b7-e5d0f9e73139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:21:27.684475 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 748/1495] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:21:27.689657 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85461206-bca9-4fb6-8a89-df3359d308b1 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:27.690859 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-85461206-bca9-4fb6-8a89-df3359d308b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:21:27.703054 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85461206-bca9-4fb6-8a89-df3359d308b1 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:27.761922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:21:27.794540 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3efb4d-c603-4311-8d66-ec2eaa0f7f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:27.795131 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3efb4d-c603-4311-8d66-ec2eaa0f7f6b admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:27.795462 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3efb4d-c603-4311-8d66-ec2eaa0f7f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:27.795737 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3efb4d-c603-4311-8d66-ec2eaa0f7f6b admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:27.796398 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3efb4d-c603-4311-8d66-ec2eaa0f7f6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:21:27.796696 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3efb4d-c603-4311-8d66-ec2eaa0f7f6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:27.797710 dv-cinder-740146-18-smb devstack@keystone.service[80638]: WARNING py.warnings [None req-7b3efb4d-c603-4311-8d66-ec2eaa0f7f6b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:21:27.797710 dv-cinder-740146-18-smb devstack@keystone.service[80638]: warnings.warn(msg) Aug 08 02:21:27.797710 dv-cinder-740146-18-smb devstack@keystone.service[80638]: Aug 08 02:21:27.798563 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3efb4d-c603-4311-8d66-ec2eaa0f7f6b admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:27.809354 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 748/1496] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:21:27.818130 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8085a47-fe74-4e4a-a3b7-e5d0f9e73139 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:27.828327 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8085a47-fe74-4e4a-a3b7-e5d0f9e73139 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:27.888450 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:21:27.922615 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c06bd0-03f9-467a-9062-4743740f1f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:27.923209 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c06bd0-03f9-467a-9062-4743740f1f36 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:27.923521 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c06bd0-03f9-467a-9062-4743740f1f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:27.923792 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c06bd0-03f9-467a-9062-4743740f1f36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:27.924417 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c06bd0-03f9-467a-9062-4743740f1f36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:27.926117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: WARNING py.warnings [None req-59c06bd0-03f9-467a-9062-4743740f1f36 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:21:27.926117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: warnings.warn(msg) Aug 08 02:21:27.926117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: Aug 08 02:21:27.927326 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c06bd0-03f9-467a-9062-4743740f1f36 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:28.069832 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 749/1497] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:21:27 2022] POST /identity/v3/projects => generated 373 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:21:28.074293 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3efb4d-c603-4311-8d66-ec2eaa0f7f6b admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:28.075840 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-7b3efb4d-c603-4311-8d66-ec2eaa0f7f6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:21:28.109640 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3efb4d-c603-4311-8d66-ec2eaa0f7f6b admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:28.202947 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc68b2c-b3e0-4221-b3f3-5e9bd2460c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:28.203577 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc68b2c-b3e0-4221-b3f3-5e9bd2460c4e admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:28.203862 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc68b2c-b3e0-4221-b3f3-5e9bd2460c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:28.204141 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc68b2c-b3e0-4221-b3f3-5e9bd2460c4e admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:28.204773 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc68b2c-b3e0-4221-b3f3-5e9bd2460c4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:28.205778 dv-cinder-740146-18-smb devstack@keystone.service[80638]: WARNING py.warnings [None req-afc68b2c-b3e0-4221-b3f3-5e9bd2460c4e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:21:28.205778 dv-cinder-740146-18-smb devstack@keystone.service[80638]: warnings.warn(msg) Aug 08 02:21:28.205778 dv-cinder-740146-18-smb devstack@keystone.service[80638]: Aug 08 02:21:28.206989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc68b2c-b3e0-4221-b3f3-5e9bd2460c4e admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:28.343837 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 749/1498] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:21:28 2022] POST /identity/v3/users => generated 287 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:21:28.348176 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c06bd0-03f9-467a-9062-4743740f1f36 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:28.349701 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-59c06bd0-03f9-467a-9062-4743740f1f36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:21:28.410331 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c06bd0-03f9-467a-9062-4743740f1f36 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:28.493402 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:21:28.503199 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b7eb2-9f59-46f2-825e-b76a2c7532fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:28.506772 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b7eb2-9f59-46f2-825e-b76a2c7532fb admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:28.506772 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b7eb2-9f59-46f2-825e-b76a2c7532fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:28.506772 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b7eb2-9f59-46f2-825e-b76a2c7532fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:28.506772 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b7eb2-9f59-46f2-825e-b76a2c7532fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:28.506772 dv-cinder-740146-18-smb devstack@keystone.service[80637]: WARNING py.warnings [None req-b86b7eb2-9f59-46f2-825e-b76a2c7532fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:21:28.506772 dv-cinder-740146-18-smb devstack@keystone.service[80637]: warnings.warn(msg) Aug 08 02:21:28.506772 dv-cinder-740146-18-smb devstack@keystone.service[80637]: Aug 08 02:21:28.507370 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b7eb2-9f59-46f2-825e-b76a2c7532fb admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:28.518940 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 750/1499] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:21:28.522989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc68b2c-b3e0-4221-b3f3-5e9bd2460c4e admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:28.524565 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-afc68b2c-b3e0-4221-b3f3-5e9bd2460c4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:21:28.536389 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc68b2c-b3e0-4221-b3f3-5e9bd2460c4e admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:28.561536 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:21:28.630603 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb99f8-cbcc-40dd-ba77-839c982c299e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:28.631197 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb99f8-cbcc-40dd-ba77-839c982c299e admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:28.631510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb99f8-cbcc-40dd-ba77-839c982c299e admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:28.631777 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb99f8-cbcc-40dd-ba77-839c982c299e admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:28.632407 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb99f8-cbcc-40dd-ba77-839c982c299e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:28.633428 dv-cinder-740146-18-smb devstack@keystone.service[80638]: WARNING py.warnings [None req-9fbb99f8-cbcc-40dd-ba77-839c982c299e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:21:28.633428 dv-cinder-740146-18-smb devstack@keystone.service[80638]: warnings.warn(msg) Aug 08 02:21:28.633428 dv-cinder-740146-18-smb devstack@keystone.service[80638]: Aug 08 02:21:28.634405 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb99f8-cbcc-40dd-ba77-839c982c299e admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:28.646358 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 750/1500] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:21:28.650545 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b7eb2-9f59-46f2-825e-b76a2c7532fb admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:28.652091 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-b86b7eb2-9f59-46f2-825e-b76a2c7532fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:21:28.686801 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b7eb2-9f59-46f2-825e-b76a2c7532fb admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:28.780496 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82a2a8-2e32-4879-a98b-265959a697bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:28.781078 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82a2a8-2e32-4879-a98b-265959a697bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:28.781356 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82a2a8-2e32-4879-a98b-265959a697bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:28.781646 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82a2a8-2e32-4879-a98b-265959a697bd admin admin] PATH_INFO: `/v3/projects/5d2ae6e923a940739db42287314aa9ce/users/51ca6db2897146dcae061e2f9b2c0885/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:28.803668 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d82a2a8-2e32-4879-a98b-265959a697bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d2ae6e923a940739db42287314aa9ce, user_id=51ca6db2897146dcae061e2f9b2c0885, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:28.804686 dv-cinder-740146-18-smb devstack@keystone.service[80637]: WARNING py.warnings [None req-0d82a2a8-2e32-4879-a98b-265959a697bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:21:28.804686 dv-cinder-740146-18-smb devstack@keystone.service[80637]: warnings.warn(msg) Aug 08 02:21:28.804686 dv-cinder-740146-18-smb devstack@keystone.service[80637]: Aug 08 02:21:28.806589 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d82a2a8-2e32-4879-a98b-265959a697bd admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:28.915178 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 751/1501] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:21:28 2022] PUT /identity/v3/projects/5d2ae6e923a940739db42287314aa9ce/users/51ca6db2897146dcae061e2f9b2c0885/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:21:28.927246 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9eaa7b-7aac-479b-a6b6-2b8366662479 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:28.927575 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9eaa7b-7aac-479b-a6b6-2b8366662479 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:28.927855 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9eaa7b-7aac-479b-a6b6-2b8366662479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:28.984249 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-da9eaa7b-7aac-479b-a6b6-2b8366662479 None None] MFA Rules not processed for user `51ca6db2897146dcae061e2f9b2c0885`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:21:28.985449 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-da9eaa7b-7aac-479b-a6b6-2b8366662479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:21:29.061811 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 751/1502] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:21:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:21:29.075138 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b3aef-5c81-41c3-9aba-22c9eb0c115a None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:29.075460 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b3aef-5c81-41c3-9aba-22c9eb0c115a None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:29.075742 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b3aef-5c81-41c3-9aba-22c9eb0c115a None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:29.077627 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 752/1503] 10.222.0.23 () {54 vars in 964 bytes} [Mon Aug 8 02:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:21:29.082286 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d4824-e855-4b92-85ce-30d539e9ecad None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:29.082583 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d4824-e855-4b92-85ce-30d539e9ecad None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:29.082868 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d4824-e855-4b92-85ce-30d539e9ecad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:29.113979 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:21:29.159266 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-ea3d4824-e855-4b92-85ce-30d539e9ecad None None] MFA Rules not processed for user `c63640b6bedd4e64b16657a34eb40f3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:21:29.160510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-ea3d4824-e855-4b92-85ce-30d539e9ecad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:21:29.235207 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 752/1504] 10.222.0.23 () {58 vars in 1061 bytes} [Mon Aug 8 02:21:29 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:21:29.242922 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b3aef-5c81-41c3-9aba-22c9eb0c115a None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:29.244462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-c34b3aef-5c81-41c3-9aba-22c9eb0c115a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:21:29.294138 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:21:29.350109 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b3aef-5c81-41c3-9aba-22c9eb0c115a None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:29.422295 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc724d83-3900-42aa-b276-a82240349a35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:29.422903 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc724d83-3900-42aa-b276-a82240349a35 service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:29.423181 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc724d83-3900-42aa-b276-a82240349a35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:29.423519 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc724d83-3900-42aa-b276-a82240349a35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:29.425104 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-bc724d83-3900-42aa-b276-a82240349a35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:21:29.523096 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc724d83-3900-42aa-b276-a82240349a35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:29.524568 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc724d83-3900-42aa-b276-a82240349a35 service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:29.528019 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:21:29.542840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 753/1505] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:21:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:21:29.589896 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b21d55-2311-41ac-8c6c-197cf5a505e7 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:29.590322 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b21d55-2311-41ac-8c6c-197cf5a505e7 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:29.590440 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b21d55-2311-41ac-8c6c-197cf5a505e7 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:29.591736 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 753/1506] 10.222.0.23 () {52 vars in 830 bytes} [Mon Aug 8 02:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:21:29.595415 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc724d83-3900-42aa-b276-a82240349a35 service cinder] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:29.596806 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-bc724d83-3900-42aa-b276-a82240349a35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:21:29.700088 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc724d83-3900-42aa-b276-a82240349a35 service cinder] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:29.806325 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1595f-b881-45db-a587-71fbbde5e4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:29.806953 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1595f-b881-45db-a587-71fbbde5e4aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:29.807272 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1595f-b881-45db-a587-71fbbde5e4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:29.807581 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1595f-b881-45db-a587-71fbbde5e4aa admin admin] PATH_INFO: `/v3/users/51ca6db2897146dcae061e2f9b2c0885` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:29.820143 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1595f-b881-45db-a587-71fbbde5e4aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=51ca6db2897146dcae061e2f9b2c0885)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:29.822277 dv-cinder-740146-18-smb devstack@keystone.service[80637]: WARNING py.warnings [None req-99d1595f-b881-45db-a587-71fbbde5e4aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:21:29.822277 dv-cinder-740146-18-smb devstack@keystone.service[80637]: warnings.warn(msg) Aug 08 02:21:29.822277 dv-cinder-740146-18-smb devstack@keystone.service[80637]: Aug 08 02:21:29.822531 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1595f-b881-45db-a587-71fbbde5e4aa admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:29.832582 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:21:29.990682 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-99d1595f-b881-45db-a587-71fbbde5e4aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51ca6db2897146dcae061e2f9b2c0885'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:21:30.050714 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-99d1595f-b881-45db-a587-71fbbde5e4aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51ca6db2897146dcae061e2f9b2c0885'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:21:30.051150 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-99d1595f-b881-45db-a587-71fbbde5e4aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51ca6db2897146dcae061e2f9b2c0885'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:21:30.074211 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-99d1595f-b881-45db-a587-71fbbde5e4aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51ca6db2897146dcae061e2f9b2c0885'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:21:30.088415 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-99d1595f-b881-45db-a587-71fbbde5e4aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51ca6db2897146dcae061e2f9b2c0885'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:21:30.094093 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 754/1507] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:21:29 2022] DELETE /identity/v3/users/51ca6db2897146dcae061e2f9b2c0885 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:21:30.098454 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f7bac-5678-4d51-a77f-9885a40ad3b3 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:30.098741 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f7bac-5678-4d51-a77f-9885a40ad3b3 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:30.099020 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f7bac-5678-4d51-a77f-9885a40ad3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:30.155090 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-fe1f7bac-5678-4d51-a77f-9885a40ad3b3 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:21:30.156314 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-fe1f7bac-5678-4d51-a77f-9885a40ad3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:21:30.232123 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:21:30.249292 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 754/1508] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:21:30.254817 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1595f-b881-45db-a587-71fbbde5e4aa admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:30.256065 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-99d1595f-b881-45db-a587-71fbbde5e4aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:21:30.352998 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1595f-b881-45db-a587-71fbbde5e4aa admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:30.406684 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:21:30.425349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504de99f-6bf8-4587-ac32-73df8abca13e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:30.425980 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504de99f-6bf8-4587-ac32-73df8abca13e service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:30.426254 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504de99f-6bf8-4587-ac32-73df8abca13e service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:30.426526 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504de99f-6bf8-4587-ac32-73df8abca13e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:30.428198 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-504de99f-6bf8-4587-ac32-73df8abca13e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:21:30.535438 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504de99f-6bf8-4587-ac32-73df8abca13e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:30.536813 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504de99f-6bf8-4587-ac32-73df8abca13e service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:30.555133 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 755/1509] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:21:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:21:31.025179 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f7bac-5678-4d51-a77f-9885a40ad3b3 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:21:31.026661 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-fe1f7bac-5678-4d51-a77f-9885a40ad3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:21:31.038787 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f7bac-5678-4d51-a77f-9885a40ad3b3 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:21:31.137966 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ab644-4909-4ad0-bdbf-1585b4e0baee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:21:31.138495 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ab644-4909-4ad0-bdbf-1585b4e0baee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:21:31.138777 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ab644-4909-4ad0-bdbf-1585b4e0baee admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:21:31.139619 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ab644-4909-4ad0-bdbf-1585b4e0baee admin admin] PATH_INFO: `/v3/projects/5d2ae6e923a940739db42287314aa9ce` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:21:31.149379 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ab644-4909-4ad0-bdbf-1585b4e0baee admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d2ae6e923a940739db42287314aa9ce)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:21:31.150401 dv-cinder-740146-18-smb devstack@keystone.service[80638]: WARNING py.warnings [None req-f73ab644-4909-4ad0-bdbf-1585b4e0baee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:21:31.150401 dv-cinder-740146-18-smb devstack@keystone.service[80638]: warnings.warn(msg) Aug 08 02:21:31.150401 dv-cinder-740146-18-smb devstack@keystone.service[80638]: Aug 08 02:21:31.151620 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ab644-4909-4ad0-bdbf-1585b4e0baee admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:21:31.259971 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-f73ab644-4909-4ad0-bdbf-1585b4e0baee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d2ae6e923a940739db42287314aa9ce', 'request_id': 'req-f73ab644-4909-4ad0-bdbf-1585b4e0baee'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:21:31.266360 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-f73ab644-4909-4ad0-bdbf-1585b4e0baee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d2ae6e923a940739db42287314aa9ce', 'request_id': 'req-f73ab644-4909-4ad0-bdbf-1585b4e0baee'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:21:31.278963 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-f73ab644-4909-4ad0-bdbf-1585b4e0baee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d2ae6e923a940739db42287314aa9ce', 'request_id': 'req-f73ab644-4909-4ad0-bdbf-1585b4e0baee'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:21:31.359609 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-f73ab644-4909-4ad0-bdbf-1585b4e0baee admin admin] The token cache is being invalidate because project 5d2ae6e923a940739db42287314aa9ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:21:31.359905 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-f73ab644-4909-4ad0-bdbf-1585b4e0baee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:21:31.360433 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-f73ab644-4909-4ad0-bdbf-1585b4e0baee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:21:31.361741 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 755/1510] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:21:31 2022] DELETE /identity/v3/projects/5d2ae6e923a940739db42287314aa9ce => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:21:40.552995 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=62 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:21:41.357476 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:05.728661 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6109893-e9b7-44e4-967d-9682cbab0571 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:05.735607 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6109893-e9b7-44e4-967d-9682cbab0571 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:05.735607 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6109893-e9b7-44e4-967d-9682cbab0571 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:05.735607 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 756/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 02:23:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:23:05.736073 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df768c08-5c79-4a9a-9bcd-465002ef2f61 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:05.736482 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df768c08-5c79-4a9a-9bcd-465002ef2f61 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:05.736638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df768c08-5c79-4a9a-9bcd-465002ef2f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:05.818866 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-df768c08-5c79-4a9a-9bcd-465002ef2f61 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:05.820141 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-df768c08-5c79-4a9a-9bcd-465002ef2f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:05.921484 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 756/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 02:23:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:06.073554 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6109893-e9b7-44e4-967d-9682cbab0571 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:06.075919 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-f6109893-e9b7-44e4-967d-9682cbab0571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:06.193340 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6109893-e9b7-44e4-967d-9682cbab0571 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:06.198738 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9283c4-d32b-44eb-9bde-6f67730f9df5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:06.199338 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9283c4-d32b-44eb-9bde-6f67730f9df5 service nova] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:06.199647 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9283c4-d32b-44eb-9bde-6f67730f9df5 service nova] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:06.200174 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9283c4-d32b-44eb-9bde-6f67730f9df5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:06.208111 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9283c4-d32b-44eb-9bde-6f67730f9df5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:06.209671 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9283c4-d32b-44eb-9bde-6f67730f9df5 service nova] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:06.219128 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 757/1513] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:23:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:23:07.051495 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344f0d6-fdee-4125-8f8f-b5563f2417be None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:07.052040 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344f0d6-fdee-4125-8f8f-b5563f2417be None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:07.052040 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344f0d6-fdee-4125-8f8f-b5563f2417be None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:07.053390 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 757/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 02:23:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:23:07.058170 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfdffd-46c8-43e3-a5d8-171d5d0b4d21 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:07.058557 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfdffd-46c8-43e3-a5d8-171d5d0b4d21 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:07.058725 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfdffd-46c8-43e3-a5d8-171d5d0b4d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:07.080042 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-a2dfdffd-46c8-43e3-a5d8-171d5d0b4d21 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:07.081246 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-a2dfdffd-46c8-43e3-a5d8-171d5d0b4d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:07.089058 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 758/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 02:23:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:07.249245 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344f0d6-fdee-4125-8f8f-b5563f2417be None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:07.263349 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344f0d6-fdee-4125-8f8f-b5563f2417be None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:07.269656 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b44bb-913d-4d85-9f74-389c50544c09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:07.270249 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b44bb-913d-4d85-9f74-389c50544c09 service nova] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:07.270534 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b44bb-913d-4d85-9f74-389c50544c09 service nova] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:07.270808 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b44bb-913d-4d85-9f74-389c50544c09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:07.279275 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b44bb-913d-4d85-9f74-389c50544c09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:07.285150 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b44bb-913d-4d85-9f74-389c50544c09 service nova] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:07.291242 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 758/1516] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:23:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:23:07.392480 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8cdfb-adea-4b39-9b5e-56ff961184b8 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:07.392775 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8cdfb-adea-4b39-9b5e-56ff961184b8 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:07.393061 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8cdfb-adea-4b39-9b5e-56ff961184b8 None None] PATH_INFO: `/v3` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:07.394352 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 759/1517] 10.222.0.44 () {54 vars in 925 bytes} [Mon Aug 8 02:23:07 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:23:07.422586 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ff4a2-65b4-49e1-8754-12449a77eb76 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:07.422870 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ff4a2-65b4-49e1-8754-12449a77eb76 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:07.423147 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ff4a2-65b4-49e1-8754-12449a77eb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:07.491135 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-0a0ff4a2-65b4-49e1-8754-12449a77eb76 None None] MFA Rules not processed for user `43a39dd539974180a8165e34de57b552`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:07.492393 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-0a0ff4a2-65b4-49e1-8754-12449a77eb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:07.509206 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:07.562435 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 759/1518] 10.222.0.44 () {58 vars in 1015 bytes} [Mon Aug 8 02:23:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:11.594207 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ffb27-5b38-46d4-9382-154c5098024c None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:11.594710 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ffb27-5b38-46d4-9382-154c5098024c None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:11.594710 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ffb27-5b38-46d4-9382-154c5098024c None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:11.596036 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 760/1519] 10.222.0.23 () {54 vars in 961 bytes} [Mon Aug 8 02:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:23:11.601019 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d189c-98e1-4eba-b403-24e3cbc56420 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:11.601422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d189c-98e1-4eba-b403-24e3cbc56420 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:11.601585 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d189c-98e1-4eba-b403-24e3cbc56420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:11.620575 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-e73d189c-98e1-4eba-b403-24e3cbc56420 None None] MFA Rules not processed for user `43a39dd539974180a8165e34de57b552`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:11.621777 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-e73d189c-98e1-4eba-b403-24e3cbc56420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:11.630282 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 760/1520] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Aug 8 02:23:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:11.637484 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ffb27-5b38-46d4-9382-154c5098024c None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:11.651241 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ffb27-5b38-46d4-9382-154c5098024c None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:11.656757 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54bc483-bcb5-476c-abd8-132b173d9be6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43a39dd539974180a8165e34de57b552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:11.657332 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bc483-bcb5-476c-abd8-132b173d9be6 service placement] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:11.657614 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bc483-bcb5-476c-abd8-132b173d9be6 service placement] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:11.657942 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bc483-bcb5-476c-abd8-132b173d9be6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:11.665951 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54bc483-bcb5-476c-abd8-132b173d9be6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:11.667529 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54bc483-bcb5-476c-abd8-132b173d9be6 service placement] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:11.677143 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 761/1521] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:23:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:23:18.538527 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd6233-c8ea-461f-89a8-b364d88acb33 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:18.539079 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd6233-c8ea-461f-89a8-b364d88acb33 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:18.539079 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd6233-c8ea-461f-89a8-b364d88acb33 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:18.540446 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 02:23:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:23:18.545092 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e08bc-219a-4bb3-b445-88f3b59c1f00 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:18.545531 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e08bc-219a-4bb3-b445-88f3b59c1f00 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:18.545637 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e08bc-219a-4bb3-b445-88f3b59c1f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:18.569858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-e18e08bc-219a-4bb3-b445-88f3b59c1f00 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:18.571057 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-e18e08bc-219a-4bb3-b445-88f3b59c1f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:18.579696 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 02:23:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:18.733574 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd6233-c8ea-461f-89a8-b364d88acb33 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:18.747769 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd6233-c8ea-461f-89a8-b364d88acb33 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:18.753657 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c723a0-7bd6-45dc-89ce-b3ec7760eaf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:18.755521 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c723a0-7bd6-45dc-89ce-b3ec7760eaf9 service nova] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:18.755521 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c723a0-7bd6-45dc-89ce-b3ec7760eaf9 service nova] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:18.755521 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c723a0-7bd6-45dc-89ce-b3ec7760eaf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:18.762743 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c723a0-7bd6-45dc-89ce-b3ec7760eaf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:18.764352 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c723a0-7bd6-45dc-89ce-b3ec7760eaf9 service nova] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:18.774132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 762/1524] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:23:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:23:19.595143 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b269bd5-ebd5-4562-8e72-7bfaf24c863b None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:19.595732 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b269bd5-ebd5-4562-8e72-7bfaf24c863b None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:19.595732 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b269bd5-ebd5-4562-8e72-7bfaf24c863b None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:19.597138 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 763/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 02:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:23:19.601963 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b94da-6203-4091-9221-02f923d21aca None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:19.602378 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b94da-6203-4091-9221-02f923d21aca None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:19.602523 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b94da-6203-4091-9221-02f923d21aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:19.622408 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-d25b94da-6203-4091-9221-02f923d21aca None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:19.623642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-d25b94da-6203-4091-9221-02f923d21aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:19.631501 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 763/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 02:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:23:19.782723 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b269bd5-ebd5-4562-8e72-7bfaf24c863b None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:19.796770 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b269bd5-ebd5-4562-8e72-7bfaf24c863b None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:19.802105 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b5f3c-8d34-4818-9617-cc1d49ebc9f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:19.802690 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b5f3c-8d34-4818-9617-cc1d49ebc9f0 service nova] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:19.802976 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b5f3c-8d34-4818-9617-cc1d49ebc9f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:19.803248 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b5f3c-8d34-4818-9617-cc1d49ebc9f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:19.811066 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b5f3c-8d34-4818-9617-cc1d49ebc9f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:19.812644 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b5f3c-8d34-4818-9617-cc1d49ebc9f0 service nova] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:19.821772 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 764/1527] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:23:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:23:23.674202 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db181252-95ce-43cb-88da-a05dd17aa439 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:23.674767 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db181252-95ce-43cb-88da-a05dd17aa439 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:23.674767 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db181252-95ce-43cb-88da-a05dd17aa439 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:23.676147 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 764/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:23:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:23:23.681198 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6efcf-fa68-48b7-a5b5-13b7f50a2006 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:23.681620 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6efcf-fa68-48b7-a5b5-13b7f50a2006 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:23.681819 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6efcf-fa68-48b7-a5b5-13b7f50a2006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:23.701262 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-a1c6efcf-fa68-48b7-a5b5-13b7f50a2006 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:23.702446 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-a1c6efcf-fa68-48b7-a5b5-13b7f50a2006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:23.710131 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 765/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:23.781610 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db181252-95ce-43cb-88da-a05dd17aa439 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:23.783297 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-db181252-95ce-43cb-88da-a05dd17aa439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:23.862101 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db181252-95ce-43cb-88da-a05dd17aa439 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:23.865591 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af712383-e73a-4184-89aa-1996de83c7ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:23.866186 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af712383-e73a-4184-89aa-1996de83c7ec service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:23.866468 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af712383-e73a-4184-89aa-1996de83c7ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:23.866746 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af712383-e73a-4184-89aa-1996de83c7ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:23.875940 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af712383-e73a-4184-89aa-1996de83c7ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:23.877428 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af712383-e73a-4184-89aa-1996de83c7ec service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:23.886996 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 765/1530] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:23:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:23:25.911468 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303ceeb-74c4-4d21-bf4c-c58ae9c6f40c None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:25.912043 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303ceeb-74c4-4d21-bf4c-c58ae9c6f40c None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:25.912043 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303ceeb-74c4-4d21-bf4c-c58ae9c6f40c None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:25.913392 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 766/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:23:25.918411 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8edad5-e327-4c24-9207-581e0400402f None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:25.918864 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8edad5-e327-4c24-9207-581e0400402f None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:25.918971 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8edad5-e327-4c24-9207-581e0400402f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:25.937829 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-ac8edad5-e327-4c24-9207-581e0400402f None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:25.939026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-ac8edad5-e327-4c24-9207-581e0400402f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:25.946628 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 766/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:23:25.983153 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303ceeb-74c4-4d21-bf4c-c58ae9c6f40c None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:25.993774 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303ceeb-74c4-4d21-bf4c-c58ae9c6f40c None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:25.997250 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029a702-150c-4207-9745-ed6de86bd094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:25.997843 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029a702-150c-4207-9745-ed6de86bd094 service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:25.998125 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029a702-150c-4207-9745-ed6de86bd094 service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:25.998401 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029a702-150c-4207-9745-ed6de86bd094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:26.007057 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029a702-150c-4207-9745-ed6de86bd094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:26.008512 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029a702-150c-4207-9745-ed6de86bd094 service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:26.018306 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 767/1533] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:23:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:23:29.637740 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18c158-5b5c-470a-9430-89ae53e1aa37 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:29.638298 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18c158-5b5c-470a-9430-89ae53e1aa37 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:29.638298 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18c158-5b5c-470a-9430-89ae53e1aa37 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:29.639664 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 767/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:23:29.644934 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0636bb-59fa-4f0e-be63-e8a494256854 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:29.645326 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0636bb-59fa-4f0e-be63-e8a494256854 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:29.645495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0636bb-59fa-4f0e-be63-e8a494256854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:29.664623 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-5e0636bb-59fa-4f0e-be63-e8a494256854 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:29.674637 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-5e0636bb-59fa-4f0e-be63-e8a494256854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:29.674637 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 768/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:29.981669 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18c158-5b5c-470a-9430-89ae53e1aa37 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:29.983992 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-4a18c158-5b5c-470a-9430-89ae53e1aa37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:30.048440 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:30.060973 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18c158-5b5c-470a-9430-89ae53e1aa37 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:30.064651 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfaf0c1-523d-4522-aebf-22a426a4b067 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:30.065248 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfaf0c1-523d-4522-aebf-22a426a4b067 service cinder] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:30.065530 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfaf0c1-523d-4522-aebf-22a426a4b067 service cinder] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:30.065807 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfaf0c1-523d-4522-aebf-22a426a4b067 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:30.074844 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfaf0c1-523d-4522-aebf-22a426a4b067 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:30.076583 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfaf0c1-523d-4522-aebf-22a426a4b067 service cinder] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:30.087825 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 768/1536] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:23:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:23:32.106355 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f7941-3af4-4261-89cc-adfd1b32385b None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:32.106924 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f7941-3af4-4261-89cc-adfd1b32385b None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:32.106924 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f7941-3af4-4261-89cc-adfd1b32385b None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:32.108308 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 769/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 02:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:23:32.113498 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8564e-8e4d-4984-9747-fa946d82e8f5 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:32.114177 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8564e-8e4d-4984-9747-fa946d82e8f5 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:32.114177 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8564e-8e4d-4984-9747-fa946d82e8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:32.133911 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-49a8564e-8e4d-4984-9747-fa946d82e8f5 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:23:32.135132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-49a8564e-8e4d-4984-9747-fa946d82e8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:32.143561 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 769/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 02:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:23:32.445532 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f7941-3af4-4261-89cc-adfd1b32385b None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:23:32.447217 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-410f7941-3af4-4261-89cc-adfd1b32385b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:23:32.455110 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=84 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:32.460902 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f7941-3af4-4261-89cc-adfd1b32385b None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:23:32.464457 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c952e30-13e4-487c-bad2-d62ed6e4dc35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:23:32.465044 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c952e30-13e4-487c-bad2-d62ed6e4dc35 service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:23:32.465325 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c952e30-13e4-487c-bad2-d62ed6e4dc35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:23:32.465634 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c952e30-13e4-487c-bad2-d62ed6e4dc35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:23:32.474406 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c952e30-13e4-487c-bad2-d62ed6e4dc35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:23:32.477574 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c952e30-13e4-487c-bad2-d62ed6e4dc35 service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:23:32.486202 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 770/1539] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:23:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:23:42.129176 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=11 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:42.520711 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=5 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:03.106885 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c5e83-13d4-435d-ad3c-0f3d2a0bee34 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:03.107560 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c5e83-13d4-435d-ad3c-0f3d2a0bee34 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:03.107560 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c5e83-13d4-435d-ad3c-0f3d2a0bee34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:03.130368 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-201c5e83-13d4-435d-ad3c-0f3d2a0bee34 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:03.132012 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-201c5e83-13d4-435d-ad3c-0f3d2a0bee34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:03.143618 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 770/1540] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:03.152749 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922fa57-81c6-4fb1-9c74-4bb39ef6e845 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:03.153330 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922fa57-81c6-4fb1-9c74-4bb39ef6e845 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:03.153330 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922fa57-81c6-4fb1-9c74-4bb39ef6e845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:03.187497 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-5922fa57-81c6-4fb1-9c74-4bb39ef6e845 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:03.188847 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-5922fa57-81c6-4fb1-9c74-4bb39ef6e845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:03.198540 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 771/1541] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:03.203870 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c5e83-13d4-435d-ad3c-0f3d2a0bee34 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:03.218328 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c5e83-13d4-435d-ad3c-0f3d2a0bee34 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:03.226692 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de312c-f6d8-409b-9b49-23f04966f9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:03.228028 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de312c-f6d8-409b-9b49-23f04966f9b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:03.228548 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de312c-f6d8-409b-9b49-23f04966f9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:03.229045 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de312c-f6d8-409b-9b49-23f04966f9b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:03.229942 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7de312c-f6d8-409b-9b49-23f04966f9b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:25:03.230475 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7de312c-f6d8-409b-9b49-23f04966f9b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:03.232554 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7de312c-f6d8-409b-9b49-23f04966f9b3 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:03.250327 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 771/1542] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:25:03.259444 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922fa57-81c6-4fb1-9c74-4bb39ef6e845 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:03.263101 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb3b12-8b37-44a3-86aa-b225c05dc769 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:03.263709 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb3b12-8b37-44a3-86aa-b225c05dc769 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:03.264227 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb3b12-8b37-44a3-86aa-b225c05dc769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:03.273704 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922fa57-81c6-4fb1-9c74-4bb39ef6e845 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:03.284397 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941392c-2ed2-48f0-8014-b945583e074f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:03.285007 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941392c-2ed2-48f0-8014-b945583e074f admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:03.285529 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941392c-2ed2-48f0-8014-b945583e074f admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:03.286025 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941392c-2ed2-48f0-8014-b945583e074f admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:03.286883 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941392c-2ed2-48f0-8014-b945583e074f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:03.289156 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941392c-2ed2-48f0-8014-b945583e074f admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:03.294244 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-32eb3b12-8b37-44a3-86aa-b225c05dc769 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:03.295475 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-32eb3b12-8b37-44a3-86aa-b225c05dc769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:03.310347 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 772/1543] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:25:03.318865 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734a4bc-e6e5-4c9d-a814-8598db670d10 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:03.319155 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734a4bc-e6e5-4c9d-a814-8598db670d10 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:03.319730 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734a4bc-e6e5-4c9d-a814-8598db670d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:03.354442 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-a734a4bc-e6e5-4c9d-a814-8598db670d10 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:03.355751 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-a734a4bc-e6e5-4c9d-a814-8598db670d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:03.367892 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 773/1544] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:25:03.369116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd339d5-c471-4697-949a-dd8e516a6da7 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:03.369410 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd339d5-c471-4697-949a-dd8e516a6da7 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:03.369695 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd339d5-c471-4697-949a-dd8e516a6da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:03.398396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-5dd339d5-c471-4697-949a-dd8e516a6da7 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:03.399809 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-5dd339d5-c471-4697-949a-dd8e516a6da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:03.413515 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 774/1545] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:03.414814 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fca87-4060-4565-a892-7c67435eab1a None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:03.415120 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fca87-4060-4565-a892-7c67435eab1a None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:03.415426 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fca87-4060-4565-a892-7c67435eab1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:03.447039 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 772/1546] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:25:03 2022] POST /identity/v3/projects => generated 371 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:25:03.448185 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941392c-2ed2-48f0-8014-b945583e074f admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:03.451656 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-235fca87-4060-4565-a892-7c67435eab1a None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:03.453289 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-235fca87-4060-4565-a892-7c67435eab1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:03.546932 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 775/1547] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:03.549149 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4399f-527b-41cd-a912-f401bc83981b None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:03.549741 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4399f-527b-41cd-a912-f401bc83981b None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:03.550255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4399f-527b-41cd-a912-f401bc83981b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:03.563542 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941392c-2ed2-48f0-8014-b945583e074f admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:03.569593 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96ac5b-2f05-4d90-96b5-06e52723cefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:03.570213 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96ac5b-2f05-4d90-96b5-06e52723cefe admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:03.570496 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96ac5b-2f05-4d90-96b5-06e52723cefe admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:03.570774 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96ac5b-2f05-4d90-96b5-06e52723cefe admin admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:03.572352 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96ac5b-2f05-4d90-96b5-06e52723cefe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:25:03.572665 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96ac5b-2f05-4d90-96b5-06e52723cefe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:03.574670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: WARNING py.warnings [None req-bd96ac5b-2f05-4d90-96b5-06e52723cefe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:25:03.574670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: warnings.warn(msg) Aug 08 02:25:03.574670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: Aug 08 02:25:03.575616 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96ac5b-2f05-4d90-96b5-06e52723cefe admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:03.579483 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-74c4399f-527b-41cd-a912-f401bc83981b None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:03.580942 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-74c4399f-527b-41cd-a912-f401bc83981b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:03.589469 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 773/1548] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:25:03.595381 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96ac5b-2f05-4d90-96b5-06e52723cefe admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:03.595535 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 776/1549] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:03.595535 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fff930-ff95-40ce-a9cf-6455d1703a7a None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:03.595535 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fff930-ff95-40ce-a9cf-6455d1703a7a None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:03.595535 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fff930-ff95-40ce-a9cf-6455d1703a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:03.607903 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96ac5b-2f05-4d90-96b5-06e52723cefe admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:03.616052 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e0627-5840-4cfa-92ee-d40c2e917960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:03.617639 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e0627-5840-4cfa-92ee-d40c2e917960 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:03.618211 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e0627-5840-4cfa-92ee-d40c2e917960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:03.618429 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e0627-5840-4cfa-92ee-d40c2e917960 admin admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:03.619065 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e0627-5840-4cfa-92ee-d40c2e917960 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:03.620115 dv-cinder-740146-18-smb devstack@keystone.service[80637]: WARNING py.warnings [None req-7b9e0627-5840-4cfa-92ee-d40c2e917960 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:25:03.620115 dv-cinder-740146-18-smb devstack@keystone.service[80637]: warnings.warn(msg) Aug 08 02:25:03.620115 dv-cinder-740146-18-smb devstack@keystone.service[80637]: Aug 08 02:25:03.621331 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e0627-5840-4cfa-92ee-d40c2e917960 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:03.623864 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-58fff930-ff95-40ce-a9cf-6455d1703a7a None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:03.625073 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-58fff930-ff95-40ce-a9cf-6455d1703a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:03.634857 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 777/1550] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:03.636752 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c6c65-b506-4fd7-8cc6-abdd2fbb394d None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:03.637259 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c6c65-b506-4fd7-8cc6-abdd2fbb394d None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:03.637709 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c6c65-b506-4fd7-8cc6-abdd2fbb394d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:03.658158 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-aa9c6c65-b506-4fd7-8cc6-abdd2fbb394d None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:03.659455 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-aa9c6c65-b506-4fd7-8cc6-abdd2fbb394d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:03.667244 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 778/1551] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:03.670421 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af432e7-6f7c-48f9-8874-fa1c0a9d4c73 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:03.670421 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af432e7-6f7c-48f9-8874-fa1c0a9d4c73 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:03.670421 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af432e7-6f7c-48f9-8874-fa1c0a9d4c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:03.687551 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-2af432e7-6f7c-48f9-8874-fa1c0a9d4c73 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:03.689249 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-2af432e7-6f7c-48f9-8874-fa1c0a9d4c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:03.695507 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 774/1552] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:25:03 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:25:03.696493 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e0627-5840-4cfa-92ee-d40c2e917960 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:03.706770 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 779/1553] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:03.706770 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af432e7-6f7c-48f9-8874-fa1c0a9d4c73 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:03.706989 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e0627-5840-4cfa-92ee-d40c2e917960 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:03.711595 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb3c00-b1ba-486a-92cc-ab677187a124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:03.712183 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb3c00-b1ba-486a-92cc-ab677187a124 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:03.712523 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb3c00-b1ba-486a-92cc-ab677187a124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:03.712682 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af432e7-6f7c-48f9-8874-fa1c0a9d4c73 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:03.712799 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb3c00-b1ba-486a-92cc-ab677187a124 admin admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:03.713422 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb3c00-b1ba-486a-92cc-ab677187a124 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:25:03.713722 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb3c00-b1ba-486a-92cc-ab677187a124 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:03.715326 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb3c00-b1ba-486a-92cc-ab677187a124 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:03.717435 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e541e62-0ba8-48d6-8960-f62dd09ee393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:03.718030 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e541e62-0ba8-48d6-8960-f62dd09ee393 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:03.718322 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e541e62-0ba8-48d6-8960-f62dd09ee393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:03.718607 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e541e62-0ba8-48d6-8960-f62dd09ee393 admin admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:03.719261 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e541e62-0ba8-48d6-8960-f62dd09ee393 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:03.720299 dv-cinder-740146-18-smb devstack@keystone.service[80638]: WARNING py.warnings [None req-6e541e62-0ba8-48d6-8960-f62dd09ee393 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:25:03.720299 dv-cinder-740146-18-smb devstack@keystone.service[80638]: warnings.warn(msg) Aug 08 02:25:03.720299 dv-cinder-740146-18-smb devstack@keystone.service[80638]: Aug 08 02:25:03.721484 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e541e62-0ba8-48d6-8960-f62dd09ee393 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:03.728720 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 775/1554] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:25:03.735570 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f356d0-fedc-4e88-af36-bb2a1062a630 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:03.735570 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f356d0-fedc-4e88-af36-bb2a1062a630 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:03.735570 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f356d0-fedc-4e88-af36-bb2a1062a630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:03.753018 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-38f356d0-fedc-4e88-af36-bb2a1062a630 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:03.754199 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-38f356d0-fedc-4e88-af36-bb2a1062a630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:03.762385 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 776/1555] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:03.763761 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5f1e8-3cfb-4077-9fa3-ea1d0c14daaf None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:03.764041 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5f1e8-3cfb-4077-9fa3-ea1d0c14daaf None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:03.765133 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5f1e8-3cfb-4077-9fa3-ea1d0c14daaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:03.783991 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-61a5f1e8-3cfb-4077-9fa3-ea1d0c14daaf None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:03.785195 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-61a5f1e8-3cfb-4077-9fa3-ea1d0c14daaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:03.793151 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 777/1556] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:03.794436 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb4538-eeab-44b4-a1ca-4b997e2c69a4 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:03.794720 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb4538-eeab-44b4-a1ca-4b997e2c69a4 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:03.794996 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb4538-eeab-44b4-a1ca-4b997e2c69a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:03.814440 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-ceeb4538-eeab-44b4-a1ca-4b997e2c69a4 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:03.815678 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-ceeb4538-eeab-44b4-a1ca-4b997e2c69a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:03.819761 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 780/1557] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:25:03 2022] POST /identity/v3/projects => generated 403 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:25:03.820928 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4d496-9b90-49d7-bdba-1646f4c2f8ff None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:03.821639 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4d496-9b90-49d7-bdba-1646f4c2f8ff None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:03.821639 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4d496-9b90-49d7-bdba-1646f4c2f8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:03.827443 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 778/1558] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:03.827649 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb4538-eeab-44b4-a1ca-4b997e2c69a4 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:03.838516 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb4538-eeab-44b4-a1ca-4b997e2c69a4 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:03.845941 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-72a4d496-9b90-49d7-bdba-1646f4c2f8ff None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:03.847154 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-72a4d496-9b90-49d7-bdba-1646f4c2f8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:03.896958 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd259de-1296-47ea-8515-ce17c53ea9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:03.897530 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd259de-1296-47ea-8515-ce17c53ea9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:03.897816 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd259de-1296-47ea-8515-ce17c53ea9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:03.898097 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd259de-1296-47ea-8515-ce17c53ea9e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:03.898734 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd259de-1296-47ea-8515-ce17c53ea9e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:03.900358 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd259de-1296-47ea-8515-ce17c53ea9e5 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:03.909239 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 781/1559] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:03.914785 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 779/1560] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:25:03.914942 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4d496-9b90-49d7-bdba-1646f4c2f8ff None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:03.915050 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd259de-1296-47ea-8515-ce17c53ea9e5 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:03.917824 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:03.921819 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4d496-9b90-49d7-bdba-1646f4c2f8ff None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:03.925738 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd259de-1296-47ea-8515-ce17c53ea9e5 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:03.927177 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dcc780-3681-4039-bb33-7b3807998267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:03.927896 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcc780-3681-4039-bb33-7b3807998267 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:03.928258 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcc780-3681-4039-bb33-7b3807998267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:03.928607 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcc780-3681-4039-bb33-7b3807998267 admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:03.928712 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b2c21-94ea-4f6c-8da4-850a5527032b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:03.929368 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b2c21-94ea-4f6c-8da4-850a5527032b admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:03.929486 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dcc780-3681-4039-bb33-7b3807998267 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:25:03.929788 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b2c21-94ea-4f6c-8da4-850a5527032b admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:03.929909 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dcc780-3681-4039-bb33-7b3807998267 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:03.930185 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b2c21-94ea-4f6c-8da4-850a5527032b admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:03.930949 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b2c21-94ea-4f6c-8da4-850a5527032b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:03.931722 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dcc780-3681-4039-bb33-7b3807998267 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:03.932831 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b2c21-94ea-4f6c-8da4-850a5527032b admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:03.941016 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:03.944371 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 782/1561] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:25:03.945399 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa39460-94c9-4d08-9428-1ad653f763cf None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:03.945692 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa39460-94c9-4d08-9428-1ad653f763cf None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:03.945980 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa39460-94c9-4d08-9428-1ad653f763cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:03.965508 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-5aa39460-94c9-4d08-9428-1ad653f763cf None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:03.966706 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-5aa39460-94c9-4d08-9428-1ad653f763cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:03.974574 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 783/1562] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:03.975336 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa39460-94c9-4d08-9428-1ad653f763cf None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:03.984280 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa39460-94c9-4d08-9428-1ad653f763cf None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:03.989767 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fc0ac-3f66-452f-82f1-7c20e1c06721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:03.993537 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fc0ac-3f66-452f-82f1-7c20e1c06721 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:03.993537 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fc0ac-3f66-452f-82f1-7c20e1c06721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:03.993537 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fc0ac-3f66-452f-82f1-7c20e1c06721 admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:03.993537 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2fc0ac-3f66-452f-82f1-7c20e1c06721 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:25:03.993537 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2fc0ac-3f66-452f-82f1-7c20e1c06721 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:03.993537 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2fc0ac-3f66-452f-82f1-7c20e1c06721 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:04.005447 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 784/1563] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:25:04.006185 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fc0ac-3f66-452f-82f1-7c20e1c06721 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:04.015279 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fc0ac-3f66-452f-82f1-7c20e1c06721 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:04.019892 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd92ac-e3de-4af4-a970-c74067dffb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:04.020461 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd92ac-e3de-4af4-a970-c74067dffb36 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:04.020739 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd92ac-e3de-4af4-a970-c74067dffb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:04.021014 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd92ac-e3de-4af4-a970-c74067dffb36 admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:04.021614 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd92ac-e3de-4af4-a970-c74067dffb36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:04.023513 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd92ac-e3de-4af4-a970-c74067dffb36 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:04.041814 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 780/1564] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:25:03 2022] POST /identity/v3/projects => generated 391 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:25:04.043042 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671369b-6427-4fe8-b128-558e3a7d832f None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:04.043330 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671369b-6427-4fe8-b128-558e3a7d832f None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:04.043862 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671369b-6427-4fe8-b128-558e3a7d832f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:04.063065 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-3671369b-6427-4fe8-b128-558e3a7d832f None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:04.064838 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-3671369b-6427-4fe8-b128-558e3a7d832f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:04.119723 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 785/1565] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:25:04 2022] POST /identity/v3/users => generated 302 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:25:04.119723 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd92ac-e3de-4af4-a970-c74067dffb36 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:04.126531 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 781/1566] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:04.127665 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671369b-6427-4fe8-b128-558e3a7d832f None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:04.139499 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd92ac-e3de-4af4-a970-c74067dffb36 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:04.141049 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671369b-6427-4fe8-b128-558e3a7d832f None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:04.145597 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e8e95-eb94-477e-b47d-683f6900f4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:04.146208 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e8e95-eb94-477e-b47d-683f6900f4f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:04.146523 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e8e95-eb94-477e-b47d-683f6900f4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:04.146712 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fde063-2a45-40f8-8a52-6640c7a95ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:04.146849 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e8e95-eb94-477e-b47d-683f6900f4f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:04.147394 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fde063-2a45-40f8-8a52-6640c7a95ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:04.147586 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e8e95-eb94-477e-b47d-683f6900f4f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:25:04.147687 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fde063-2a45-40f8-8a52-6640c7a95ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:04.147845 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e8e95-eb94-477e-b47d-683f6900f4f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:04.147958 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fde063-2a45-40f8-8a52-6640c7a95ec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:04.148527 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fde063-2a45-40f8-8a52-6640c7a95ec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:04.149416 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e8e95-eb94-477e-b47d-683f6900f4f8 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:04.150113 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fde063-2a45-40f8-8a52-6640c7a95ec1 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:04.160946 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 782/1567] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:25:04.170078 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fde063-2a45-40f8-8a52-6640c7a95ec1 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:04.170227 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 786/1568] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:25:04.170227 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e8e95-eb94-477e-b47d-683f6900f4f8 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:04.174747 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fde063-2a45-40f8-8a52-6640c7a95ec1 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:04.175827 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e8e95-eb94-477e-b47d-683f6900f4f8 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:04.179349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d9b0e-33ed-431f-8d56-65f72cecf3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:04.179970 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d9b0e-33ed-431f-8d56-65f72cecf3aa admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:04.180254 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d9b0e-33ed-431f-8d56-65f72cecf3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:04.180445 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07226a59-4f80-4066-be75-2fb7ef0ad8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:04.180560 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d9b0e-33ed-431f-8d56-65f72cecf3aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:04.181027 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07226a59-4f80-4066-be75-2fb7ef0ad8ad admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:04.181167 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d9b0e-33ed-431f-8d56-65f72cecf3aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:04.181306 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07226a59-4f80-4066-be75-2fb7ef0ad8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:04.181578 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07226a59-4f80-4066-be75-2fb7ef0ad8ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:04.182458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07226a59-4f80-4066-be75-2fb7ef0ad8ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:25:04.183014 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07226a59-4f80-4066-be75-2fb7ef0ad8ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:04.183130 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d9b0e-33ed-431f-8d56-65f72cecf3aa admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:04.185431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07226a59-4f80-4066-be75-2fb7ef0ad8ad admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:04.197873 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 787/1569] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:25:04.198649 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07226a59-4f80-4066-be75-2fb7ef0ad8ad admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:04.208978 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07226a59-4f80-4066-be75-2fb7ef0ad8ad admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:04.213523 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6aaa09-5dbc-4233-87c0-3cb0fa6512d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:04.214095 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6aaa09-5dbc-4233-87c0-3cb0fa6512d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:04.214370 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6aaa09-5dbc-4233-87c0-3cb0fa6512d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:04.214641 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6aaa09-5dbc-4233-87c0-3cb0fa6512d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:04.217534 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6aaa09-5dbc-4233-87c0-3cb0fa6512d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:04.217534 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6aaa09-5dbc-4233-87c0-3cb0fa6512d3 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:04.282293 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 783/1570] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:25:04 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:25:04.283097 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d9b0e-33ed-431f-8d56-65f72cecf3aa admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:04.306613 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 788/1571] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:25:04 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:25:04.306613 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6aaa09-5dbc-4233-87c0-3cb0fa6512d3 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:04.344379 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d9b0e-33ed-431f-8d56-65f72cecf3aa admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:04.366411 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6aaa09-5dbc-4233-87c0-3cb0fa6512d3 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:04.371023 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849a918-dc58-40e1-bf8c-909ce7aec025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:04.371640 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849a918-dc58-40e1-bf8c-909ce7aec025 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:04.371922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849a918-dc58-40e1-bf8c-909ce7aec025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:04.372194 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849a918-dc58-40e1-bf8c-909ce7aec025 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:04.372822 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849a918-dc58-40e1-bf8c-909ce7aec025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:04.374401 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849a918-dc58-40e1-bf8c-909ce7aec025 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:04.387504 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 789/1572] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:25:04.387504 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849a918-dc58-40e1-bf8c-909ce7aec025 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:04.395719 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849a918-dc58-40e1-bf8c-909ce7aec025 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:04.398600 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:04.400340 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881065e-cb58-41d0-a486-9ec980525309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:04.400921 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881065e-cb58-41d0-a486-9ec980525309 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:04.401205 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881065e-cb58-41d0-a486-9ec980525309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:04.401479 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881065e-cb58-41d0-a486-9ec980525309 admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:04.402110 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881065e-cb58-41d0-a486-9ec980525309 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:25:04.402411 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881065e-cb58-41d0-a486-9ec980525309 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:04.404019 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881065e-cb58-41d0-a486-9ec980525309 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:04.412709 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398185cf-d3a7-4a6f-99f5-ffe3c10682a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:04.412709 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398185cf-d3a7-4a6f-99f5-ffe3c10682a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:04.412709 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398185cf-d3a7-4a6f-99f5-ffe3c10682a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:04.412709 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398185cf-d3a7-4a6f-99f5-ffe3c10682a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:04.413097 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398185cf-d3a7-4a6f-99f5-ffe3c10682a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:04.413097 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398185cf-d3a7-4a6f-99f5-ffe3c10682a9 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:04.416456 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 790/1573] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:25:04.417349 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881065e-cb58-41d0-a486-9ec980525309 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:04.427003 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881065e-cb58-41d0-a486-9ec980525309 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:04.431720 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d75ba-2491-4b87-bc35-06c0219afc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:04.432362 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d75ba-2491-4b87-bc35-06c0219afc9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:04.432640 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d75ba-2491-4b87-bc35-06c0219afc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:04.432913 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d75ba-2491-4b87-bc35-06c0219afc9b admin admin] PATH_INFO: `/v3/projects/5bd684389eb240418bb4e7a3ff6bb41a/users/1fa75cc084344a7aaa28848c6f1b4c5a/roles/5691bce246d6452990f13933e19f2825` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:04.448497 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412d75ba-2491-4b87-bc35-06c0219afc9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bd684389eb240418bb4e7a3ff6bb41a, user_id=1fa75cc084344a7aaa28848c6f1b4c5a, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:04.449532 dv-cinder-740146-18-smb devstack@keystone.service[80638]: WARNING py.warnings [None req-412d75ba-2491-4b87-bc35-06c0219afc9b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:25:04.449532 dv-cinder-740146-18-smb devstack@keystone.service[80638]: warnings.warn(msg) Aug 08 02:25:04.449532 dv-cinder-740146-18-smb devstack@keystone.service[80638]: Aug 08 02:25:04.451501 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412d75ba-2491-4b87-bc35-06c0219afc9b admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:04.494970 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 784/1574] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:25:04 2022] POST /identity/v3/users => generated 296 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:25:04.498034 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398185cf-d3a7-4a6f-99f5-ffe3c10682a9 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:04.507700 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398185cf-d3a7-4a6f-99f5-ffe3c10682a9 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:04.512482 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe99be1-9547-4f57-ae10-af51137ee98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:04.513055 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe99be1-9547-4f57-ae10-af51137ee98b admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:04.513335 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe99be1-9547-4f57-ae10-af51137ee98b admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:04.513607 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe99be1-9547-4f57-ae10-af51137ee98b admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:04.514243 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe99be1-9547-4f57-ae10-af51137ee98b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:04.516359 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe99be1-9547-4f57-ae10-af51137ee98b admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:04.523722 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 791/1575] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:25:04 2022] PUT /identity/v3/projects/5bd684389eb240418bb4e7a3ff6bb41a/users/1fa75cc084344a7aaa28848c6f1b4c5a/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:04.529255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d75ba-2491-4b87-bc35-06c0219afc9b admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:04.560291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:04.586975 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d75ba-2491-4b87-bc35-06c0219afc9b admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:04.591615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830d35b-8a04-4146-8ddb-57fe86620fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:04.592248 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830d35b-8a04-4146-8ddb-57fe86620fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:04.592595 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830d35b-8a04-4146-8ddb-57fe86620fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:04.592879 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830d35b-8a04-4146-8ddb-57fe86620fd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:04.593492 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6830d35b-8a04-4146-8ddb-57fe86620fd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:04.595990 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6830d35b-8a04-4146-8ddb-57fe86620fd0 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:04.611044 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 785/1576] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:25:04 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:25:04.611044 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe99be1-9547-4f57-ae10-af51137ee98b admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:04.668808 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe99be1-9547-4f57-ae10-af51137ee98b admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:04.673391 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc1982-1f7a-400e-a8eb-a9c0fccc6377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:04.678165 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc1982-1f7a-400e-a8eb-a9c0fccc6377 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:04.678165 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc1982-1f7a-400e-a8eb-a9c0fccc6377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:04.678165 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc1982-1f7a-400e-a8eb-a9c0fccc6377 admin admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:04.678165 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc1982-1f7a-400e-a8eb-a9c0fccc6377 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:04.678165 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc1982-1f7a-400e-a8eb-a9c0fccc6377 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:04.708857 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 792/1577] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:25:04 2022] POST /identity/v3/projects => generated 379 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:25:04.708857 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830d35b-8a04-4146-8ddb-57fe86620fd0 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:04.765166 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830d35b-8a04-4146-8ddb-57fe86620fd0 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:04.770318 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca32f85-604f-4876-9509-370901d87edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:04.770909 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca32f85-604f-4876-9509-370901d87edc admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:04.771187 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca32f85-604f-4876-9509-370901d87edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:04.771556 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca32f85-604f-4876-9509-370901d87edc admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:04.772175 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca32f85-604f-4876-9509-370901d87edc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:04.774073 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca32f85-604f-4876-9509-370901d87edc admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:04.791401 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 786/1578] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:25:04 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:25:04.791401 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc1982-1f7a-400e-a8eb-a9c0fccc6377 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:04.800966 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc1982-1f7a-400e-a8eb-a9c0fccc6377 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:04.805532 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae602726-21e1-410b-940a-508b8a5b0f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:04.806104 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae602726-21e1-410b-940a-508b8a5b0f17 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:04.806407 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae602726-21e1-410b-940a-508b8a5b0f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:04.806680 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae602726-21e1-410b-940a-508b8a5b0f17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:04.807306 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae602726-21e1-410b-940a-508b8a5b0f17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:04.808911 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae602726-21e1-410b-940a-508b8a5b0f17 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:04.818573 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 787/1579] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:25:04.820764 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae602726-21e1-410b-940a-508b8a5b0f17 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:04.828465 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae602726-21e1-410b-940a-508b8a5b0f17 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:04.833439 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1ea1f-07da-4ecf-b452-7f0338372abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:04.833970 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1ea1f-07da-4ecf-b452-7f0338372abc admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:04.834248 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1ea1f-07da-4ecf-b452-7f0338372abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:04.834519 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1ea1f-07da-4ecf-b452-7f0338372abc admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:04.835100 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1ea1f-07da-4ecf-b452-7f0338372abc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:04.836904 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1ea1f-07da-4ecf-b452-7f0338372abc admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:04.877745 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 793/1580] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:25:04 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:25:04.878567 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca32f85-604f-4876-9509-370901d87edc admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:04.887725 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca32f85-604f-4876-9509-370901d87edc admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:04.892852 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a43e44-c4a7-4618-8e93-c32b0ff66fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:04.893414 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a43e44-c4a7-4618-8e93-c32b0ff66fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:04.893693 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a43e44-c4a7-4618-8e93-c32b0ff66fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:04.893967 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a43e44-c4a7-4618-8e93-c32b0ff66fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:04.894591 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a43e44-c4a7-4618-8e93-c32b0ff66fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:04.896201 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a43e44-c4a7-4618-8e93-c32b0ff66fe1 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:04.905848 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 794/1581] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:25:04.906927 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36597995-c886-4b81-8ec4-f67f5ce2b55e None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:04.907209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36597995-c886-4b81-8ec4-f67f5ce2b55e None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:04.908081 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36597995-c886-4b81-8ec4-f67f5ce2b55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:04.935314 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-36597995-c886-4b81-8ec4-f67f5ce2b55e None None] MFA Rules not processed for user `1fa75cc084344a7aaa28848c6f1b4c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:04.936458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-36597995-c886-4b81-8ec4-f67f5ce2b55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:04.979656 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 788/1582] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:25:04 2022] POST /identity/v3/projects => generated 389 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:25:04.979656 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1ea1f-07da-4ecf-b452-7f0338372abc admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:05.002708 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 795/1583] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:05.007102 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36597995-c886-4b81-8ec4-f67f5ce2b55e None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:05.017862 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36597995-c886-4b81-8ec4-f67f5ce2b55e None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:05.040952 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1ea1f-07da-4ecf-b452-7f0338372abc admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:05.041771 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:05.045575 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d931aa4-cae6-42da-9ef8-8822f8509d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:05.046234 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d931aa4-cae6-42da-9ef8-8822f8509d96 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:05.046523 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d931aa4-cae6-42da-9ef8-8822f8509d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:05.046801 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d931aa4-cae6-42da-9ef8-8822f8509d96 admin admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:05.047445 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d931aa4-cae6-42da-9ef8-8822f8509d96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:05.049395 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d931aa4-cae6-42da-9ef8-8822f8509d96 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:05.073704 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf20e12-9f38-47f6-9990-11031eeeb4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:05.074304 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf20e12-9f38-47f6-9990-11031eeeb4f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:05.074585 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf20e12-9f38-47f6-9990-11031eeeb4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:05.074858 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf20e12-9f38-47f6-9990-11031eeeb4f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:05.075506 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf20e12-9f38-47f6-9990-11031eeeb4f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:05.077409 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf20e12-9f38-47f6-9990-11031eeeb4f4 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:05.174691 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 789/1584] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:25:04 2022] POST /identity/v3/users => generated 287 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:25:05.175615 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d931aa4-cae6-42da-9ef8-8822f8509d96 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:05.185140 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d931aa4-cae6-42da-9ef8-8822f8509d96 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:05.186837 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 796/1585] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:25:05 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:25:05.187725 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf20e12-9f38-47f6-9990-11031eeeb4f4 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:05.193398 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d9673-b604-4445-861a-33f3d64afecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:05.193996 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d9673-b604-4445-861a-33f3d64afecb admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:05.194273 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d9673-b604-4445-861a-33f3d64afecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:05.194604 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d9673-b604-4445-861a-33f3d64afecb admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:05.195249 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d9673-b604-4445-861a-33f3d64afecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:05.196997 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d9673-b604-4445-861a-33f3d64afecb admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:05.199179 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:05.199531 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf20e12-9f38-47f6-9990-11031eeeb4f4 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:05.205117 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355d505-0309-4b36-a69b-c4584421a081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:05.205759 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355d505-0309-4b36-a69b-c4584421a081 admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:05.206064 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355d505-0309-4b36-a69b-c4584421a081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:05.206344 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355d505-0309-4b36-a69b-c4584421a081 admin admin] PATH_INFO: `/v3/projects/e417a84ba65b4d0e80f19abe51838428/users/a12216bc8f0e4eeca9e753b9b430fa2b/roles/5691bce246d6452990f13933e19f2825` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:05.208523 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 790/1586] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:25:05.209289 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d9673-b604-4445-861a-33f3d64afecb admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:05.218489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d9673-b604-4445-861a-33f3d64afecb admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:05.221729 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355d505-0309-4b36-a69b-c4584421a081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e417a84ba65b4d0e80f19abe51838428, user_id=a12216bc8f0e4eeca9e753b9b430fa2b, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:05.222970 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e74528-5a11-4d53-bf82-82c625e1aa0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:05.223579 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e74528-5a11-4d53-bf82-82c625e1aa0a admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:05.223861 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e74528-5a11-4d53-bf82-82c625e1aa0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:05.224127 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e74528-5a11-4d53-bf82-82c625e1aa0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:05.224417 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355d505-0309-4b36-a69b-c4584421a081 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:05.224743 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e74528-5a11-4d53-bf82-82c625e1aa0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:05.226279 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e74528-5a11-4d53-bf82-82c625e1aa0a admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:05.236739 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 791/1587] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:25:05.251636 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e74528-5a11-4d53-bf82-82c625e1aa0a admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:05.251636 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e74528-5a11-4d53-bf82-82c625e1aa0a admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:05.251636 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa002072-d84a-4191-aeb7-b51a77d77ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:05.251925 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa002072-d84a-4191-aeb7-b51a77d77ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:05.252122 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa002072-d84a-4191-aeb7-b51a77d77ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:05.252387 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa002072-d84a-4191-aeb7-b51a77d77ab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:05.252975 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa002072-d84a-4191-aeb7-b51a77d77ab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:05.254464 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa002072-d84a-4191-aeb7-b51a77d77ab6 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:05.267418 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 792/1588] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:25:05.267418 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa002072-d84a-4191-aeb7-b51a77d77ab6 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:05.274303 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa002072-d84a-4191-aeb7-b51a77d77ab6 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:05.278846 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a45ab4-fdc0-41e4-a854-c06e9dce5281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:05.280239 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a45ab4-fdc0-41e4-a854-c06e9dce5281 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:05.280239 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a45ab4-fdc0-41e4-a854-c06e9dce5281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:05.280239 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a45ab4-fdc0-41e4-a854-c06e9dce5281 admin admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:05.280654 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a45ab4-fdc0-41e4-a854-c06e9dce5281 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:05.282559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a45ab4-fdc0-41e4-a854-c06e9dce5281 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:05.385394 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 797/1589] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:25:05 2022] PUT /identity/v3/projects/e417a84ba65b4d0e80f19abe51838428/users/a12216bc8f0e4eeca9e753b9b430fa2b/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:05.385394 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355d505-0309-4b36-a69b-c4584421a081 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:05.385394 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355d505-0309-4b36-a69b-c4584421a081 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:05.385394 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f0ba1-3e29-45d8-b0e8-b5437cb2c6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:05.385931 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f0ba1-3e29-45d8-b0e8-b5437cb2c6ae admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:05.385931 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f0ba1-3e29-45d8-b0e8-b5437cb2c6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:05.385931 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f0ba1-3e29-45d8-b0e8-b5437cb2c6ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:05.386151 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f0ba1-3e29-45d8-b0e8-b5437cb2c6ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:05.388473 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f0ba1-3e29-45d8-b0e8-b5437cb2c6ae admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:05.395834 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 793/1590] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:25:05 2022] POST /identity/v3/users => generated 295 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:25:05.395834 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a45ab4-fdc0-41e4-a854-c06e9dce5281 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:05.407510 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a45ab4-fdc0-41e4-a854-c06e9dce5281 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:05.412312 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ab70b-c75f-44dd-901a-ca7eaeadc311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:05.412955 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ab70b-c75f-44dd-901a-ca7eaeadc311 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:05.413244 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ab70b-c75f-44dd-901a-ca7eaeadc311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:05.413559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ab70b-c75f-44dd-901a-ca7eaeadc311 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:05.414327 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ab70b-c75f-44dd-901a-ca7eaeadc311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:05.416029 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ab70b-c75f-44dd-901a-ca7eaeadc311 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:05.428127 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 794/1591] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:25:05.428921 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ab70b-c75f-44dd-901a-ca7eaeadc311 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:05.438531 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ab70b-c75f-44dd-901a-ca7eaeadc311 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:05.443665 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f848c-4e5d-4ba1-8570-a43bbada8cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:05.444247 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f848c-4e5d-4ba1-8570-a43bbada8cca admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:05.444538 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f848c-4e5d-4ba1-8570-a43bbada8cca admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:05.444809 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f848c-4e5d-4ba1-8570-a43bbada8cca admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:05.445432 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f848c-4e5d-4ba1-8570-a43bbada8cca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:05.447036 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f848c-4e5d-4ba1-8570-a43bbada8cca admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:05.457527 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 795/1592] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:25:05.458350 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f848c-4e5d-4ba1-8570-a43bbada8cca admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:05.468313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f848c-4e5d-4ba1-8570-a43bbada8cca admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:05.473309 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685db0e9-60da-47c6-8926-e5edb9dee69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:05.473932 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685db0e9-60da-47c6-8926-e5edb9dee69e admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:05.474222 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685db0e9-60da-47c6-8926-e5edb9dee69e admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:05.474491 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685db0e9-60da-47c6-8926-e5edb9dee69e admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:05.475161 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685db0e9-60da-47c6-8926-e5edb9dee69e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:05.476799 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685db0e9-60da-47c6-8926-e5edb9dee69e admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:05.488125 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 796/1593] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:25:05.488978 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685db0e9-60da-47c6-8926-e5edb9dee69e admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:05.495439 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 798/1594] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:25:05 2022] POST /identity/v3/projects => generated 371 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:25:05.495439 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f0ba1-3e29-45d8-b0e8-b5437cb2c6ae admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:05.499643 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685db0e9-60da-47c6-8926-e5edb9dee69e admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:05.565938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c8adf-e334-4ab5-a777-8b5cb68279e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:05.566415 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f0ba1-3e29-45d8-b0e8-b5437cb2c6ae admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:05.566546 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c8adf-e334-4ab5-a777-8b5cb68279e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:05.566751 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c8adf-e334-4ab5-a777-8b5cb68279e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:05.567049 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c8adf-e334-4ab5-a777-8b5cb68279e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:05.567731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361c8adf-e334-4ab5-a777-8b5cb68279e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:05.569390 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361c8adf-e334-4ab5-a777-8b5cb68279e3 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:05.571612 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf734b-dc68-46da-8530-129a443bbf68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:05.572278 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf734b-dc68-46da-8530-129a443bbf68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:05.572561 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf734b-dc68-46da-8530-129a443bbf68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:05.573145 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf734b-dc68-46da-8530-129a443bbf68 admin admin] PATH_INFO: `/v3/projects/b18ce23826594ef2a366ca57b3b147aa/users/014a5ebd029d43d194722af661e4675b/roles/5691bce246d6452990f13933e19f2825` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:05.581919 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 797/1595] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:25:05.583183 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fae5a-7db2-49ab-a061-10ee5409db55 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:05.583543 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fae5a-7db2-49ab-a061-10ee5409db55 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:05.583817 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fae5a-7db2-49ab-a061-10ee5409db55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:05.593828 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf734b-dc68-46da-8530-129a443bbf68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b18ce23826594ef2a366ca57b3b147aa, user_id=014a5ebd029d43d194722af661e4675b, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:05.596591 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf734b-dc68-46da-8530-129a443bbf68 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:05.612805 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-611fae5a-7db2-49ab-a061-10ee5409db55 None None] MFA Rules not processed for user `a12216bc8f0e4eeca9e753b9b430fa2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:05.614093 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-611fae5a-7db2-49ab-a061-10ee5409db55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:05.681130 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 798/1596] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:05 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:05.681875 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611fae5a-7db2-49ab-a061-10ee5409db55 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:05.692620 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611fae5a-7db2-49ab-a061-10ee5409db55 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:05.697136 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89bbc4-3f4d-4a4e-913d-6e142320c3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:05.697731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89bbc4-3f4d-4a4e-913d-6e142320c3ee admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:05.698014 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89bbc4-3f4d-4a4e-913d-6e142320c3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:05.698291 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89bbc4-3f4d-4a4e-913d-6e142320c3ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:05.698966 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a89bbc4-3f4d-4a4e-913d-6e142320c3ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:05.699594 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:05.700667 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a89bbc4-3f4d-4a4e-913d-6e142320c3ee admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:05.705374 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 799/1597] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:25:05 2022] PUT /identity/v3/projects/b18ce23826594ef2a366ca57b3b147aa/users/014a5ebd029d43d194722af661e4675b/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:05.706391 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf734b-dc68-46da-8530-129a443bbf68 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:05.706952 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:05.713705 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 799/1598] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:25:05.714593 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89bbc4-3f4d-4a4e-913d-6e142320c3ee admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:05.724668 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89bbc4-3f4d-4a4e-913d-6e142320c3ee admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:05.774327 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf734b-dc68-46da-8530-129a443bbf68 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:05.778369 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfcc800-9f65-428d-b03c-f4f1889eaf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:05.778978 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcc800-9f65-428d-b03c-f4f1889eaf9c admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:05.779255 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcc800-9f65-428d-b03c-f4f1889eaf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:05.779400 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919cf70-d4b3-4998-acbe-8def80aa095e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:05.779540 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcc800-9f65-428d-b03c-f4f1889eaf9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:05.779997 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919cf70-d4b3-4998-acbe-8def80aa095e admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:05.780173 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfcc800-9f65-428d-b03c-f4f1889eaf9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:05.780286 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919cf70-d4b3-4998-acbe-8def80aa095e admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:05.780547 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919cf70-d4b3-4998-acbe-8def80aa095e admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:05.781217 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f919cf70-d4b3-4998-acbe-8def80aa095e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:05.781800 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfcc800-9f65-428d-b03c-f4f1889eaf9c admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:05.783457 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f919cf70-d4b3-4998-acbe-8def80aa095e admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:05.792025 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 800/1599] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:25:05.793529 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfcc800-9f65-428d-b03c-f4f1889eaf9c admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:05.796345 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 800/1600] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:25:05.799742 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919cf70-d4b3-4998-acbe-8def80aa095e admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:05.803166 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfcc800-9f65-428d-b03c-f4f1889eaf9c admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:05.807902 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7355e6-ab77-4567-b32d-d852de1edd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:05.808403 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919cf70-d4b3-4998-acbe-8def80aa095e admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:05.808527 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7355e6-ab77-4567-b32d-d852de1edd6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:05.808799 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7355e6-ab77-4567-b32d-d852de1edd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:05.809072 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7355e6-ab77-4567-b32d-d852de1edd6c admin admin] PATH_INFO: `/v3/projects/be7ad115782648ee9da0b20452460bd2/users/bf2422e88cc94ef9b19f24f5d8e7d56c/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:05.813329 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495b9d5-d5d2-40ef-a565-6dbad5486241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:05.814394 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495b9d5-d5d2-40ef-a565-6dbad5486241 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:05.814678 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495b9d5-d5d2-40ef-a565-6dbad5486241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:05.814955 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495b9d5-d5d2-40ef-a565-6dbad5486241 admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:05.815607 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495b9d5-d5d2-40ef-a565-6dbad5486241 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:05.817564 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495b9d5-d5d2-40ef-a565-6dbad5486241 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:05.823814 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7355e6-ab77-4567-b32d-d852de1edd6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=be7ad115782648ee9da0b20452460bd2, user_id=bf2422e88cc94ef9b19f24f5d8e7d56c, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:05.828467 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7355e6-ab77-4567-b32d-d852de1edd6c admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:05.928693 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 801/1601] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:25:05 2022] POST /identity/v3/users => generated 292 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:25:05.929624 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495b9d5-d5d2-40ef-a565-6dbad5486241 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:05.938988 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495b9d5-d5d2-40ef-a565-6dbad5486241 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:05.943609 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d986caa-c6cd-4096-b959-ce9cc8db7fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:05.944184 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d986caa-c6cd-4096-b959-ce9cc8db7fee admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:05.944466 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d986caa-c6cd-4096-b959-ce9cc8db7fee admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:05.944752 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d986caa-c6cd-4096-b959-ce9cc8db7fee admin admin] PATH_INFO: `/v3/projects/4ce20c1e75b64e41a8c5234a3a83f66c/users/9222455cb9e047ab8b667b156c6f1f73/roles/5691bce246d6452990f13933e19f2825` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:05.949285 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 801/1602] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:25:05 2022] PUT /identity/v3/projects/be7ad115782648ee9da0b20452460bd2/users/bf2422e88cc94ef9b19f24f5d8e7d56c/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:05.950076 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7355e6-ab77-4567-b32d-d852de1edd6c admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:05.965130 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d986caa-c6cd-4096-b959-ce9cc8db7fee admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ce20c1e75b64e41a8c5234a3a83f66c, user_id=9222455cb9e047ab8b667b156c6f1f73, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:05.967799 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d986caa-c6cd-4096-b959-ce9cc8db7fee admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:06.011693 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7355e6-ab77-4567-b32d-d852de1edd6c admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:06.016239 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c548a0-0267-4606-96a5-3fbd1725765c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:06.016836 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c548a0-0267-4606-96a5-3fbd1725765c admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:06.017110 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c548a0-0267-4606-96a5-3fbd1725765c admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:06.017423 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c548a0-0267-4606-96a5-3fbd1725765c admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:06.018043 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c548a0-0267-4606-96a5-3fbd1725765c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:06.019960 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c548a0-0267-4606-96a5-3fbd1725765c admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:06.052606 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 802/1603] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:25:05 2022] PUT /identity/v3/projects/4ce20c1e75b64e41a8c5234a3a83f66c/users/9222455cb9e047ab8b667b156c6f1f73/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:06.054010 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db76ce-0c82-4e9c-a11a-9c6c450ba00b None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:06.054298 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db76ce-0c82-4e9c-a11a-9c6c450ba00b None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:06.054580 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db76ce-0c82-4e9c-a11a-9c6c450ba00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:06.073003 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-a5db76ce-0c82-4e9c-a11a-9c6c450ba00b None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:06.074203 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-a5db76ce-0c82-4e9c-a11a-9c6c450ba00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:06.128242 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 802/1604] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:25:05 2022] POST /identity/v3/projects => generated 405 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:25:06.128242 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c548a0-0267-4606-96a5-3fbd1725765c admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:06.144720 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 803/1605] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:06.145696 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db76ce-0c82-4e9c-a11a-9c6c450ba00b None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:06.155694 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db76ce-0c82-4e9c-a11a-9c6c450ba00b None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:06.195387 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:06.199171 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c548a0-0267-4606-96a5-3fbd1725765c admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:06.204841 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fb608-0aa0-46b1-9046-ec2f46923e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:06.206426 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fb608-0aa0-46b1-9046-ec2f46923e0a admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:06.206426 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fb608-0aa0-46b1-9046-ec2f46923e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:06.206697 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:06.207129 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fb608-0aa0-46b1-9046-ec2f46923e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:06.207129 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2fb608-0aa0-46b1-9046-ec2f46923e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:06.208212 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2fb608-0aa0-46b1-9046-ec2f46923e0a admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:06.212603 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478040b-f377-46da-a168-e71d21ba4297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:06.213076 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478040b-f377-46da-a168-e71d21ba4297 admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:06.213362 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478040b-f377-46da-a168-e71d21ba4297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:06.213630 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478040b-f377-46da-a168-e71d21ba4297 admin admin] PATH_INFO: `/v3/projects/4369767ae33e4c518c08b981a63fa391/users/2825bb31d1de466d80fcfd3e66bd7fae/roles/5691bce246d6452990f13933e19f2825` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:06.218257 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 803/1606] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:25:06.219194 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fb608-0aa0-46b1-9046-ec2f46923e0a admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:06.229638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2478040b-f377-46da-a168-e71d21ba4297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4369767ae33e4c518c08b981a63fa391, user_id=2825bb31d1de466d80fcfd3e66bd7fae, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:06.231871 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fb608-0aa0-46b1-9046-ec2f46923e0a admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:06.235294 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2478040b-f377-46da-a168-e71d21ba4297 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:06.236667 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70bf48-649b-4d47-a503-692efb3c7210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:06.237302 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70bf48-649b-4d47-a503-692efb3c7210 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:06.237586 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70bf48-649b-4d47-a503-692efb3c7210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:06.237866 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70bf48-649b-4d47-a503-692efb3c7210 admin admin] PATH_INFO: `/v3/projects/e99096f087154c9b84c0ecdd3785bab2/users/a896f09a7abd4c9d994f81c66f0cb23c/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:06.252101 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70bf48-649b-4d47-a503-692efb3c7210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e99096f087154c9b84c0ecdd3785bab2, user_id=a896f09a7abd4c9d994f81c66f0cb23c, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:06.254726 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70bf48-649b-4d47-a503-692efb3c7210 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:06.311309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 804/1607] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:25:06 2022] PUT /identity/v3/projects/4369767ae33e4c518c08b981a63fa391/users/2825bb31d1de466d80fcfd3e66bd7fae/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:06.312283 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478040b-f377-46da-a168-e71d21ba4297 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:06.336567 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 804/1608] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:25:06 2022] PUT /identity/v3/projects/e99096f087154c9b84c0ecdd3785bab2/users/a896f09a7abd4c9d994f81c66f0cb23c/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:06.337934 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e848d96-ecd7-4e9c-bce2-704af711c3cc None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:06.338227 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e848d96-ecd7-4e9c-bce2-704af711c3cc None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:06.338621 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e848d96-ecd7-4e9c-bce2-704af711c3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:06.360033 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-8e848d96-ecd7-4e9c-bce2-704af711c3cc None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:06.361291 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-8e848d96-ecd7-4e9c-bce2-704af711c3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:06.371898 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478040b-f377-46da-a168-e71d21ba4297 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:06.420812 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 805/1609] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:06.422475 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e8386-168d-4b2c-8da9-f030c36a1a42 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:06.422771 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e8386-168d-4b2c-8da9-f030c36a1a42 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:06.423049 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e8386-168d-4b2c-8da9-f030c36a1a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:06.437473 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdcfc4-31bb-4997-abb4-6ee34292033b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:06.438087 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdcfc4-31bb-4997-abb4-6ee34292033b admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:06.438373 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdcfc4-31bb-4997-abb4-6ee34292033b admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:06.438677 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdcfc4-31bb-4997-abb4-6ee34292033b admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:06.439343 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cdcfc4-31bb-4997-abb4-6ee34292033b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:06.440969 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cdcfc4-31bb-4997-abb4-6ee34292033b admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:06.443309 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-3c3e8386-168d-4b2c-8da9-f030c36a1a42 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:06.444560 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-3c3e8386-168d-4b2c-8da9-f030c36a1a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:06.457685 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 805/1610] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:25:06.457685 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdcfc4-31bb-4997-abb4-6ee34292033b admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:06.457955 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 806/1611] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:06.457955 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e8386-168d-4b2c-8da9-f030c36a1a42 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:06.463097 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdcfc4-31bb-4997-abb4-6ee34292033b admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:06.467805 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d5ed4-9c1b-41cb-9f9a-2a3fce248211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:06.468427 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d5ed4-9c1b-41cb-9f9a-2a3fce248211 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:06.468709 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d5ed4-9c1b-41cb-9f9a-2a3fce248211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:06.469003 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d5ed4-9c1b-41cb-9f9a-2a3fce248211 admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:06.469662 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d5ed4-9c1b-41cb-9f9a-2a3fce248211 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:06.471631 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d5ed4-9c1b-41cb-9f9a-2a3fce248211 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:06.513759 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e8386-168d-4b2c-8da9-f030c36a1a42 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:06.517838 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08755e31-f65f-48c4-9c47-860541c40850 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:06.518429 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08755e31-f65f-48c4-9c47-860541c40850 service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:06.518707 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08755e31-f65f-48c4-9c47-860541c40850 service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:06.518977 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08755e31-f65f-48c4-9c47-860541c40850 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:06.527577 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08755e31-f65f-48c4-9c47-860541c40850 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:06.528984 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08755e31-f65f-48c4-9c47-860541c40850 service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:06.538098 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 807/1612] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:06.538833 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08755e31-f65f-48c4-9c47-860541c40850 service neutron] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:06.547538 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08755e31-f65f-48c4-9c47-860541c40850 service neutron] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:06.555040 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 806/1613] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:25:06 2022] POST /identity/v3/users => generated 309 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:25:06.555202 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fad154-fd70-47c2-b09d-82ea05273cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:06.555202 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fad154-fd70-47c2-b09d-82ea05273cd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:06.555202 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fad154-fd70-47c2-b09d-82ea05273cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:06.555202 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fad154-fd70-47c2-b09d-82ea05273cd3 admin admin] PATH_INFO: `/v3/projects/1049450b0abe4ae69da9708435f04322/users/5f1629cbe3e64573bf444834d6083669/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:06.557111 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ba2ad-3fff-40d4-acb1-fc9adbfd4989 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:06.557111 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ba2ad-3fff-40d4-acb1-fc9adbfd4989 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:06.557111 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ba2ad-3fff-40d4-acb1-fc9adbfd4989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:06.569846 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fad154-fd70-47c2-b09d-82ea05273cd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1049450b0abe4ae69da9708435f04322, user_id=5f1629cbe3e64573bf444834d6083669, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:06.572593 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fad154-fd70-47c2-b09d-82ea05273cd3 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:06.576397 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-434ba2ad-3fff-40d4-acb1-fc9adbfd4989 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:06.577592 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-434ba2ad-3fff-40d4-acb1-fc9adbfd4989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:06.586372 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 807/1614] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:06.587549 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebc8c9-facf-4a28-ae3c-fe3a0c7c76f2 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:06.587830 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebc8c9-facf-4a28-ae3c-fe3a0c7c76f2 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:06.588099 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebc8c9-facf-4a28-ae3c-fe3a0c7c76f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:06.615375 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-e9ebc8c9-facf-4a28-ae3c-fe3a0c7c76f2 None None] MFA Rules not processed for user `a896f09a7abd4c9d994f81c66f0cb23c`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:06.616590 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-e9ebc8c9-facf-4a28-ae3c-fe3a0c7c76f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:06.653163 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 808/1615] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:25:06 2022] PUT /identity/v3/projects/1049450b0abe4ae69da9708435f04322/users/5f1629cbe3e64573bf444834d6083669/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:06.656589 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fad154-fd70-47c2-b09d-82ea05273cd3 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:06.666485 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:06.688427 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 808/1616] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:06.689734 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ebc8c9-facf-4a28-ae3c-fe3a0c7c76f2 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:06.700318 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ebc8c9-facf-4a28-ae3c-fe3a0c7c76f2 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:06.714912 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:06.733071 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fad154-fd70-47c2-b09d-82ea05273cd3 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:06.738368 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8c8b7-38e9-4971-8520-8feab9b24750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:06.743451 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8c8b7-38e9-4971-8520-8feab9b24750 service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:06.743451 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8c8b7-38e9-4971-8520-8feab9b24750 service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:06.743451 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8c8b7-38e9-4971-8520-8feab9b24750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:06.764434 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd54325-9bf2-4783-91b4-170ec186969d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:06.765097 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd54325-9bf2-4783-91b4-170ec186969d admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:06.765384 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd54325-9bf2-4783-91b4-170ec186969d admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:06.765667 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd54325-9bf2-4783-91b4-170ec186969d admin admin] PATH_INFO: `/v3/projects/21a8a8be78664b30b04b7aa4d1a23706/users/ce55551fb0714dfe9ba9beb38eec6d30/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:06.779760 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd54325-9bf2-4783-91b4-170ec186969d admin admin] RBAC: Authorizing `identity:create_grant(project_id=21a8a8be78664b30b04b7aa4d1a23706, user_id=ce55551fb0714dfe9ba9beb38eec6d30, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:06.782934 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd54325-9bf2-4783-91b4-170ec186969d admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:06.800152 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8c8b7-38e9-4971-8520-8feab9b24750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:06.801813 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8c8b7-38e9-4971-8520-8feab9b24750 service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:06.812197 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 809/1617] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:06.813167 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8c8b7-38e9-4971-8520-8feab9b24750 service neutron] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:06.814558 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-acf8c8b7-38e9-4971-8520-8feab9b24750 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:06.825688 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8c8b7-38e9-4971-8520-8feab9b24750 service neutron] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:06.830241 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f6300-7b51-438e-8eee-b59974bc5d1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:06.830841 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f6300-7b51-438e-8eee-b59974bc5d1e service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:06.831125 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f6300-7b51-438e-8eee-b59974bc5d1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:06.831430 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f6300-7b51-438e-8eee-b59974bc5d1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:06.840767 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f6300-7b51-438e-8eee-b59974bc5d1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:06.842240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f6300-7b51-438e-8eee-b59974bc5d1e service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:06.855176 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 810/1618] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:06.858417 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f6300-7b51-438e-8eee-b59974bc5d1e service neutron] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:06.858641 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 809/1619] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:25:06 2022] PUT /identity/v3/projects/21a8a8be78664b30b04b7aa4d1a23706/users/ce55551fb0714dfe9ba9beb38eec6d30/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:06.858641 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd54325-9bf2-4783-91b4-170ec186969d admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:06.870101 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f6300-7b51-438e-8eee-b59974bc5d1e service neutron] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:06.934929 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd54325-9bf2-4783-91b4-170ec186969d admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:06.939882 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2d1c7-801d-487b-9d5f-a1d36deb72d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:06.940500 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2d1c7-801d-487b-9d5f-a1d36deb72d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:06.940786 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2d1c7-801d-487b-9d5f-a1d36deb72d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:06.941068 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2d1c7-801d-487b-9d5f-a1d36deb72d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:06.949592 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6c4b9-791f-43f7-955d-8e69fc8ab267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:06.950202 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6c4b9-791f-43f7-955d-8e69fc8ab267 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:06.950546 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6c4b9-791f-43f7-955d-8e69fc8ab267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:06.950862 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6c4b9-791f-43f7-955d-8e69fc8ab267 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:06.951536 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6c4b9-791f-43f7-955d-8e69fc8ab267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:06.953645 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6c4b9-791f-43f7-955d-8e69fc8ab267 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:06.965099 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 811/1620] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:25:06.965099 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe14fda-11f3-46c0-8eba-ef2d42156784 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:06.965339 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe14fda-11f3-46c0-8eba-ef2d42156784 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:06.965535 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe14fda-11f3-46c0-8eba-ef2d42156784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:06.983239 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-afe14fda-11f3-46c0-8eba-ef2d42156784 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:06.984457 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-afe14fda-11f3-46c0-8eba-ef2d42156784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:06.992605 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 812/1621] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:06.993557 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ace50-2700-4417-80fb-8b725ffebbe7 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:06.993837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ace50-2700-4417-80fb-8b725ffebbe7 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:06.994115 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ace50-2700-4417-80fb-8b725ffebbe7 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:06.995601 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 813/1622] 10.222.0.23 () {54 vars in 962 bytes} [Mon Aug 8 02:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:25:06.996302 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ace50-2700-4417-80fb-8b725ffebbe7 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:07.009538 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ace50-2700-4417-80fb-8b725ffebbe7 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:07.015269 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4659b3-b2cf-4fdc-8574-a48261cd3021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:07.015918 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4659b3-b2cf-4fdc-8574-a48261cd3021 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:07.028086 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4659b3-b2cf-4fdc-8574-a48261cd3021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:07.028086 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4659b3-b2cf-4fdc-8574-a48261cd3021 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:07.028086 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4659b3-b2cf-4fdc-8574-a48261cd3021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:07.028462 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd2d1c7-801d-487b-9d5f-a1d36deb72d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:07.028592 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4659b3-b2cf-4fdc-8574-a48261cd3021 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:07.028689 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd2d1c7-801d-487b-9d5f-a1d36deb72d9 service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:07.029563 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 810/1623] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:07.030217 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2d1c7-801d-487b-9d5f-a1d36deb72d9 service neutron] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:07.030936 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 814/1624] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:25:07.031850 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4659b3-b2cf-4fdc-8574-a48261cd3021 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:07.039547 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2d1c7-801d-487b-9d5f-a1d36deb72d9 service neutron] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:07.041635 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4659b3-b2cf-4fdc-8574-a48261cd3021 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:07.044377 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f142caf-584a-4de1-b3c5-3cee19c63057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:07.045116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f142caf-584a-4de1-b3c5-3cee19c63057 admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:07.045510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f142caf-584a-4de1-b3c5-3cee19c63057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:07.045884 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f142caf-584a-4de1-b3c5-3cee19c63057 admin admin] PATH_INFO: `/v3/projects/ba38147cfc2a4acdac3c79d6deccf9d8/users/aeb086d354f44131b119659310aad591/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:07.047821 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76ca9e-b79f-4e76-9d8e-ef2faa96b08a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:07.049231 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76ca9e-b79f-4e76-9d8e-ef2faa96b08a service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:07.049523 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76ca9e-b79f-4e76-9d8e-ef2faa96b08a service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:07.049800 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76ca9e-b79f-4e76-9d8e-ef2faa96b08a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:07.061347 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d76ca9e-b79f-4e76-9d8e-ef2faa96b08a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:07.063118 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d76ca9e-b79f-4e76-9d8e-ef2faa96b08a service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:07.067708 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f142caf-584a-4de1-b3c5-3cee19c63057 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba38147cfc2a4acdac3c79d6deccf9d8, user_id=aeb086d354f44131b119659310aad591, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:07.085484 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f142caf-584a-4de1-b3c5-3cee19c63057 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:07.085912 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 815/1625] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:07.086029 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:07.086127 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aacc58-f32b-4b3e-82a8-a6d3b2ac1fb0 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:07.086127 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aacc58-f32b-4b3e-82a8-a6d3b2ac1fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:07.086127 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aacc58-f32b-4b3e-82a8-a6d3b2ac1fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:07.115218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-29aacc58-f32b-4b3e-82a8-a6d3b2ac1fb0 None None] MFA Rules not processed for user `5d89e0c7d62444e4b75d3f4da49b2bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:07.116562 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-29aacc58-f32b-4b3e-82a8-a6d3b2ac1fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:07.189994 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 816/1626] 10.222.0.23 () {58 vars in 1059 bytes} [Mon Aug 8 02:25:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:07.190880 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aacc58-f32b-4b3e-82a8-a6d3b2ac1fb0 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:07.206427 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aacc58-f32b-4b3e-82a8-a6d3b2ac1fb0 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:07.209304 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd488a-2f3f-416b-a93b-395bf95a3e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:07.210135 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd488a-2f3f-416b-a93b-395bf95a3e33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:07.210425 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd488a-2f3f-416b-a93b-395bf95a3e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:07.210694 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd488a-2f3f-416b-a93b-395bf95a3e33 admin admin] PATH_INFO: `/v3/projects/21a8a8be78664b30b04b7aa4d1a23706/users/ce55551fb0714dfe9ba9beb38eec6d30/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:07.212739 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd488a-2f3f-416b-a93b-395bf95a3e33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21a8a8be78664b30b04b7aa4d1a23706, user_id=ce55551fb0714dfe9ba9beb38eec6d30, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:07.215618 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd488a-2f3f-416b-a93b-395bf95a3e33 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:07.227187 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 817/1627] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:25:07 2022] PUT /identity/v3/projects/21a8a8be78664b30b04b7aa4d1a23706/users/ce55551fb0714dfe9ba9beb38eec6d30/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:07.232583 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd488a-2f3f-416b-a93b-395bf95a3e33 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:07.263197 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 811/1628] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:25:07 2022] PUT /identity/v3/projects/ba38147cfc2a4acdac3c79d6deccf9d8/users/aeb086d354f44131b119659310aad591/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:07.265298 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df7fea-bf5c-4325-8372-6111656a6f47 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:07.265637 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df7fea-bf5c-4325-8372-6111656a6f47 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:07.266035 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df7fea-bf5c-4325-8372-6111656a6f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:07.314141 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-45df7fea-bf5c-4325-8372-6111656a6f47 None None] MFA Rules not processed for user `ce55551fb0714dfe9ba9beb38eec6d30`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:07.315952 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-45df7fea-bf5c-4325-8372-6111656a6f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:07.331375 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd488a-2f3f-416b-a93b-395bf95a3e33 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:07.425758 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b536b5-428d-4f68-b1e0-e950d6da5068 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:07.426496 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b536b5-428d-4f68-b1e0-e950d6da5068 service nova] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:07.427237 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b536b5-428d-4f68-b1e0-e950d6da5068 service nova] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:07.427621 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b536b5-428d-4f68-b1e0-e950d6da5068 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:07.429547 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 812/1629] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:07.430372 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df7fea-bf5c-4325-8372-6111656a6f47 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:07.478684 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:07.505401 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b536b5-428d-4f68-b1e0-e950d6da5068 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:07.507439 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b536b5-428d-4f68-b1e0-e950d6da5068 service nova] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:07.510838 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df7fea-bf5c-4325-8372-6111656a6f47 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:07.516959 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d67a9-41ab-481e-9363-93fdc319dc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:07.517935 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d67a9-41ab-481e-9363-93fdc319dc6b admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:07.518438 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d67a9-41ab-481e-9363-93fdc319dc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:07.518774 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d67a9-41ab-481e-9363-93fdc319dc6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:07.519558 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d67a9-41ab-481e-9363-93fdc319dc6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:07.520528 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 818/1630] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:07.521292 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d67a9-41ab-481e-9363-93fdc319dc6b admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:07.521958 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b536b5-428d-4f68-b1e0-e950d6da5068 service nova] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:07.536617 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 813/1631] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:25:07.541784 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d67a9-41ab-481e-9363-93fdc319dc6b admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:07.554835 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d67a9-41ab-481e-9363-93fdc319dc6b admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:07.561236 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6bfc6b-6f23-42cc-abf8-5ab12e40edee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:07.562855 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6bfc6b-6f23-42cc-abf8-5ab12e40edee admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:07.564669 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6bfc6b-6f23-42cc-abf8-5ab12e40edee admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:07.570769 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6bfc6b-6f23-42cc-abf8-5ab12e40edee admin admin] PATH_INFO: `/v3/projects/ba38147cfc2a4acdac3c79d6deccf9d8/users/aeb086d354f44131b119659310aad591/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:07.570769 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6bfc6b-6f23-42cc-abf8-5ab12e40edee admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba38147cfc2a4acdac3c79d6deccf9d8, user_id=aeb086d354f44131b119659310aad591, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:07.572749 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6bfc6b-6f23-42cc-abf8-5ab12e40edee admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:07.594864 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 814/1632] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:25:07 2022] PUT /identity/v3/projects/ba38147cfc2a4acdac3c79d6deccf9d8/users/aeb086d354f44131b119659310aad591/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:25:07.596681 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92297d2f-bbfe-4227-b355-1ce1c6a4ee31 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:07.596975 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92297d2f-bbfe-4227-b355-1ce1c6a4ee31 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:07.597252 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92297d2f-bbfe-4227-b355-1ce1c6a4ee31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:07.608477 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b536b5-428d-4f68-b1e0-e950d6da5068 service nova] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:07.631611 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-92297d2f-bbfe-4227-b355-1ce1c6a4ee31 None None] MFA Rules not processed for user `aeb086d354f44131b119659310aad591`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:07.633001 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-92297d2f-bbfe-4227-b355-1ce1c6a4ee31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:07.680928 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f308a-30cc-49e6-9101-f8e24305e801 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:07.681546 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f308a-30cc-49e6-9101-f8e24305e801 service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:07.681878 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f308a-30cc-49e6-9101-f8e24305e801 service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:07.682310 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f308a-30cc-49e6-9101-f8e24305e801 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:07.687188 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:07.744663 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 815/1633] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:07 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:07.753326 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92297d2f-bbfe-4227-b355-1ce1c6a4ee31 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:07.764734 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92297d2f-bbfe-4227-b355-1ce1c6a4ee31 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:07.769960 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac86e2-b42c-4efe-a6d8-f93d5cde74b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:07.772204 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac86e2-b42c-4efe-a6d8-f93d5cde74b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:07.772356 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac86e2-b42c-4efe-a6d8-f93d5cde74b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:07.772655 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac86e2-b42c-4efe-a6d8-f93d5cde74b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:07.784245 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f308a-30cc-49e6-9101-f8e24305e801 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:07.785145 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac86e2-b42c-4efe-a6d8-f93d5cde74b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:07.785841 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f308a-30cc-49e6-9101-f8e24305e801 service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:07.786885 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac86e2-b42c-4efe-a6d8-f93d5cde74b8 service cinder] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:07.810801 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 819/1634] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:07.813165 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:07.832320 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 816/1635] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:07 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:07.900642 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b00f6b-718b-4a1a-b486-6e4c27b03922 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:07.900961 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b00f6b-718b-4a1a-b486-6e4c27b03922 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:07.901217 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b00f6b-718b-4a1a-b486-6e4c27b03922 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:07.902761 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 820/1636] 10.222.0.23 () {54 vars in 912 bytes} [Mon Aug 8 02:25:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:25:07.927290 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01124b64-1388-4d2d-8a51-fcc4b4d6e3d7 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:07.927615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01124b64-1388-4d2d-8a51-fcc4b4d6e3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:07.927902 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01124b64-1388-4d2d-8a51-fcc4b4d6e3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:07.961879 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-01124b64-1388-4d2d-8a51-fcc4b4d6e3d7 None None] MFA Rules not processed for user `5d89e0c7d62444e4b75d3f4da49b2bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:07.963478 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-01124b64-1388-4d2d-8a51-fcc4b4d6e3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:08.061851 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 817/1637] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 8 02:25:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:08.091616 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b00f6b-718b-4a1a-b486-6e4c27b03922 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:08.103204 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b00f6b-718b-4a1a-b486-6e4c27b03922 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:08.107161 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f4da9-9826-440d-8890-78483670c98e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:08.107808 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f4da9-9826-440d-8890-78483670c98e service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:08.108091 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f4da9-9826-440d-8890-78483670c98e service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:08.108366 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f4da9-9826-440d-8890-78483670c98e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:08.136710 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f4da9-9826-440d-8890-78483670c98e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:08.138418 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f4da9-9826-440d-8890-78483670c98e service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:08.159107 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 821/1638] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:08.199015 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01124b64-1388-4d2d-8a51-fcc4b4d6e3d7 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:08.239384 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f4da9-9826-440d-8890-78483670c98e service cinder] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:08.251606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f4da9-9826-440d-8890-78483670c98e service cinder] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:08.268660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbe35e-bfe6-4090-bdb3-3cbd43678539 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:08.269338 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbe35e-bfe6-4090-bdb3-3cbd43678539 service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:08.272458 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbe35e-bfe6-4090-bdb3-3cbd43678539 service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:08.272757 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbe35e-bfe6-4090-bdb3-3cbd43678539 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:08.342201 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01124b64-1388-4d2d-8a51-fcc4b4d6e3d7 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:08.347131 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc9483-8a2c-408d-a177-8a9010e684ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:08.347908 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc9483-8a2c-408d-a177-8a9010e684ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:08.348466 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc9483-8a2c-408d-a177-8a9010e684ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:08.348605 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc9483-8a2c-408d-a177-8a9010e684ff admin admin] PATH_INFO: `/v3/users/a12216bc8f0e4eeca9e753b9b430fa2b` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:08.349788 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc9483-8a2c-408d-a177-8a9010e684ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=a12216bc8f0e4eeca9e753b9b430fa2b)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:08.350847 dv-cinder-740146-18-smb devstack@keystone.service[80638]: WARNING py.warnings [None req-1efc9483-8a2c-408d-a177-8a9010e684ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:25:08.350847 dv-cinder-740146-18-smb devstack@keystone.service[80638]: warnings.warn(msg) Aug 08 02:25:08.350847 dv-cinder-740146-18-smb devstack@keystone.service[80638]: Aug 08 02:25:08.352277 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc9483-8a2c-408d-a177-8a9010e684ff admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:08.369606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bbe35e-bfe6-4090-bdb3-3cbd43678539 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:08.371936 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bbe35e-bfe6-4090-bdb3-3cbd43678539 service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:08.384121 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 822/1639] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:25:08.604420 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-1efc9483-8a2c-408d-a177-8a9010e684ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a12216bc8f0e4eeca9e753b9b430fa2b'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:08.615069 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:08.698081 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-1efc9483-8a2c-408d-a177-8a9010e684ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a12216bc8f0e4eeca9e753b9b430fa2b'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:08.698346 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-1efc9483-8a2c-408d-a177-8a9010e684ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a12216bc8f0e4eeca9e753b9b430fa2b'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:08.698859 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-1efc9483-8a2c-408d-a177-8a9010e684ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a12216bc8f0e4eeca9e753b9b430fa2b'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:08.722395 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-1efc9483-8a2c-408d-a177-8a9010e684ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a12216bc8f0e4eeca9e753b9b430fa2b'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:08.742834 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 818/1640] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:25:08 2022] DELETE /identity/v3/users/a12216bc8f0e4eeca9e753b9b430fa2b => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:08.744079 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a01961-ed46-46c0-b95a-cf1c3ee9e29d None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:08.744388 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a01961-ed46-46c0-b95a-cf1c3ee9e29d None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:08.744649 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a01961-ed46-46c0-b95a-cf1c3ee9e29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:08.779979 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-09a01961-ed46-46c0-b95a-cf1c3ee9e29d None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:08.781213 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-09a01961-ed46-46c0-b95a-cf1c3ee9e29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:08.862290 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 823/1641] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:25:08.888796 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc9483-8a2c-408d-a177-8a9010e684ff admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:08.890712 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-1efc9483-8a2c-408d-a177-8a9010e684ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:08.927027 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:08.975468 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc9483-8a2c-408d-a177-8a9010e684ff admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:09.001517 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294bb58-7ec7-455a-a7d4-f21f6a21df4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:09.001517 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294bb58-7ec7-455a-a7d4-f21f6a21df4f service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:09.001517 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294bb58-7ec7-455a-a7d4-f21f6a21df4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:09.001517 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294bb58-7ec7-455a-a7d4-f21f6a21df4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:09.038923 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0294bb58-7ec7-455a-a7d4-f21f6a21df4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:09.041120 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0294bb58-7ec7-455a-a7d4-f21f6a21df4f service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:09.059044 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 819/1642] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:10.183249 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a01961-ed46-46c0-b95a-cf1c3ee9e29d None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:10.187133 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-09a01961-ed46-46c0-b95a-cf1c3ee9e29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:10.225065 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a01961-ed46-46c0-b95a-cf1c3ee9e29d None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:10.236907 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c595a-c9de-4697-92bf-94750887b487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:10.237020 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c595a-c9de-4697-92bf-94750887b487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:10.237293 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c595a-c9de-4697-92bf-94750887b487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:10.237564 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c595a-c9de-4697-92bf-94750887b487 admin admin] PATH_INFO: `/v3/projects/e417a84ba65b4d0e80f19abe51838428` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:10.241932 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c595a-c9de-4697-92bf-94750887b487 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e417a84ba65b4d0e80f19abe51838428)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:10.242988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: WARNING py.warnings [None req-7e5c595a-c9de-4697-92bf-94750887b487 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:25:10.242988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: warnings.warn(msg) Aug 08 02:25:10.242988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: Aug 08 02:25:10.246310 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c595a-c9de-4697-92bf-94750887b487 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:10.457064 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-7e5c595a-c9de-4697-92bf-94750887b487 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e417a84ba65b4d0e80f19abe51838428', 'request_id': 'req-7e5c595a-c9de-4697-92bf-94750887b487'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:10.468681 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-7e5c595a-c9de-4697-92bf-94750887b487 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e417a84ba65b4d0e80f19abe51838428', 'request_id': 'req-7e5c595a-c9de-4697-92bf-94750887b487'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:10.508472 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-7e5c595a-c9de-4697-92bf-94750887b487 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e417a84ba65b4d0e80f19abe51838428', 'request_id': 'req-7e5c595a-c9de-4697-92bf-94750887b487'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:10.677183 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-7e5c595a-c9de-4697-92bf-94750887b487 admin admin] The token cache is being invalidate because project e417a84ba65b4d0e80f19abe51838428 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:25:10.679291 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-7e5c595a-c9de-4697-92bf-94750887b487 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:10.680808 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-7e5c595a-c9de-4697-92bf-94750887b487 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:10.694959 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 824/1643] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:25:10 2022] DELETE /identity/v3/projects/e417a84ba65b4d0e80f19abe51838428 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:10.698953 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294bb58-7ec7-455a-a7d4-f21f6a21df4f service neutron] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:10.710510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294bb58-7ec7-455a-a7d4-f21f6a21df4f service neutron] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:10.885847 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c4702-d53d-49ff-97c7-9185989cec4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:10.886507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c4702-d53d-49ff-97c7-9185989cec4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:10.886793 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c4702-d53d-49ff-97c7-9185989cec4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:10.887072 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c4702-d53d-49ff-97c7-9185989cec4e admin admin] PATH_INFO: `/v3/users/aeb086d354f44131b119659310aad591` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:10.892119 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c4702-d53d-49ff-97c7-9185989cec4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=aeb086d354f44131b119659310aad591)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:10.895928 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c4702-d53d-49ff-97c7-9185989cec4e admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:11.254756 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-cb1c4702-d53d-49ff-97c7-9185989cec4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aeb086d354f44131b119659310aad591'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:11.418945 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-cb1c4702-d53d-49ff-97c7-9185989cec4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aeb086d354f44131b119659310aad591'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:11.420639 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-cb1c4702-d53d-49ff-97c7-9185989cec4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aeb086d354f44131b119659310aad591'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:11.421625 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-cb1c4702-d53d-49ff-97c7-9185989cec4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aeb086d354f44131b119659310aad591'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:11.453759 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-cb1c4702-d53d-49ff-97c7-9185989cec4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aeb086d354f44131b119659310aad591'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:11.518083 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a808d-ea14-4c0e-aa30-47d2f8eaf44f None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:11.518694 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a808d-ea14-4c0e-aa30-47d2f8eaf44f None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:11.518784 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a808d-ea14-4c0e-aa30-47d2f8eaf44f None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:11.520532 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 825/1644] 10.222.0.23 () {54 vars in 962 bytes} [Mon Aug 8 02:25:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 02:25:11.525931 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 820/1645] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:25:10 2022] DELETE /identity/v3/users/aeb086d354f44131b119659310aad591 => generated 0 bytes in 827 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:11.539245 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b7b10-60a7-4664-bcf3-d093090fe347 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:11.539576 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b7b10-60a7-4664-bcf3-d093090fe347 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:11.539855 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b7b10-60a7-4664-bcf3-d093090fe347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:11.571344 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-781b7b10-60a7-4664-bcf3-d093090fe347 None None] MFA Rules not processed for user `5d89e0c7d62444e4b75d3f4da49b2bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:11.574320 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-781b7b10-60a7-4664-bcf3-d093090fe347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:11.673625 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:11.706810 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 826/1646] 10.222.0.23 () {58 vars in 1059 bytes} [Mon Aug 8 02:25:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:25:11.712929 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55381a1-db21-449b-865f-9a34481d4e77 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:11.713474 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55381a1-db21-449b-865f-9a34481d4e77 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:11.713550 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55381a1-db21-449b-865f-9a34481d4e77 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:11.715849 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 821/1647] 10.222.0.23 () {54 vars in 912 bytes} [Mon Aug 8 02:25:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:25:11.723186 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f96c4-8ce1-4ed3-a01b-6ee72ba361d3 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:11.723927 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f96c4-8ce1-4ed3-a01b-6ee72ba361d3 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:11.724996 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f96c4-8ce1-4ed3-a01b-6ee72ba361d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:11.822825 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-8e7f96c4-8ce1-4ed3-a01b-6ee72ba361d3 None None] MFA Rules not processed for user `5d89e0c7d62444e4b75d3f4da49b2bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:11.824916 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-8e7f96c4-8ce1-4ed3-a01b-6ee72ba361d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:11.851927 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 827/1648] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 8 02:25:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:11.865979 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55381a1-db21-449b-865f-9a34481d4e77 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:11.871503 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-d55381a1-db21-449b-865f-9a34481d4e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:11.944580 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55381a1-db21-449b-865f-9a34481d4e77 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:11.948851 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8537dd0-5253-4fe1-ac57-0f09e08857c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:11.949469 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8537dd0-5253-4fe1-ac57-0f09e08857c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:11.949754 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8537dd0-5253-4fe1-ac57-0f09e08857c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:11.950032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8537dd0-5253-4fe1-ac57-0f09e08857c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:11.964232 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:11.967984 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8537dd0-5253-4fe1-ac57-0f09e08857c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:11.970235 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8537dd0-5253-4fe1-ac57-0f09e08857c3 service cinder] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:11.983503 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 822/1649] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:13.542655 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f96c4-8ce1-4ed3-a01b-6ee72ba361d3 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:13.546922 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-8e7f96c4-8ce1-4ed3-a01b-6ee72ba361d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:13.722657 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f96c4-8ce1-4ed3-a01b-6ee72ba361d3 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:13.733037 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f70f90-16a5-4ec0-ba32-207ee1a990c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:13.733703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f70f90-16a5-4ec0-ba32-207ee1a990c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:13.733992 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f70f90-16a5-4ec0-ba32-207ee1a990c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:13.734273 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f70f90-16a5-4ec0-ba32-207ee1a990c1 admin admin] PATH_INFO: `/v3/projects/ba38147cfc2a4acdac3c79d6deccf9d8` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:13.736790 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f70f90-16a5-4ec0-ba32-207ee1a990c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba38147cfc2a4acdac3c79d6deccf9d8)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:13.741272 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f70f90-16a5-4ec0-ba32-207ee1a990c1 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:13.946536 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-78f70f90-16a5-4ec0-ba32-207ee1a990c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba38147cfc2a4acdac3c79d6deccf9d8', 'request_id': 'req-78f70f90-16a5-4ec0-ba32-207ee1a990c1'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:13.960236 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-78f70f90-16a5-4ec0-ba32-207ee1a990c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba38147cfc2a4acdac3c79d6deccf9d8', 'request_id': 'req-78f70f90-16a5-4ec0-ba32-207ee1a990c1'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:13.980902 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-78f70f90-16a5-4ec0-ba32-207ee1a990c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba38147cfc2a4acdac3c79d6deccf9d8', 'request_id': 'req-78f70f90-16a5-4ec0-ba32-207ee1a990c1'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:14.082800 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-78f70f90-16a5-4ec0-ba32-207ee1a990c1 admin admin] The token cache is being invalidate because project ba38147cfc2a4acdac3c79d6deccf9d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:25:14.086313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-78f70f90-16a5-4ec0-ba32-207ee1a990c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:14.086313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-78f70f90-16a5-4ec0-ba32-207ee1a990c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:14.101205 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 828/1650] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:25:13 2022] DELETE /identity/v3/projects/ba38147cfc2a4acdac3c79d6deccf9d8 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:14.106323 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f1b21-d979-4b1a-ae9f-d42c1f1524bc None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:14.107516 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f1b21-d979-4b1a-ae9f-d42c1f1524bc None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:14.108132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f1b21-d979-4b1a-ae9f-d42c1f1524bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:14.155666 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-5b6f1b21-d979-4b1a-ae9f-d42c1f1524bc None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:14.159535 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-5b6f1b21-d979-4b1a-ae9f-d42c1f1524bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:14.439827 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 823/1651] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:14.442196 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72975c-79b6-4623-a1ec-977718354b09 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:14.442487 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72975c-79b6-4623-a1ec-977718354b09 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:14.442768 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72975c-79b6-4623-a1ec-977718354b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:14.541950 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-5b72975c-79b6-4623-a1ec-977718354b09 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:14.546426 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-5b72975c-79b6-4623-a1ec-977718354b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:14.596909 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 829/1652] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:14.600353 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f1b21-d979-4b1a-ae9f-d42c1f1524bc None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:14.611906 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f1b21-d979-4b1a-ae9f-d42c1f1524bc None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:14.645100 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4cfbd5-e480-4368-b457-ec6b13c0d2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:14.645744 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4cfbd5-e480-4368-b457-ec6b13c0d2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:14.646033 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4cfbd5-e480-4368-b457-ec6b13c0d2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:14.646319 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4cfbd5-e480-4368-b457-ec6b13c0d2d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:14.646991 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4cfbd5-e480-4368-b457-ec6b13c0d2d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:25:14.647307 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4cfbd5-e480-4368-b457-ec6b13c0d2d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:14.652878 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4cfbd5-e480-4368-b457-ec6b13c0d2d2 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:14.709650 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72975c-79b6-4623-a1ec-977718354b09 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:14.709855 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 824/1653] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:25:14.722134 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72975c-79b6-4623-a1ec-977718354b09 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:14.745756 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0cba02-82b9-4b57-8db3-53feeb53391a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:14.746618 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0cba02-82b9-4b57-8db3-53feeb53391a admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:14.747461 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0cba02-82b9-4b57-8db3-53feeb53391a admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:14.747878 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0cba02-82b9-4b57-8db3-53feeb53391a admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:14.748688 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0cba02-82b9-4b57-8db3-53feeb53391a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:14.751497 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0cba02-82b9-4b57-8db3-53feeb53391a admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:14.867078 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 830/1654] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:25:14 2022] POST /identity/v3/projects => generated 403 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:25:14.869803 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4cfbd5-e480-4368-b457-ec6b13c0d2d2 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:14.886361 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4cfbd5-e480-4368-b457-ec6b13c0d2d2 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:15.011454 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35926782-728c-4e83-b751-0bbe83fce67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:15.012131 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35926782-728c-4e83-b751-0bbe83fce67b admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:15.012595 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35926782-728c-4e83-b751-0bbe83fce67b admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:15.012768 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35926782-728c-4e83-b751-0bbe83fce67b admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:15.013457 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35926782-728c-4e83-b751-0bbe83fce67b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:15.018952 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35926782-728c-4e83-b751-0bbe83fce67b admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:15.215964 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0cba02-82b9-4b57-8db3-53feeb53391a admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:15.218523 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-4b0cba02-82b9-4b57-8db3-53feeb53391a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:15.251659 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0cba02-82b9-4b57-8db3-53feeb53391a admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:15.256049 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6871c-01c4-4457-9629-5d2260f9e168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:15.256709 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6871c-01c4-4457-9629-5d2260f9e168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:15.256994 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6871c-01c4-4457-9629-5d2260f9e168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:15.257275 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6871c-01c4-4457-9629-5d2260f9e168 admin admin] PATH_INFO: `/v3/users/a896f09a7abd4c9d994f81c66f0cb23c` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:15.265110 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6871c-01c4-4457-9629-5d2260f9e168 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a896f09a7abd4c9d994f81c66f0cb23c)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:15.267860 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6871c-01c4-4457-9629-5d2260f9e168 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:15.278626 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 825/1655] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:25:14 2022] POST /identity/v3/users => generated 302 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:25:15.281923 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35926782-728c-4e83-b751-0bbe83fce67b admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:15.309804 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35926782-728c-4e83-b751-0bbe83fce67b admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:15.347904 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98024c8d-37a9-4b0b-bfc6-898f9900fb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:15.348591 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98024c8d-37a9-4b0b-bfc6-898f9900fb48 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:15.348883 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98024c8d-37a9-4b0b-bfc6-898f9900fb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:15.349163 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98024c8d-37a9-4b0b-bfc6-898f9900fb48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:15.349845 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98024c8d-37a9-4b0b-bfc6-898f9900fb48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:15.351758 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98024c8d-37a9-4b0b-bfc6-898f9900fb48 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:15.389636 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 826/1656] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:25:15.390745 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98024c8d-37a9-4b0b-bfc6-898f9900fb48 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:15.417981 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98024c8d-37a9-4b0b-bfc6-898f9900fb48 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:15.426576 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadfc21-5a87-4778-ba62-6ef9f86dc53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:15.427288 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadfc21-5a87-4778-ba62-6ef9f86dc53b admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:15.427624 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadfc21-5a87-4778-ba62-6ef9f86dc53b admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:15.427909 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadfc21-5a87-4778-ba62-6ef9f86dc53b admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:15.428670 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dadfc21-5a87-4778-ba62-6ef9f86dc53b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:15.431191 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dadfc21-5a87-4778-ba62-6ef9f86dc53b admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:15.460040 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 827/1657] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:25:15.461157 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadfc21-5a87-4778-ba62-6ef9f86dc53b admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:15.474518 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadfc21-5a87-4778-ba62-6ef9f86dc53b admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:15.482175 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc045e9-107e-4b0e-91a9-2f7b02f5d03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:15.483105 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc045e9-107e-4b0e-91a9-2f7b02f5d03c admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:15.483433 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc045e9-107e-4b0e-91a9-2f7b02f5d03c admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:15.483723 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc045e9-107e-4b0e-91a9-2f7b02f5d03c admin admin] PATH_INFO: `/v3/projects/9be2feeb2d4b4d708ce13d4c9612f705/users/6c16e5594e59435cb1a5cba601744b81/roles/5691bce246d6452990f13933e19f2825` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:15.486489 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:15.518233 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc045e9-107e-4b0e-91a9-2f7b02f5d03c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9be2feeb2d4b4d708ce13d4c9612f705, user_id=6c16e5594e59435cb1a5cba601744b81, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:15.527854 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc045e9-107e-4b0e-91a9-2f7b02f5d03c admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:15.633434 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 828/1658] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:25:15 2022] PUT /identity/v3/projects/9be2feeb2d4b4d708ce13d4c9612f705/users/6c16e5594e59435cb1a5cba601744b81/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:15.640709 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad8fc9-0917-41bf-8e77-6049ca73911b None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:15.642648 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad8fc9-0917-41bf-8e77-6049ca73911b None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:15.643818 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad8fc9-0917-41bf-8e77-6049ca73911b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:15.651827 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:15.677881 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-a4d6871c-01c4-4457-9629-5d2260f9e168 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a896f09a7abd4c9d994f81c66f0cb23c'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:15.707119 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-77ad8fc9-0917-41bf-8e77-6049ca73911b None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:15.708852 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-77ad8fc9-0917-41bf-8e77-6049ca73911b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:15.761194 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-a4d6871c-01c4-4457-9629-5d2260f9e168 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a896f09a7abd4c9d994f81c66f0cb23c'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:15.762362 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-a4d6871c-01c4-4457-9629-5d2260f9e168 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a896f09a7abd4c9d994f81c66f0cb23c'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:15.786042 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-a4d6871c-01c4-4457-9629-5d2260f9e168 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a896f09a7abd4c9d994f81c66f0cb23c'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:15.808274 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-a4d6871c-01c4-4457-9629-5d2260f9e168 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a896f09a7abd4c9d994f81c66f0cb23c'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:15.831665 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 831/1659] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:25:15 2022] DELETE /identity/v3/users/a896f09a7abd4c9d994f81c66f0cb23c => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:15.835336 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028691ea-02b0-4cff-9fd4-741c63beac2e None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:15.835794 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028691ea-02b0-4cff-9fd4-741c63beac2e None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:15.837226 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028691ea-02b0-4cff-9fd4-741c63beac2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:15.881396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 829/1660] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:15.885144 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-028691ea-02b0-4cff-9fd4-741c63beac2e None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:15.886970 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-028691ea-02b0-4cff-9fd4-741c63beac2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:15.945476 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad8fc9-0917-41bf-8e77-6049ca73911b None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:15.947558 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-77ad8fc9-0917-41bf-8e77-6049ca73911b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:15.994024 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 832/1661] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:16.040064 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028691ea-02b0-4cff-9fd4-741c63beac2e None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:16.041518 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-028691ea-02b0-4cff-9fd4-741c63beac2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:16.112441 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad8fc9-0917-41bf-8e77-6049ca73911b None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:16.185981 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0889b92-d82e-4313-8686-62dd2464a784 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:16.187242 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0889b92-d82e-4313-8686-62dd2464a784 service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:16.187739 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0889b92-d82e-4313-8686-62dd2464a784 service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:16.188437 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0889b92-d82e-4313-8686-62dd2464a784 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:16.202161 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0889b92-d82e-4313-8686-62dd2464a784 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:16.203348 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028691ea-02b0-4cff-9fd4-741c63beac2e None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:16.209311 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0889b92-d82e-4313-8686-62dd2464a784 service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:16.223104 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2375a6-e04d-460e-823c-49c5bf5ba9b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:16.223811 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2375a6-e04d-460e-823c-49c5bf5ba9b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:16.224111 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2375a6-e04d-460e-823c-49c5bf5ba9b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:16.224405 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2375a6-e04d-460e-823c-49c5bf5ba9b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:16.240210 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2375a6-e04d-460e-823c-49c5bf5ba9b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:16.241681 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2375a6-e04d-460e-823c-49c5bf5ba9b2 service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:16.243009 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 830/1662] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:25:16.271298 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 833/1663] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:17.863746 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0889b92-d82e-4313-8686-62dd2464a784 service neutron] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:17.865317 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-c0889b92-d82e-4313-8686-62dd2464a784 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:17.893504 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0889b92-d82e-4313-8686-62dd2464a784 service neutron] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:17.908599 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69201794-17dc-4fbf-9bae-86bee9e140de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:17.910043 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69201794-17dc-4fbf-9bae-86bee9e140de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:17.911420 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69201794-17dc-4fbf-9bae-86bee9e140de admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:17.914255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69201794-17dc-4fbf-9bae-86bee9e140de admin admin] PATH_INFO: `/v3/projects/e99096f087154c9b84c0ecdd3785bab2` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:17.916687 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69201794-17dc-4fbf-9bae-86bee9e140de admin admin] RBAC: Authorizing `identity:delete_project(project_id=e99096f087154c9b84c0ecdd3785bab2)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:17.921291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69201794-17dc-4fbf-9bae-86bee9e140de admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:18.105637 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:18.128769 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-69201794-17dc-4fbf-9bae-86bee9e140de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e99096f087154c9b84c0ecdd3785bab2', 'request_id': 'req-69201794-17dc-4fbf-9bae-86bee9e140de'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:18.146924 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-69201794-17dc-4fbf-9bae-86bee9e140de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e99096f087154c9b84c0ecdd3785bab2', 'request_id': 'req-69201794-17dc-4fbf-9bae-86bee9e140de'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:18.161858 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-69201794-17dc-4fbf-9bae-86bee9e140de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e99096f087154c9b84c0ecdd3785bab2', 'request_id': 'req-69201794-17dc-4fbf-9bae-86bee9e140de'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:18.276928 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-69201794-17dc-4fbf-9bae-86bee9e140de admin admin] The token cache is being invalidate because project e99096f087154c9b84c0ecdd3785bab2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:25:18.284546 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-69201794-17dc-4fbf-9bae-86bee9e140de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:18.284546 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-69201794-17dc-4fbf-9bae-86bee9e140de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:18.284546 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 831/1664] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:25:17 2022] DELETE /identity/v3/projects/e99096f087154c9b84c0ecdd3785bab2 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:18.285983 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74ef45-2ccb-425b-b6f8-9d03c38ee8a4 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:18.286436 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74ef45-2ccb-425b-b6f8-9d03c38ee8a4 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:18.286538 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74ef45-2ccb-425b-b6f8-9d03c38ee8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:18.320155 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-cd74ef45-2ccb-425b-b6f8-9d03c38ee8a4 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:18.321403 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-cd74ef45-2ccb-425b-b6f8-9d03c38ee8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:18.481850 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 834/1665] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:18.493078 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a5468-0a78-4a0e-8538-065b04fe5e5e None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:18.493614 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a5468-0a78-4a0e-8538-065b04fe5e5e None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:18.494097 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a5468-0a78-4a0e-8538-065b04fe5e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:18.555645 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-851a5468-0a78-4a0e-8538-065b04fe5e5e None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:18.556913 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-851a5468-0a78-4a0e-8538-065b04fe5e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:18.583149 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 832/1666] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:18.585327 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74ef45-2ccb-425b-b6f8-9d03c38ee8a4 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:18.590172 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:18.603119 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74ef45-2ccb-425b-b6f8-9d03c38ee8a4 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:18.618499 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6f10b-2b18-4937-9787-d39a6507a181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:18.619118 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6f10b-2b18-4937-9787-d39a6507a181 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:18.624923 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6f10b-2b18-4937-9787-d39a6507a181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:18.624923 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6f10b-2b18-4937-9787-d39a6507a181 admin admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:18.624923 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c6f10b-2b18-4937-9787-d39a6507a181 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:25:18.624923 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c6f10b-2b18-4937-9787-d39a6507a181 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:18.624923 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c6f10b-2b18-4937-9787-d39a6507a181 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:18.656738 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 835/1667] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:25:18.661687 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a5468-0a78-4a0e-8538-065b04fe5e5e None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:18.673821 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a5468-0a78-4a0e-8538-065b04fe5e5e None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:18.686549 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5414e1-f4fc-4077-9c50-c2228595d608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:18.687299 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5414e1-f4fc-4077-9c50-c2228595d608 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:18.687507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5414e1-f4fc-4077-9c50-c2228595d608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:18.687769 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5414e1-f4fc-4077-9c50-c2228595d608 admin admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:18.688940 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5414e1-f4fc-4077-9c50-c2228595d608 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:18.690904 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5414e1-f4fc-4077-9c50-c2228595d608 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:18.817342 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 833/1668] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:25:18 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:25:18.821917 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6f10b-2b18-4937-9787-d39a6507a181 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:18.839071 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6f10b-2b18-4937-9787-d39a6507a181 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:19.081566 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e62c8-8f53-45b3-87d1-8c9501973a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:19.082224 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e62c8-8f53-45b3-87d1-8c9501973a3c admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:19.082512 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e62c8-8f53-45b3-87d1-8c9501973a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:19.082790 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e62c8-8f53-45b3-87d1-8c9501973a3c admin admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:19.084766 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e62c8-8f53-45b3-87d1-8c9501973a3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:19.093493 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e62c8-8f53-45b3-87d1-8c9501973a3c admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:19.366895 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 836/1669] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:25:18 2022] POST /identity/v3/users => generated 293 bytes in 545 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:25:19.371482 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5414e1-f4fc-4077-9c50-c2228595d608 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:19.382554 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5414e1-f4fc-4077-9c50-c2228595d608 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:19.391316 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f38a3-7cb9-4e2f-88e6-f40f3a6ce4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:19.392035 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f38a3-7cb9-4e2f-88e6-f40f3a6ce4f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:19.392315 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f38a3-7cb9-4e2f-88e6-f40f3a6ce4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:19.392604 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f38a3-7cb9-4e2f-88e6-f40f3a6ce4f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:19.393279 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f38a3-7cb9-4e2f-88e6-f40f3a6ce4f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:19.396412 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f38a3-7cb9-4e2f-88e6-f40f3a6ce4f2 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:19.419301 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e62c8-8f53-45b3-87d1-8c9501973a3c admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:19.432110 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 834/1670] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:25:19.433566 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f197c34-8838-4534-ad69-3a42b02c51e7 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:19.433871 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f197c34-8838-4534-ad69-3a42b02c51e7 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:19.478731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e62c8-8f53-45b3-87d1-8c9501973a3c admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:19.481790 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f197c34-8838-4534-ad69-3a42b02c51e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:19.496464 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f3965-42a5-47fa-8898-4d194bc1464a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:19.497107 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f3965-42a5-47fa-8898-4d194bc1464a admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:19.497388 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f3965-42a5-47fa-8898-4d194bc1464a admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:19.498807 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f3965-42a5-47fa-8898-4d194bc1464a admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:19.499485 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f3965-42a5-47fa-8898-4d194bc1464a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:19.518652 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f3965-42a5-47fa-8898-4d194bc1464a admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:19.592354 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 837/1671] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:25:19.601247 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f3965-42a5-47fa-8898-4d194bc1464a admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:19.647835 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f3965-42a5-47fa-8898-4d194bc1464a admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:19.650657 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-2f197c34-8838-4534-ad69-3a42b02c51e7 None None] MFA Rules not processed for user `bf2422e88cc94ef9b19f24f5d8e7d56c`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:19.652091 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-2f197c34-8838-4534-ad69-3a42b02c51e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:19.661305 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c64d8-96fb-4a2c-b27e-fee86055d5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:19.661729 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c64d8-96fb-4a2c-b27e-fee86055d5ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:19.662015 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c64d8-96fb-4a2c-b27e-fee86055d5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:19.662294 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c64d8-96fb-4a2c-b27e-fee86055d5ab admin admin] PATH_INFO: `/v3/projects/833de0ee0a014aad8b6af062da7050f8/users/d77d8a19ba324be9a782df0eb96add15/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:19.743721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c64d8-96fb-4a2c-b27e-fee86055d5ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=833de0ee0a014aad8b6af062da7050f8, user_id=d77d8a19ba324be9a782df0eb96add15, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:19.752690 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c64d8-96fb-4a2c-b27e-fee86055d5ab admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:19.786854 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 835/1672] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:19.808377 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f197c34-8838-4534-ad69-3a42b02c51e7 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:19.809496 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-2f197c34-8838-4534-ad69-3a42b02c51e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:19.856038 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 838/1673] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:25:19 2022] PUT /identity/v3/projects/833de0ee0a014aad8b6af062da7050f8/users/d77d8a19ba324be9a782df0eb96add15/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:19.867678 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9d94c-2144-4613-8c9b-84c9daf84a79 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:19.868064 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9d94c-2144-4613-8c9b-84c9daf84a79 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:19.868416 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9d94c-2144-4613-8c9b-84c9daf84a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:19.936806 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-79b9d94c-2144-4613-8c9b-84c9daf84a79 None None] MFA Rules not processed for user `d77d8a19ba324be9a782df0eb96add15`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:19.941864 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-79b9d94c-2144-4613-8c9b-84c9daf84a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:20.072144 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f197c34-8838-4534-ad69-3a42b02c51e7 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:20.173312 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 839/1674] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:20.178961 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9d94c-2144-4613-8c9b-84c9daf84a79 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:20.301894 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadea2bf-da16-4920-afa7-26285c38e01c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:20.303118 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadea2bf-da16-4920-afa7-26285c38e01c service nova] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:20.303890 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadea2bf-da16-4920-afa7-26285c38e01c service nova] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:20.305794 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadea2bf-da16-4920-afa7-26285c38e01c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:20.353660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9d94c-2144-4613-8c9b-84c9daf84a79 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:20.377401 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8550a207-6a78-4091-9d28-5f561102a1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:20.378230 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550a207-6a78-4091-9d28-5f561102a1a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:20.379060 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550a207-6a78-4091-9d28-5f561102a1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:20.381757 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550a207-6a78-4091-9d28-5f561102a1a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:20.383074 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8550a207-6a78-4091-9d28-5f561102a1a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:20.397640 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8550a207-6a78-4091-9d28-5f561102a1a6 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:20.515779 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadea2bf-da16-4920-afa7-26285c38e01c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:20.518317 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadea2bf-da16-4920-afa7-26285c38e01c service nova] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:20.552778 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 840/1675] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:25:20 2022] POST /identity/v3/projects => generated 385 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:25:20.555174 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8550a207-6a78-4091-9d28-5f561102a1a6 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:20.559471 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 836/1676] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 752 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:25:20.786222 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8550a207-6a78-4091-9d28-5f561102a1a6 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:20.800393 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fba906-abba-41ca-9a3b-41e9d9489fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:20.806003 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fba906-abba-41ca-9a3b-41e9d9489fdd admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:20.806003 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fba906-abba-41ca-9a3b-41e9d9489fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:20.806003 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fba906-abba-41ca-9a3b-41e9d9489fdd admin admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:20.806003 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fba906-abba-41ca-9a3b-41e9d9489fdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:20.816599 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fba906-abba-41ca-9a3b-41e9d9489fdd admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:20.994250 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadea2bf-da16-4920-afa7-26285c38e01c service nova] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:21.008459 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 841/1677] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:25:20 2022] POST /identity/v3/users => generated 299 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:25:21.018538 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadea2bf-da16-4920-afa7-26285c38e01c service nova] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:21.035170 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efccf534-90db-468f-b614-57b209e11a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:21.047172 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccf534-90db-468f-b614-57b209e11a12 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:21.047172 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccf534-90db-468f-b614-57b209e11a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:21.047172 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccf534-90db-468f-b614-57b209e11a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:21.047172 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efccf534-90db-468f-b614-57b209e11a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:21.047172 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efccf534-90db-468f-b614-57b209e11a12 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:21.084636 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fba906-abba-41ca-9a3b-41e9d9489fdd admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:21.099809 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 837/1678] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:25:21.103058 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fba906-abba-41ca-9a3b-41e9d9489fdd admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:21.117815 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968b44b-681b-42d8-abdf-83c7fb188049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:21.119254 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968b44b-681b-42d8-abdf-83c7fb188049 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:21.119632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968b44b-681b-42d8-abdf-83c7fb188049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:21.119975 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968b44b-681b-42d8-abdf-83c7fb188049 admin admin] PATH_INFO: `/v3/projects/e7528f4797c042c5bfa855b1221f78ca/users/3b52a1f5a08246f5845588a3bd2789ca/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:21.171852 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f968b44b-681b-42d8-abdf-83c7fb188049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7528f4797c042c5bfa855b1221f78ca, user_id=3b52a1f5a08246f5845588a3bd2789ca, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:21.174885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f968b44b-681b-42d8-abdf-83c7fb188049 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:21.319305 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 842/1679] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:25:21 2022] PUT /identity/v3/projects/e7528f4797c042c5bfa855b1221f78ca/users/3b52a1f5a08246f5845588a3bd2789ca/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:21.325676 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efccf534-90db-468f-b614-57b209e11a12 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:21.338884 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efccf534-90db-468f-b614-57b209e11a12 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:21.440752 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3df6f3-315f-4f7e-acfb-056d8f5b0209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:21.441704 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3df6f3-315f-4f7e-acfb-056d8f5b0209 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:21.442097 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3df6f3-315f-4f7e-acfb-056d8f5b0209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:21.442475 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3df6f3-315f-4f7e-acfb-056d8f5b0209 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:21.443345 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3df6f3-315f-4f7e-acfb-056d8f5b0209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:21.445221 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3df6f3-315f-4f7e-acfb-056d8f5b0209 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:21.462629 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968b44b-681b-42d8-abdf-83c7fb188049 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:21.471200 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 838/1680] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:25:21.475426 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968b44b-681b-42d8-abdf-83c7fb188049 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:21.483177 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5ab91-97a8-418a-a083-7b4d2c7a7601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:21.493822 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5ab91-97a8-418a-a083-7b4d2c7a7601 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:21.493822 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5ab91-97a8-418a-a083-7b4d2c7a7601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:21.493822 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5ab91-97a8-418a-a083-7b4d2c7a7601 admin admin] PATH_INFO: `/v3/projects/e7528f4797c042c5bfa855b1221f78ca/users/3b52a1f5a08246f5845588a3bd2789ca/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:21.493822 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5ab91-97a8-418a-a083-7b4d2c7a7601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7528f4797c042c5bfa855b1221f78ca, user_id=3b52a1f5a08246f5845588a3bd2789ca, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:21.493822 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5ab91-97a8-418a-a083-7b4d2c7a7601 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:21.511105 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 843/1681] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:25:21 2022] PUT /identity/v3/projects/e7528f4797c042c5bfa855b1221f78ca/users/3b52a1f5a08246f5845588a3bd2789ca/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:21.524190 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e05813-e05f-486c-b030-538072b60e80 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:21.524644 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e05813-e05f-486c-b030-538072b60e80 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:21.524846 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e05813-e05f-486c-b030-538072b60e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:21.592293 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-f8e05813-e05f-486c-b030-538072b60e80 None None] MFA Rules not processed for user `3b52a1f5a08246f5845588a3bd2789ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:21.593539 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-f8e05813-e05f-486c-b030-538072b60e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:21.642471 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:21.715875 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 839/1682] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:21 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:21.731178 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5ab91-97a8-418a-a083-7b4d2c7a7601 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:21.733275 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-c4a5ab91-97a8-418a-a083-7b4d2c7a7601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:21.842835 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5ab91-97a8-418a-a083-7b4d2c7a7601 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:21.854657 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b1471-c26a-4c5e-8fab-574ebe8ec876 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:21.855300 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b1471-c26a-4c5e-8fab-574ebe8ec876 service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:21.855794 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b1471-c26a-4c5e-8fab-574ebe8ec876 service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:21.856079 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b1471-c26a-4c5e-8fab-574ebe8ec876 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:21.875334 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b1471-c26a-4c5e-8fab-574ebe8ec876 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:21.877269 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b1471-c26a-4c5e-8fab-574ebe8ec876 service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:21.911046 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 844/1683] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:21 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:21.918131 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:21.990115 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e05813-e05f-486c-b030-538072b60e80 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:22.156917 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e05813-e05f-486c-b030-538072b60e80 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:22.164262 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb329e2-5e3b-4f46-b10f-eb3d4ec8df67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:22.164995 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb329e2-5e3b-4f46-b10f-eb3d4ec8df67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:22.167034 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb329e2-5e3b-4f46-b10f-eb3d4ec8df67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:22.167034 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb329e2-5e3b-4f46-b10f-eb3d4ec8df67 admin admin] PATH_INFO: `/v3/users/d77d8a19ba324be9a782df0eb96add15` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:22.167034 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb329e2-5e3b-4f46-b10f-eb3d4ec8df67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d77d8a19ba324be9a782df0eb96add15)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:22.169139 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb329e2-5e3b-4f46-b10f-eb3d4ec8df67 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:22.423113 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-0bb329e2-5e3b-4f46-b10f-eb3d4ec8df67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd77d8a19ba324be9a782df0eb96add15'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:22.612443 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60726b1-413c-4873-9bc0-7402153b0e53 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:22.612443 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60726b1-413c-4873-9bc0-7402153b0e53 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:22.612951 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-0bb329e2-5e3b-4f46-b10f-eb3d4ec8df67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd77d8a19ba324be9a782df0eb96add15'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:22.613307 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60726b1-413c-4873-9bc0-7402153b0e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:22.613392 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-0bb329e2-5e3b-4f46-b10f-eb3d4ec8df67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd77d8a19ba324be9a782df0eb96add15'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:22.613392 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-0bb329e2-5e3b-4f46-b10f-eb3d4ec8df67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd77d8a19ba324be9a782df0eb96add15'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:22.654484 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-0bb329e2-5e3b-4f46-b10f-eb3d4ec8df67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd77d8a19ba324be9a782df0eb96add15'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:22.703781 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 840/1684] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:25:21 2022] DELETE /identity/v3/users/d77d8a19ba324be9a782df0eb96add15 => generated 0 bytes in 714 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:22.707160 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-b60726b1-413c-4873-9bc0-7402153b0e53 None None] MFA Rules not processed for user `6c16e5594e59435cb1a5cba601744b81`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:22.710370 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8acb62-72e5-4935-bc6f-44be21904f9f None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:22.710678 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8acb62-72e5-4935-bc6f-44be21904f9f None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:22.711600 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8acb62-72e5-4935-bc6f-44be21904f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:22.714251 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-b60726b1-413c-4873-9bc0-7402153b0e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:22.793605 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-bd8acb62-72e5-4935-bc6f-44be21904f9f None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:22.796276 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-bd8acb62-72e5-4935-bc6f-44be21904f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:22.959891 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 845/1685] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:22 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:25:22.965009 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60726b1-413c-4873-9bc0-7402153b0e53 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:22.966933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-b60726b1-413c-4873-9bc0-7402153b0e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:23.019570 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 841/1686] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:23.036317 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60726b1-413c-4873-9bc0-7402153b0e53 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:23.041715 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8acb62-72e5-4935-bc6f-44be21904f9f None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:23.044185 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-bd8acb62-72e5-4935-bc6f-44be21904f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:23.044334 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d21d68-91b3-430b-bf96-68e439746408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:23.045158 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d21d68-91b3-430b-bf96-68e439746408 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:23.045609 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d21d68-91b3-430b-bf96-68e439746408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:23.046033 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d21d68-91b3-430b-bf96-68e439746408 admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:23.046869 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d21d68-91b3-430b-bf96-68e439746408 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:23.050619 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d21d68-91b3-430b-bf96-68e439746408 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:23.169144 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8acb62-72e5-4935-bc6f-44be21904f9f None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:23.179117 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572a856-2382-4e9b-93e6-93ae24278f59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:23.180534 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572a856-2382-4e9b-93e6-93ae24278f59 service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:23.180896 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572a856-2382-4e9b-93e6-93ae24278f59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:23.181260 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572a856-2382-4e9b-93e6-93ae24278f59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:23.199260 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 846/1687] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:25:22 2022] POST /identity/v3/projects => generated 405 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:25:23.200600 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b572a856-2382-4e9b-93e6-93ae24278f59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:23.202068 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b572a856-2382-4e9b-93e6-93ae24278f59 service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:23.203566 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d21d68-91b3-430b-bf96-68e439746408 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:23.214419 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 842/1688] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:23.383942 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d21d68-91b3-430b-bf96-68e439746408 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:23.411778 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020baac-7c83-4a70-9a44-33e7dbddd7d0 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:23.412082 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020baac-7c83-4a70-9a44-33e7dbddd7d0 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:23.412362 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020baac-7c83-4a70-9a44-33e7dbddd7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:23.424112 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b5fa4-9665-4d38-aeda-2c4c3e3c8f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:23.426908 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b5fa4-9665-4d38-aeda-2c4c3e3c8f3b admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:23.427401 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b5fa4-9665-4d38-aeda-2c4c3e3c8f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:23.427863 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b5fa4-9665-4d38-aeda-2c4c3e3c8f3b admin admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:23.429658 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b5fa4-9665-4d38-aeda-2c4c3e3c8f3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:23.433978 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b5fa4-9665-4d38-aeda-2c4c3e3c8f3b admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:23.481927 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-4020baac-7c83-4a70-9a44-33e7dbddd7d0 None None] MFA Rules not processed for user `014a5ebd029d43d194722af661e4675b`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:23.483187 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-4020baac-7c83-4a70-9a44-33e7dbddd7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:23.599675 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 847/1689] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:25:23 2022] POST /identity/v3/users => generated 309 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:25:23.603106 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b5fa4-9665-4d38-aeda-2c4c3e3c8f3b admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:23.622745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b5fa4-9665-4d38-aeda-2c4c3e3c8f3b admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:23.637318 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 843/1690] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:23 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:23.639753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d82f03-e7bf-4778-8c41-86ab25fa483c None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:23.639753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d82f03-e7bf-4778-8c41-86ab25fa483c None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:23.639753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d82f03-e7bf-4778-8c41-86ab25fa483c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:23.662519 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9f4bf-3341-4533-9045-4e6eeb94e5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:23.667556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9f4bf-3341-4533-9045-4e6eeb94e5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:23.668110 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9f4bf-3341-4533-9045-4e6eeb94e5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:23.668532 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9f4bf-3341-4533-9045-4e6eeb94e5d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:23.669919 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9f4bf-3341-4533-9045-4e6eeb94e5d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:23.671895 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9f4bf-3341-4533-9045-4e6eeb94e5d5 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:23.692740 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 848/1691] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:25:23.700357 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9f4bf-3341-4533-9045-4e6eeb94e5d5 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:23.714902 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-25d82f03-e7bf-4778-8c41-86ab25fa483c None None] MFA Rules not processed for user `014a5ebd029d43d194722af661e4675b`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:23.724363 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9f4bf-3341-4533-9045-4e6eeb94e5d5 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:23.724775 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-25d82f03-e7bf-4778-8c41-86ab25fa483c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:23.781369 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386d50c-9cfd-48a9-b875-ac2d6156d865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:23.781369 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386d50c-9cfd-48a9-b875-ac2d6156d865 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:23.781369 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386d50c-9cfd-48a9-b875-ac2d6156d865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:23.781369 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386d50c-9cfd-48a9-b875-ac2d6156d865 admin admin] PATH_INFO: `/v3/projects/0133589ae2384ebe97d9033c51b685fa/users/51b29010970f470589b118efdb2d4a12/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:23.781692 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 844/1692] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:23 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:23.789389 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d82f03-e7bf-4778-8c41-86ab25fa483c None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:23.791586 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-25d82f03-e7bf-4778-8c41-86ab25fa483c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:23.826396 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386d50c-9cfd-48a9-b875-ac2d6156d865 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0133589ae2384ebe97d9033c51b685fa, user_id=51b29010970f470589b118efdb2d4a12, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:23.830294 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386d50c-9cfd-48a9-b875-ac2d6156d865 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:23.872101 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:23.997642 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 849/1693] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:25:23 2022] PUT /identity/v3/projects/0133589ae2384ebe97d9033c51b685fa/users/51b29010970f470589b118efdb2d4a12/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:25:24.012699 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d82f03-e7bf-4778-8c41-86ab25fa483c None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:24.012915 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386d50c-9cfd-48a9-b875-ac2d6156d865 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:24.274530 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a6d11-b7a6-4a93-90fc-db7a9823675d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:24.280533 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a6d11-b7a6-4a93-90fc-db7a9823675d service nova] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:24.280533 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a6d11-b7a6-4a93-90fc-db7a9823675d service nova] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:24.280533 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a6d11-b7a6-4a93-90fc-db7a9823675d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:24.280875 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386d50c-9cfd-48a9-b875-ac2d6156d865 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:24.294871 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454b129-1fc7-4ca5-b2b1-6484958cac96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:24.302771 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454b129-1fc7-4ca5-b2b1-6484958cac96 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:24.304784 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454b129-1fc7-4ca5-b2b1-6484958cac96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:24.306288 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454b129-1fc7-4ca5-b2b1-6484958cac96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:24.315780 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454b129-1fc7-4ca5-b2b1-6484958cac96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:24.326453 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454b129-1fc7-4ca5-b2b1-6484958cac96 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:24.363457 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 850/1694] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:25:24.364726 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454b129-1fc7-4ca5-b2b1-6484958cac96 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:24.369618 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-7454b129-1fc7-4ca5-b2b1-6484958cac96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:24.424216 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454b129-1fc7-4ca5-b2b1-6484958cac96 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:24.449073 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41950a9-0cc9-4d5f-86e5-da28592fa7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:24.449911 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41950a9-0cc9-4d5f-86e5-da28592fa7c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:24.450195 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41950a9-0cc9-4d5f-86e5-da28592fa7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:24.450474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41950a9-0cc9-4d5f-86e5-da28592fa7c5 admin admin] PATH_INFO: `/v3/projects/833de0ee0a014aad8b6af062da7050f8` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:24.456507 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41950a9-0cc9-4d5f-86e5-da28592fa7c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=833de0ee0a014aad8b6af062da7050f8)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:24.465503 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41950a9-0cc9-4d5f-86e5-da28592fa7c5 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:24.496536 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a6d11-b7a6-4a93-90fc-db7a9823675d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:24.501657 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a6d11-b7a6-4a93-90fc-db7a9823675d service nova] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:24.526114 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 845/1695] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:23 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 737 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:25:24.527252 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a6d11-b7a6-4a93-90fc-db7a9823675d service nova] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:24.550817 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a6d11-b7a6-4a93-90fc-db7a9823675d service nova] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:24.565200 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36265d2-1a4c-4b22-b9c5-4d320d59376b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:24.566176 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36265d2-1a4c-4b22-b9c5-4d320d59376b admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:24.566613 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36265d2-1a4c-4b22-b9c5-4d320d59376b admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:24.567135 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36265d2-1a4c-4b22-b9c5-4d320d59376b admin admin] PATH_INFO: `/v3/projects/0133589ae2384ebe97d9033c51b685fa/users/51b29010970f470589b118efdb2d4a12/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:24.572728 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36265d2-1a4c-4b22-b9c5-4d320d59376b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0133589ae2384ebe97d9033c51b685fa, user_id=51b29010970f470589b118efdb2d4a12, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:24.577754 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36265d2-1a4c-4b22-b9c5-4d320d59376b admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:24.605510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 846/1696] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:25:24 2022] PUT /identity/v3/projects/0133589ae2384ebe97d9033c51b685fa/users/51b29010970f470589b118efdb2d4a12/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:24.653217 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:24.697371 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-d41950a9-0cc9-4d5f-86e5-da28592fa7c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '833de0ee0a014aad8b6af062da7050f8', 'request_id': 'req-d41950a9-0cc9-4d5f-86e5-da28592fa7c5'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:24.717715 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-d41950a9-0cc9-4d5f-86e5-da28592fa7c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '833de0ee0a014aad8b6af062da7050f8', 'request_id': 'req-d41950a9-0cc9-4d5f-86e5-da28592fa7c5'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:24.739570 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-d41950a9-0cc9-4d5f-86e5-da28592fa7c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '833de0ee0a014aad8b6af062da7050f8', 'request_id': 'req-d41950a9-0cc9-4d5f-86e5-da28592fa7c5'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:24.857043 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-d41950a9-0cc9-4d5f-86e5-da28592fa7c5 admin admin] The token cache is being invalidate because project 833de0ee0a014aad8b6af062da7050f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:25:24.857418 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-d41950a9-0cc9-4d5f-86e5-da28592fa7c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:24.858409 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-d41950a9-0cc9-4d5f-86e5-da28592fa7c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:24.861290 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 851/1697] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:25:24 2022] DELETE /identity/v3/projects/833de0ee0a014aad8b6af062da7050f8 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:24.865236 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36265d2-1a4c-4b22-b9c5-4d320d59376b admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:24.867108 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-f36265d2-1a4c-4b22-b9c5-4d320d59376b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:25.051146 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36265d2-1a4c-4b22-b9c5-4d320d59376b admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:25.152055 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04e497-79e7-4fbd-917a-469e747153ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:25.152859 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04e497-79e7-4fbd-917a-469e747153ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:25.153211 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04e497-79e7-4fbd-917a-469e747153ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:25.153648 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04e497-79e7-4fbd-917a-469e747153ce admin admin] PATH_INFO: `/v3/users/3b52a1f5a08246f5845588a3bd2789ca` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:25.155991 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d04e497-79e7-4fbd-917a-469e747153ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b52a1f5a08246f5845588a3bd2789ca)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:25.160352 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d04e497-79e7-4fbd-917a-469e747153ce admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:25.233941 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa263f6-c9e6-43a8-8221-b9b0e7b877a0 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:25.234267 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa263f6-c9e6-43a8-8221-b9b0e7b877a0 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:25.234650 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa263f6-c9e6-43a8-8221-b9b0e7b877a0 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:25.236764 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 852/1698] 10.222.0.23 () {54 vars in 912 bytes} [Mon Aug 8 02:25:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:25:25.242531 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a04d1-b635-4d69-8d8e-f237f24b7a6e None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:25.243259 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a04d1-b635-4d69-8d8e-f237f24b7a6e None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:25.243259 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a04d1-b635-4d69-8d8e-f237f24b7a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:25.350871 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-c09a04d1-b635-4d69-8d8e-f237f24b7a6e None None] MFA Rules not processed for user `fa4c5732acb844369140e8d970577f94`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:25.352169 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-c09a04d1-b635-4d69-8d8e-f237f24b7a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:25.502845 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 853/1699] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 8 02:25:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:25.516306 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-3d04e497-79e7-4fbd-917a-469e747153ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b52a1f5a08246f5845588a3bd2789ca'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:25.532124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a04d1-b635-4d69-8d8e-f237f24b7a6e None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:25.533931 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-c09a04d1-b635-4d69-8d8e-f237f24b7a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:25.551500 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a04d1-b635-4d69-8d8e-f237f24b7a6e None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:25.559115 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fa352-fbdd-427d-8f3f-1c1753c5d7a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:25.559890 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fa352-fbdd-427d-8f3f-1c1753c5d7a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:25.560244 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fa352-fbdd-427d-8f3f-1c1753c5d7a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:25.560591 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fa352-fbdd-427d-8f3f-1c1753c5d7a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:25.577009 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58fa352-fbdd-427d-8f3f-1c1753c5d7a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:25.580735 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58fa352-fbdd-427d-8f3f-1c1753c5d7a5 service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:25.607286 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 854/1700] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:25:25.630817 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-3d04e497-79e7-4fbd-917a-469e747153ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b52a1f5a08246f5845588a3bd2789ca'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:25.634415 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-3d04e497-79e7-4fbd-917a-469e747153ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b52a1f5a08246f5845588a3bd2789ca'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:25.643313 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-3d04e497-79e7-4fbd-917a-469e747153ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b52a1f5a08246f5845588a3bd2789ca'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:25.667650 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:25.687423 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b767c-d3cd-4f8f-afb2-dfd68271918d None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:25.687817 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b767c-d3cd-4f8f-afb2-dfd68271918d None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:25.688154 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b767c-d3cd-4f8f-afb2-dfd68271918d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:25.727499 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-3d04e497-79e7-4fbd-917a-469e747153ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b52a1f5a08246f5845588a3bd2789ca'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:25.783136 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 847/1701] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:25:24 2022] DELETE /identity/v3/users/3b52a1f5a08246f5845588a3bd2789ca => generated 0 bytes in 917 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:25.830082 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-853b767c-d3cd-4f8f-afb2-dfd68271918d None None] MFA Rules not processed for user `2825bb31d1de466d80fcfd3e66bd7fae`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:25.833383 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-853b767c-d3cd-4f8f-afb2-dfd68271918d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:26.044215 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 855/1702] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:26.051382 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0838d-b873-4f8b-bfa8-7e98315edfa5 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:26.052004 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0838d-b873-4f8b-bfa8-7e98315edfa5 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:26.052293 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0838d-b873-4f8b-bfa8-7e98315edfa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:26.101269 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:26.118766 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-f7e0838d-b873-4f8b-bfa8-7e98315edfa5 None None] MFA Rules not processed for user `2825bb31d1de466d80fcfd3e66bd7fae`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:26.120076 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-f7e0838d-b873-4f8b-bfa8-7e98315edfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:26.137465 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 848/1703] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:26.146070 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b767c-d3cd-4f8f-afb2-dfd68271918d None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:26.147595 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-853b767c-d3cd-4f8f-afb2-dfd68271918d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:26.340271 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b767c-d3cd-4f8f-afb2-dfd68271918d None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:26.363643 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7246160-97d9-41a6-8f8d-773e165bef44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:26.364289 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7246160-97d9-41a6-8f8d-773e165bef44 service nova] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:26.364573 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7246160-97d9-41a6-8f8d-773e165bef44 service nova] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:26.365116 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7246160-97d9-41a6-8f8d-773e165bef44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:26.382921 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7246160-97d9-41a6-8f8d-773e165bef44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:26.389781 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7246160-97d9-41a6-8f8d-773e165bef44 service nova] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:26.407655 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 856/1704] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:26 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:27.049982 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c5f73-6db4-4b2c-aa56-90bb73815cca None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:27.050832 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c5f73-6db4-4b2c-aa56-90bb73815cca None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:27.051326 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c5f73-6db4-4b2c-aa56-90bb73815cca None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:27.053228 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 849/1705] 10.222.0.23 () {54 vars in 961 bytes} [Mon Aug 8 02:25:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:25:27.070271 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7c36d-68ab-427b-a1ce-ae7fbeea55ec None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:27.070771 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7c36d-68ab-427b-a1ce-ae7fbeea55ec None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:27.070869 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7c36d-68ab-427b-a1ce-ae7fbeea55ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:27.082710 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c036db-7701-428c-bdaf-018e5a040534 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:27.083272 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c036db-7701-428c-bdaf-018e5a040534 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:27.083973 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c036db-7701-428c-bdaf-018e5a040534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:27.111153 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-a8c7c36d-68ab-427b-a1ce-ae7fbeea55ec None None] MFA Rules not processed for user `43a39dd539974180a8165e34de57b552`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:27.131393 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-a8c7c36d-68ab-427b-a1ce-ae7fbeea55ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:27.162079 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-a1c036db-7701-428c-bdaf-018e5a040534 None None] MFA Rules not processed for user `014a5ebd029d43d194722af661e4675b`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:27.164805 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-a1c036db-7701-428c-bdaf-018e5a040534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:27.220194 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 857/1706] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Aug 8 02:25:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:27.221798 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96dc064-9646-4075-bb68-f82e955c452f None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:27.222229 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96dc064-9646-4075-bb68-f82e955c452f None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:27.222665 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96dc064-9646-4075-bb68-f82e955c452f None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:27.224136 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 858/1707] 10.222.0.23 () {54 vars in 912 bytes} [Mon Aug 8 02:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:25:27.227919 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96dc064-9646-4075-bb68-f82e955c452f None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:27.243464 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96dc064-9646-4075-bb68-f82e955c452f None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:27.249370 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8641ba5-bed5-41e0-985c-a79b7d771d3f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43a39dd539974180a8165e34de57b552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:27.250212 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8641ba5-bed5-41e0-985c-a79b7d771d3f service placement] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:27.250647 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8641ba5-bed5-41e0-985c-a79b7d771d3f service placement] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:27.251126 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8641ba5-bed5-41e0-985c-a79b7d771d3f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:27.253179 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-f8641ba5-bed5-41e0-985c-a79b7d771d3f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:27.270100 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8641ba5-bed5-41e0-985c-a79b7d771d3f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:27.272023 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8641ba5-bed5-41e0-985c-a79b7d771d3f service placement] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:27.287812 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 859/1708] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:27.290944 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35242b8-49ef-49f1-9d1c-7b36f3fa6e6a None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:27.291798 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35242b8-49ef-49f1-9d1c-7b36f3fa6e6a None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:27.292271 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35242b8-49ef-49f1-9d1c-7b36f3fa6e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:27.334171 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-a35242b8-49ef-49f1-9d1c-7b36f3fa6e6a None None] MFA Rules not processed for user `fa4c5732acb844369140e8d970577f94`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:27.336213 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-a35242b8-49ef-49f1-9d1c-7b36f3fa6e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:27.400017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 850/1709] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:27.477299 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 860/1710] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 8 02:25:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:27.544259 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c036db-7701-428c-bdaf-018e5a040534 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:27.546036 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-a1c036db-7701-428c-bdaf-018e5a040534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:27.570364 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c036db-7701-428c-bdaf-018e5a040534 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:27.574881 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b225e20-4dd8-4c12-a0de-b4ac73bda32a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:27.576858 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b225e20-4dd8-4c12-a0de-b4ac73bda32a service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:27.577224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b225e20-4dd8-4c12-a0de-b4ac73bda32a service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:27.588349 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b225e20-4dd8-4c12-a0de-b4ac73bda32a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:27.598614 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b225e20-4dd8-4c12-a0de-b4ac73bda32a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:27.600762 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b225e20-4dd8-4c12-a0de-b4ac73bda32a service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:27.616086 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 851/1711] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:27.854088 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35242b8-49ef-49f1-9d1c-7b36f3fa6e6a None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:27.859209 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-a35242b8-49ef-49f1-9d1c-7b36f3fa6e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:28.042474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35242b8-49ef-49f1-9d1c-7b36f3fa6e6a None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:28.064510 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a494700-a215-4f3e-a986-3c765605d91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:28.065701 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a494700-a215-4f3e-a986-3c765605d91f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:28.066230 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a494700-a215-4f3e-a986-3c765605d91f admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:28.066601 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a494700-a215-4f3e-a986-3c765605d91f admin admin] PATH_INFO: `/v3/projects/e7528f4797c042c5bfa855b1221f78ca` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:28.067972 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a494700-a215-4f3e-a986-3c765605d91f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7528f4797c042c5bfa855b1221f78ca)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:28.070277 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a494700-a215-4f3e-a986-3c765605d91f admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:28.293031 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-1a494700-a215-4f3e-a986-3c765605d91f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7528f4797c042c5bfa855b1221f78ca', 'request_id': 'req-1a494700-a215-4f3e-a986-3c765605d91f'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:28.308360 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:28.309322 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-1a494700-a215-4f3e-a986-3c765605d91f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7528f4797c042c5bfa855b1221f78ca', 'request_id': 'req-1a494700-a215-4f3e-a986-3c765605d91f'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:28.325375 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-1a494700-a215-4f3e-a986-3c765605d91f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7528f4797c042c5bfa855b1221f78ca', 'request_id': 'req-1a494700-a215-4f3e-a986-3c765605d91f'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:28.503555 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-1a494700-a215-4f3e-a986-3c765605d91f admin admin] The token cache is being invalidate because project e7528f4797c042c5bfa855b1221f78ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:25:28.503935 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-1a494700-a215-4f3e-a986-3c765605d91f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:28.506579 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-1a494700-a215-4f3e-a986-3c765605d91f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:28.520255 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 861/1712] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:25:27 2022] DELETE /identity/v3/projects/e7528f4797c042c5bfa855b1221f78ca => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:28.522033 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f51c7c-a0d3-42ff-b361-ac8633c29ca8 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:28.522578 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f51c7c-a0d3-42ff-b361-ac8633c29ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:28.522578 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f51c7c-a0d3-42ff-b361-ac8633c29ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:28.570049 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-15f51c7c-a0d3-42ff-b361-ac8633c29ca8 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:28.580673 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-15f51c7c-a0d3-42ff-b361-ac8633c29ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:28.762673 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 852/1713] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:28.770345 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cef91a-137b-4ab3-a159-f1505d67aa73 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:28.770345 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cef91a-137b-4ab3-a159-f1505d67aa73 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:28.770699 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cef91a-137b-4ab3-a159-f1505d67aa73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:28.805570 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-78cef91a-137b-4ab3-a159-f1505d67aa73 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:28.807309 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-78cef91a-137b-4ab3-a159-f1505d67aa73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:28.821478 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 862/1714] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:28.825616 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f51c7c-a0d3-42ff-b361-ac8633c29ca8 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:28.841365 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f51c7c-a0d3-42ff-b361-ac8633c29ca8 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:28.849935 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471907a-d682-4615-ba56-07cf24b643b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:28.851084 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471907a-d682-4615-ba56-07cf24b643b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:28.852746 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471907a-d682-4615-ba56-07cf24b643b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:28.858529 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471907a-d682-4615-ba56-07cf24b643b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:28.864213 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a471907a-d682-4615-ba56-07cf24b643b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:25:28.864213 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a471907a-d682-4615-ba56-07cf24b643b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:28.866603 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a471907a-d682-4615-ba56-07cf24b643b2 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:28.894237 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 853/1715] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:25:28.898393 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cef91a-137b-4ab3-a159-f1505d67aa73 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:28.909948 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cef91a-137b-4ab3-a159-f1505d67aa73 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:28.920476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7c5f8-68e4-4acb-8528-381812ddbdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:28.921112 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7c5f8-68e4-4acb-8528-381812ddbdac admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:28.921415 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7c5f8-68e4-4acb-8528-381812ddbdac admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:28.922189 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7c5f8-68e4-4acb-8528-381812ddbdac admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:28.922551 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7c5f8-68e4-4acb-8528-381812ddbdac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:28.925214 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7c5f8-68e4-4acb-8528-381812ddbdac admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:28.938944 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7413d88-6842-4015-afe8-e59eadaa4337 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:28.939231 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7413d88-6842-4015-afe8-e59eadaa4337 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:28.939781 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7413d88-6842-4015-afe8-e59eadaa4337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:29.004867 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-f7413d88-6842-4015-afe8-e59eadaa4337 None None] MFA Rules not processed for user `51b29010970f470589b118efdb2d4a12`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:29.006286 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-f7413d88-6842-4015-afe8-e59eadaa4337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:29.061313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 863/1716] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:25:28 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:25:29.062521 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7c5f8-68e4-4acb-8528-381812ddbdac admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:29.152151 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 854/1717] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:28 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:29.232204 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7c5f8-68e4-4acb-8528-381812ddbdac admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:29.248100 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c1bec-8239-4a40-b377-9cf5f3843517 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:29.248880 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c1bec-8239-4a40-b377-9cf5f3843517 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:29.249380 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c1bec-8239-4a40-b377-9cf5f3843517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:29.262247 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d277e-18a8-42f2-bfc8-f16aa8aa276e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:29.265555 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d277e-18a8-42f2-bfc8-f16aa8aa276e admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:29.268203 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d277e-18a8-42f2-bfc8-f16aa8aa276e admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:29.269975 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d277e-18a8-42f2-bfc8-f16aa8aa276e admin admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:29.275447 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d277e-18a8-42f2-bfc8-f16aa8aa276e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:29.279745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d277e-18a8-42f2-bfc8-f16aa8aa276e admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:29.315307 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:29.409008 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-b05c1bec-8239-4a40-b377-9cf5f3843517 None None] MFA Rules not processed for user `5f1629cbe3e64573bf444834d6083669`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:29.414932 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-b05c1bec-8239-4a40-b377-9cf5f3843517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:29.530072 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 864/1718] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:25:29 2022] POST /identity/v3/users => generated 289 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:25:29.534674 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d277e-18a8-42f2-bfc8-f16aa8aa276e admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:29.580758 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d277e-18a8-42f2-bfc8-f16aa8aa276e admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:29.614906 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505b534-600f-4405-92ea-5b0506e6b281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:29.616285 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505b534-600f-4405-92ea-5b0506e6b281 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:29.616731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505b534-600f-4405-92ea-5b0506e6b281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:29.617149 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505b534-600f-4405-92ea-5b0506e6b281 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:29.617942 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505b534-600f-4405-92ea-5b0506e6b281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:29.619883 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505b534-600f-4405-92ea-5b0506e6b281 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:29.674555 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 865/1719] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:25:29.680732 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33526c1-47bc-4f2b-a781-1dcdaeed3d60 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:29.681016 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33526c1-47bc-4f2b-a781-1dcdaeed3d60 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:29.681310 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33526c1-47bc-4f2b-a781-1dcdaeed3d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:29.706336 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 855/1720] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:29 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:25:29.710607 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c1bec-8239-4a40-b377-9cf5f3843517 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:29.744367 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c1bec-8239-4a40-b377-9cf5f3843517 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:29.757134 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08b3f9-b738-496b-aba0-30ed7f4e98a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:29.758144 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08b3f9-b738-496b-aba0-30ed7f4e98a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:29.775220 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08b3f9-b738-496b-aba0-30ed7f4e98a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:29.776481 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08b3f9-b738-496b-aba0-30ed7f4e98a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:29.779424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a08b3f9-b738-496b-aba0-30ed7f4e98a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:29.782160 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-c33526c1-47bc-4f2b-a781-1dcdaeed3d60 None None] MFA Rules not processed for user `9222455cb9e047ab8b667b156c6f1f73`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:29.784425 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a08b3f9-b738-496b-aba0-30ed7f4e98a3 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:29.790891 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-c33526c1-47bc-4f2b-a781-1dcdaeed3d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:29.828212 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 856/1721] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:25:29.830335 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08b3f9-b738-496b-aba0-30ed7f4e98a3 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:29.862368 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-7a08b3f9-b738-496b-aba0-30ed7f4e98a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:29.937086 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 866/1722] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:29.951810 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33526c1-47bc-4f2b-a781-1dcdaeed3d60 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:29.964033 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33526c1-47bc-4f2b-a781-1dcdaeed3d60 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:29.969102 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee0ee2-1edd-4a9e-8209-7fadc4ab8035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:29.970942 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee0ee2-1edd-4a9e-8209-7fadc4ab8035 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:29.970942 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee0ee2-1edd-4a9e-8209-7fadc4ab8035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:29.974740 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee0ee2-1edd-4a9e-8209-7fadc4ab8035 admin admin] PATH_INFO: `/v3/projects/5f590875e3c34d77839d0c8a418a0216/users/4ef8b8cb04184d318b7c50ba64d3c90c/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:30.030641 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08b3f9-b738-496b-aba0-30ed7f4e98a3 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:30.038278 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520ab9f-1171-4c7c-b7b5-4f226624f812 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:30.041474 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520ab9f-1171-4c7c-b7b5-4f226624f812 service nova] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:30.041765 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520ab9f-1171-4c7c-b7b5-4f226624f812 service nova] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:30.042047 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520ab9f-1171-4c7c-b7b5-4f226624f812 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:30.044948 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee0ee2-1edd-4a9e-8209-7fadc4ab8035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f590875e3c34d77839d0c8a418a0216, user_id=4ef8b8cb04184d318b7c50ba64d3c90c, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:30.060926 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee0ee2-1edd-4a9e-8209-7fadc4ab8035 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:30.077396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9520ab9f-1171-4c7c-b7b5-4f226624f812 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:30.082654 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9520ab9f-1171-4c7c-b7b5-4f226624f812 service nova] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:30.111861 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 857/1723] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:29 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:30.112850 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520ab9f-1171-4c7c-b7b5-4f226624f812 service nova] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:30.115648 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-9520ab9f-1171-4c7c-b7b5-4f226624f812 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:30.133842 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520ab9f-1171-4c7c-b7b5-4f226624f812 service nova] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:30.151031 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1af6c6-d71d-4f1c-9253-d39a8478c375 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:30.151031 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1af6c6-d71d-4f1c-9253-d39a8478c375 service nova] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:30.151031 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1af6c6-d71d-4f1c-9253-d39a8478c375 service nova] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:30.151031 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1af6c6-d71d-4f1c-9253-d39a8478c375 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:30.175843 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1af6c6-d71d-4f1c-9253-d39a8478c375 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:30.177412 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1af6c6-d71d-4f1c-9253-d39a8478c375 service nova] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:30.201556 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 858/1724] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:30.235971 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 867/1725] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:25:29 2022] PUT /identity/v3/projects/5f590875e3c34d77839d0c8a418a0216/users/4ef8b8cb04184d318b7c50ba64d3c90c/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:30.249428 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57f98b-6c68-41cd-8b9c-864053d62a03 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:30.249711 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57f98b-6c68-41cd-8b9c-864053d62a03 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:30.249984 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57f98b-6c68-41cd-8b9c-864053d62a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:30.321430 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-ea57f98b-6c68-41cd-8b9c-864053d62a03 None None] MFA Rules not processed for user `4ef8b8cb04184d318b7c50ba64d3c90c`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:30.323109 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-ea57f98b-6c68-41cd-8b9c-864053d62a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:30.523274 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 859/1726] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:30.527636 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee0ee2-1edd-4a9e-8209-7fadc4ab8035 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:30.673561 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee0ee2-1edd-4a9e-8209-7fadc4ab8035 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:30.682650 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c197134-7119-4026-993b-80c266f1acaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:30.683331 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c197134-7119-4026-993b-80c266f1acaa admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:30.683648 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c197134-7119-4026-993b-80c266f1acaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:30.683924 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c197134-7119-4026-993b-80c266f1acaa admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:30.684570 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c197134-7119-4026-993b-80c266f1acaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:30.689327 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c197134-7119-4026-993b-80c266f1acaa admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:30.852235 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 868/1727] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:25:30 2022] POST /identity/v3/projects => generated 379 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:25:30.855699 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57f98b-6c68-41cd-8b9c-864053d62a03 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:30.884720 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57f98b-6c68-41cd-8b9c-864053d62a03 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:31.031230 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9a74c-0a8a-42d6-9599-745f1ee00002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:31.031928 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9a74c-0a8a-42d6-9599-745f1ee00002 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:31.032289 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9a74c-0a8a-42d6-9599-745f1ee00002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:31.032564 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9a74c-0a8a-42d6-9599-745f1ee00002 admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:31.033276 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e9a74c-0a8a-42d6-9599-745f1ee00002 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:31.035215 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e9a74c-0a8a-42d6-9599-745f1ee00002 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:31.265173 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 860/1728] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:25:30 2022] POST /identity/v3/users => generated 290 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:25:31.267603 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c197134-7119-4026-993b-80c266f1acaa admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:31.278144 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c197134-7119-4026-993b-80c266f1acaa admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:31.279663 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a24cdc-91dc-4513-90a8-ef7a19691fcf None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:31.280317 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a24cdc-91dc-4513-90a8-ef7a19691fcf None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:31.280721 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a24cdc-91dc-4513-90a8-ef7a19691fcf None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:31.282501 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 861/1729] 10.222.0.23 () {54 vars in 921 bytes} [Mon Aug 8 02:25:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:25:31.284146 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89795f51-cbe5-4f8f-9e27-ebe1f27897d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:31.285073 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89795f51-cbe5-4f8f-9e27-ebe1f27897d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:31.285482 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89795f51-cbe5-4f8f-9e27-ebe1f27897d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:31.285914 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89795f51-cbe5-4f8f-9e27-ebe1f27897d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:31.286708 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89795f51-cbe5-4f8f-9e27-ebe1f27897d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:31.288585 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89795f51-cbe5-4f8f-9e27-ebe1f27897d3 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:31.311389 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7ee81-3a03-41bb-9454-ee5cf1a80cc8 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:31.311389 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7ee81-3a03-41bb-9454-ee5cf1a80cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:31.311389 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7ee81-3a03-41bb-9454-ee5cf1a80cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:31.346555 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-aef7ee81-3a03-41bb-9454-ee5cf1a80cc8 None None] MFA Rules not processed for user `43a39dd539974180a8165e34de57b552`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:31.356765 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-aef7ee81-3a03-41bb-9454-ee5cf1a80cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:31.359999 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 869/1730] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:25:31.364837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89795f51-cbe5-4f8f-9e27-ebe1f27897d3 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:31.404450 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89795f51-cbe5-4f8f-9e27-ebe1f27897d3 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:31.425712 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:31.425888 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb71825-d9e9-4812-a622-0f1e2d6378d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:31.425888 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb71825-d9e9-4812-a622-0f1e2d6378d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:31.425888 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb71825-d9e9-4812-a622-0f1e2d6378d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:31.425888 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb71825-d9e9-4812-a622-0f1e2d6378d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:31.426767 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb71825-d9e9-4812-a622-0f1e2d6378d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:31.430349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb71825-d9e9-4812-a622-0f1e2d6378d2 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:31.453160 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 870/1731] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:25:31.456431 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb71825-d9e9-4812-a622-0f1e2d6378d2 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:31.471238 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb71825-d9e9-4812-a622-0f1e2d6378d2 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:31.477057 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760438cd-4eb9-4bc6-99f4-d2e223d9186c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:31.477894 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760438cd-4eb9-4bc6-99f4-d2e223d9186c admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:31.478273 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760438cd-4eb9-4bc6-99f4-d2e223d9186c admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:31.478648 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760438cd-4eb9-4bc6-99f4-d2e223d9186c admin admin] PATH_INFO: `/v3/projects/8fc3e9a08325433694d26ebf505c0c57/users/453e1966193647f7a61a28fb46b4fdfe/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:31.488572 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 862/1732] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Aug 8 02:25:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:31.494705 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7ee81-3a03-41bb-9454-ee5cf1a80cc8 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:31.496319 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760438cd-4eb9-4bc6-99f4-d2e223d9186c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fc3e9a08325433694d26ebf505c0c57, user_id=453e1966193647f7a61a28fb46b4fdfe, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:31.496892 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-aef7ee81-3a03-41bb-9454-ee5cf1a80cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:31.499056 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760438cd-4eb9-4bc6-99f4-d2e223d9186c admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:31.510133 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7ee81-3a03-41bb-9454-ee5cf1a80cc8 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:31.515494 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3456a00b-b7b5-4d66-9db5-2c7e6fc668da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43a39dd539974180a8165e34de57b552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:31.516107 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456a00b-b7b5-4d66-9db5-2c7e6fc668da service placement] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:31.516453 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456a00b-b7b5-4d66-9db5-2c7e6fc668da service placement] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:31.517241 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456a00b-b7b5-4d66-9db5-2c7e6fc668da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:31.526282 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3456a00b-b7b5-4d66-9db5-2c7e6fc668da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:31.527920 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3456a00b-b7b5-4d66-9db5-2c7e6fc668da service placement] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:31.538547 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 863/1733] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:25:31.651022 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 871/1734] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:25:31 2022] PUT /identity/v3/projects/8fc3e9a08325433694d26ebf505c0c57/users/453e1966193647f7a61a28fb46b4fdfe/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:31.661951 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0ade2-732c-4eb4-a125-cc1aecf98f51 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:31.662497 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0ade2-732c-4eb4-a125-cc1aecf98f51 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:31.662975 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0ade2-732c-4eb4-a125-cc1aecf98f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:31.822194 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-05a0ade2-732c-4eb4-a125-cc1aecf98f51 None None] MFA Rules not processed for user `453e1966193647f7a61a28fb46b4fdfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:31.823800 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-05a0ade2-732c-4eb4-a125-cc1aecf98f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:31.995397 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 864/1735] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:31.998038 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760438cd-4eb9-4bc6-99f4-d2e223d9186c admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:32.208681 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760438cd-4eb9-4bc6-99f4-d2e223d9186c admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:32.208827 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04606944-e9a0-4fa4-8d90-b3565c7e9fb8 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:32.208827 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04606944-e9a0-4fa4-8d90-b3565c7e9fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:32.208827 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04606944-e9a0-4fa4-8d90-b3565c7e9fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:32.217292 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc193db4-e7b0-444e-b7d3-33335bd953ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:32.218151 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc193db4-e7b0-444e-b7d3-33335bd953ac admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:32.218534 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc193db4-e7b0-444e-b7d3-33335bd953ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:32.218904 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc193db4-e7b0-444e-b7d3-33335bd953ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:32.219691 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc193db4-e7b0-444e-b7d3-33335bd953ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:32.221689 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc193db4-e7b0-444e-b7d3-33335bd953ac admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:32.243576 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-04606944-e9a0-4fa4-8d90-b3565c7e9fb8 None None] MFA Rules not processed for user `bf2422e88cc94ef9b19f24f5d8e7d56c`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:32.249426 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-04606944-e9a0-4fa4-8d90-b3565c7e9fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:32.391998 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 865/1736] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:32.536944 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 872/1737] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:25:31 2022] POST /identity/v3/projects => generated 379 bytes in 539 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:25:32.540708 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04606944-e9a0-4fa4-8d90-b3565c7e9fb8 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:32.555977 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04606944-e9a0-4fa4-8d90-b3565c7e9fb8 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:32.649760 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874e4b1-3c02-44c0-8b53-7f2a56c2a291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:32.650369 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874e4b1-3c02-44c0-8b53-7f2a56c2a291 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:32.650810 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874e4b1-3c02-44c0-8b53-7f2a56c2a291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:32.651071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874e4b1-3c02-44c0-8b53-7f2a56c2a291 admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:32.651803 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874e4b1-3c02-44c0-8b53-7f2a56c2a291 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:32.654055 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874e4b1-3c02-44c0-8b53-7f2a56c2a291 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:32.808588 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 866/1738] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:25:32 2022] POST /identity/v3/users => generated 296 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:25:32.812739 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc193db4-e7b0-444e-b7d3-33335bd953ac admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:32.828002 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc193db4-e7b0-444e-b7d3-33335bd953ac admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:32.851941 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ce124-c3c7-4eb3-8d91-cac277402c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:32.866813 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ce124-c3c7-4eb3-8d91-cac277402c3d admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:32.874828 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ce124-c3c7-4eb3-8d91-cac277402c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:32.874828 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ce124-c3c7-4eb3-8d91-cac277402c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:32.874828 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ce124-c3c7-4eb3-8d91-cac277402c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:32.874828 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ce124-c3c7-4eb3-8d91-cac277402c3d admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:32.919404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 873/1739] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:25:32.922267 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874e4b1-3c02-44c0-8b53-7f2a56c2a291 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:32.936149 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874e4b1-3c02-44c0-8b53-7f2a56c2a291 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:32.951102 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b405a-5875-4e61-ba8f-625bce44c88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:32.951944 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b405a-5875-4e61-ba8f-625bce44c88e admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:32.952324 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b405a-5875-4e61-ba8f-625bce44c88e admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:32.952706 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b405a-5875-4e61-ba8f-625bce44c88e admin admin] PATH_INFO: `/v3/projects/8c44ca44db684447a36675ef8205b0d3/users/deccf9dfc00f414089342de8532f5fb1/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:32.988030 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30b405a-5875-4e61-ba8f-625bce44c88e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c44ca44db684447a36675ef8205b0d3, user_id=deccf9dfc00f414089342de8532f5fb1, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:32.993429 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30b405a-5875-4e61-ba8f-625bce44c88e admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:33.132452 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 867/1740] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:25:32 2022] PUT /identity/v3/projects/8c44ca44db684447a36675ef8205b0d3/users/deccf9dfc00f414089342de8532f5fb1/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:25:33.144535 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ce124-c3c7-4eb3-8d91-cac277402c3d admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:33.166828 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ce124-c3c7-4eb3-8d91-cac277402c3d admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:33.321592 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:33.361422 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb7b9e-af20-40c2-8a0c-840a4243a631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:33.362438 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb7b9e-af20-40c2-8a0c-840a4243a631 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:33.362872 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb7b9e-af20-40c2-8a0c-840a4243a631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:33.363306 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb7b9e-af20-40c2-8a0c-840a4243a631 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:33.364291 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb7b9e-af20-40c2-8a0c-840a4243a631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:33.366467 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb7b9e-af20-40c2-8a0c-840a4243a631 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:33.398277 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 874/1741] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:25:33.403543 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b405a-5875-4e61-ba8f-625bce44c88e admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:33.422209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b405a-5875-4e61-ba8f-625bce44c88e admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:33.439436 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0eb98c-fc3e-46ac-a438-cc108dd99a53 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:33.444569 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0eb98c-fc3e-46ac-a438-cc108dd99a53 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:33.444569 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0eb98c-fc3e-46ac-a438-cc108dd99a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:33.450176 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf84ff6-58ed-4253-9414-724d29ad745f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:33.458775 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf84ff6-58ed-4253-9414-724d29ad745f admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:33.461497 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf84ff6-58ed-4253-9414-724d29ad745f admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:33.461948 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf84ff6-58ed-4253-9414-724d29ad745f admin admin] PATH_INFO: `/v3/projects/8c44ca44db684447a36675ef8205b0d3/users/deccf9dfc00f414089342de8532f5fb1/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:33.468922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf84ff6-58ed-4253-9414-724d29ad745f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c44ca44db684447a36675ef8205b0d3, user_id=deccf9dfc00f414089342de8532f5fb1, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:33.480275 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf84ff6-58ed-4253-9414-724d29ad745f admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:33.556205 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 868/1742] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:25:33 2022] PUT /identity/v3/projects/8c44ca44db684447a36675ef8205b0d3/users/deccf9dfc00f414089342de8532f5fb1/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:33.569153 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d06608-3ad4-4625-914a-47eee2d04707 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:33.569466 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d06608-3ad4-4625-914a-47eee2d04707 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:33.569769 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d06608-3ad4-4625-914a-47eee2d04707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:33.625102 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-fb0eb98c-fc3e-46ac-a438-cc108dd99a53 None None] MFA Rules not processed for user `1d39439278814d4faac4cfb1e71aa4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:33.627787 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-fb0eb98c-fc3e-46ac-a438-cc108dd99a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:33.650592 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-30d06608-3ad4-4625-914a-47eee2d04707 None None] MFA Rules not processed for user `deccf9dfc00f414089342de8532f5fb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:33.651921 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-30d06608-3ad4-4625-914a-47eee2d04707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:33.790824 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 875/1743] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 8 02:25:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:33.823179 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 869/1744] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:33 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:33.836654 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0eb98c-fc3e-46ac-a438-cc108dd99a53 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:33.841660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-fb0eb98c-fc3e-46ac-a438-cc108dd99a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:33.969455 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0eb98c-fc3e-46ac-a438-cc108dd99a53 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:33.973967 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319e632-eab3-4c09-9210-3445117385f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:33.974646 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319e632-eab3-4c09-9210-3445117385f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:33.974940 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319e632-eab3-4c09-9210-3445117385f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:33.975223 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319e632-eab3-4c09-9210-3445117385f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:33.987720 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7319e632-eab3-4c09-9210-3445117385f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:33.989465 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7319e632-eab3-4c09-9210-3445117385f7 service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:34.005834 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 876/1745] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:33 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:34.166424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d06608-3ad4-4625-914a-47eee2d04707 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:34.168929 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-30d06608-3ad4-4625-914a-47eee2d04707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:34.194017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d06608-3ad4-4625-914a-47eee2d04707 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:34.212209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963fbd6-eed2-4d4d-8a78-1ed5da45b036 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:34.212209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963fbd6-eed2-4d4d-8a78-1ed5da45b036 service cinder] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:34.212209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963fbd6-eed2-4d4d-8a78-1ed5da45b036 service cinder] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:34.212209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963fbd6-eed2-4d4d-8a78-1ed5da45b036 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:34.218242 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319e632-eab3-4c09-9210-3445117385f7 service cinder] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:34.220448 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-7319e632-eab3-4c09-9210-3445117385f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:34.360307 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e963fbd6-eed2-4d4d-8a78-1ed5da45b036 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:34.363925 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e963fbd6-eed2-4d4d-8a78-1ed5da45b036 service cinder] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:34.389578 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 870/1746] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:34.390626 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963fbd6-eed2-4d4d-8a78-1ed5da45b036 service cinder] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:34.393755 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-e963fbd6-eed2-4d4d-8a78-1ed5da45b036 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:34.424431 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319e632-eab3-4c09-9210-3445117385f7 service cinder] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:34.436440 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c628c9-d1c2-4cf1-b08f-aee7db81eb3b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c212009b6a44e1bad92769630116408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:34.437076 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c628c9-d1c2-4cf1-b08f-aee7db81eb3b service swift] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:34.437361 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c628c9-d1c2-4cf1-b08f-aee7db81eb3b service swift] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:34.437643 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c628c9-d1c2-4cf1-b08f-aee7db81eb3b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:34.443712 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:34.458195 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c628c9-d1c2-4cf1-b08f-aee7db81eb3b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:34.459892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c628c9-d1c2-4cf1-b08f-aee7db81eb3b service swift] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:34.479956 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 877/1747] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 8 02:25:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:25:34.686335 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963fbd6-eed2-4d4d-8a78-1ed5da45b036 service cinder] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:34.714744 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9a61f-cedc-4742-8130-af89ae4bb624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:34.715729 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9a61f-cedc-4742-8130-af89ae4bb624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:34.717572 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9a61f-cedc-4742-8130-af89ae4bb624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:34.718008 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9a61f-cedc-4742-8130-af89ae4bb624 admin admin] PATH_INFO: `/v3/users/6c16e5594e59435cb1a5cba601744b81` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:34.724277 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d9a61f-cedc-4742-8130-af89ae4bb624 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c16e5594e59435cb1a5cba601744b81)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:34.726498 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d9a61f-cedc-4742-8130-af89ae4bb624 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:34.727226 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:35.075577 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-00d9a61f-cedc-4742-8130-af89ae4bb624 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c16e5594e59435cb1a5cba601744b81'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:35.224037 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-00d9a61f-cedc-4742-8130-af89ae4bb624 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c16e5594e59435cb1a5cba601744b81'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:35.224037 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-00d9a61f-cedc-4742-8130-af89ae4bb624 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c16e5594e59435cb1a5cba601744b81'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:35.225732 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-00d9a61f-cedc-4742-8130-af89ae4bb624 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c16e5594e59435cb1a5cba601744b81'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:35.305416 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-00d9a61f-cedc-4742-8130-af89ae4bb624 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c16e5594e59435cb1a5cba601744b81'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:35.392727 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 871/1748] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:25:34 2022] DELETE /identity/v3/users/6c16e5594e59435cb1a5cba601744b81 => generated 0 bytes in 999 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:37.078360 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c628c9-d1c2-4cf1-b08f-aee7db81eb3b service swift] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:37.095818 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c628c9-d1c2-4cf1-b08f-aee7db81eb3b service swift] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:37.209414 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217da9e7-71bc-4f7d-8b74-46116fa3e4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:37.210251 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217da9e7-71bc-4f7d-8b74-46116fa3e4c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:37.210697 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217da9e7-71bc-4f7d-8b74-46116fa3e4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:37.211217 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217da9e7-71bc-4f7d-8b74-46116fa3e4c7 admin admin] PATH_INFO: `/v3/projects/9be2feeb2d4b4d708ce13d4c9612f705` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:37.213704 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217da9e7-71bc-4f7d-8b74-46116fa3e4c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9be2feeb2d4b4d708ce13d4c9612f705)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:37.215954 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217da9e7-71bc-4f7d-8b74-46116fa3e4c7 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:37.519371 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-217da9e7-71bc-4f7d-8b74-46116fa3e4c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9be2feeb2d4b4d708ce13d4c9612f705', 'request_id': 'req-217da9e7-71bc-4f7d-8b74-46116fa3e4c7'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:37.536566 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-217da9e7-71bc-4f7d-8b74-46116fa3e4c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9be2feeb2d4b4d708ce13d4c9612f705', 'request_id': 'req-217da9e7-71bc-4f7d-8b74-46116fa3e4c7'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:37.557479 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-217da9e7-71bc-4f7d-8b74-46116fa3e4c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9be2feeb2d4b4d708ce13d4c9612f705', 'request_id': 'req-217da9e7-71bc-4f7d-8b74-46116fa3e4c7'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:37.691850 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-217da9e7-71bc-4f7d-8b74-46116fa3e4c7 admin admin] The token cache is being invalidate because project 9be2feeb2d4b4d708ce13d4c9612f705 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:25:37.691850 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-217da9e7-71bc-4f7d-8b74-46116fa3e4c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:37.701499 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-217da9e7-71bc-4f7d-8b74-46116fa3e4c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:37.707294 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 878/1749] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:25:37 2022] DELETE /identity/v3/projects/9be2feeb2d4b4d708ce13d4c9612f705 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:37.708292 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9a61f-cedc-4742-8130-af89ae4bb624 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:37.711089 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-00d9a61f-cedc-4742-8130-af89ae4bb624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:37.739085 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9a61f-cedc-4742-8130-af89ae4bb624 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:37.785627 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af0c85-c781-4b3c-af8c-3183f5f64ee8 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:37.786129 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af0c85-c781-4b3c-af8c-3183f5f64ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:37.786129 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af0c85-c781-4b3c-af8c-3183f5f64ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:37.950821 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-d7af0c85-c781-4b3c-af8c-3183f5f64ee8 None None] MFA Rules not processed for user `9222455cb9e047ab8b667b156c6f1f73`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:37.950821 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-d7af0c85-c781-4b3c-af8c-3183f5f64ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:37.952370 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b20304-6874-4546-8589-5cde9f3f6848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:37.952370 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b20304-6874-4546-8589-5cde9f3f6848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:37.952370 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b20304-6874-4546-8589-5cde9f3f6848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:37.952370 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b20304-6874-4546-8589-5cde9f3f6848 admin admin] PATH_INFO: `/v3/users/51b29010970f470589b118efdb2d4a12` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:37.952778 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b20304-6874-4546-8589-5cde9f3f6848 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51b29010970f470589b118efdb2d4a12)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:37.952778 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b20304-6874-4546-8589-5cde9f3f6848 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:37.953004 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 879/1750] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:38.222106 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1345bc-1cb1-4d37-80ae-e5a3e64ac86f None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:38.222724 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1345bc-1cb1-4d37-80ae-e5a3e64ac86f None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:38.223017 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1345bc-1cb1-4d37-80ae-e5a3e64ac86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:38.297578 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-dc1345bc-1cb1-4d37-80ae-e5a3e64ac86f None None] MFA Rules not processed for user `5f1629cbe3e64573bf444834d6083669`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:38.299402 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-dc1345bc-1cb1-4d37-80ae-e5a3e64ac86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:38.403104 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-15b20304-6874-4546-8589-5cde9f3f6848 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51b29010970f470589b118efdb2d4a12'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:38.443578 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 880/1751] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:38.612294 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3dd694-6a50-480e-913d-24fef97b8c41 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:38.612728 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3dd694-6a50-480e-913d-24fef97b8c41 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:38.613118 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3dd694-6a50-480e-913d-24fef97b8c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:38.642496 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-15b20304-6874-4546-8589-5cde9f3f6848 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51b29010970f470589b118efdb2d4a12'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:38.643604 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-15b20304-6874-4546-8589-5cde9f3f6848 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51b29010970f470589b118efdb2d4a12'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:38.644729 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-15b20304-6874-4546-8589-5cde9f3f6848 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51b29010970f470589b118efdb2d4a12'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:38.663708 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-15b20304-6874-4546-8589-5cde9f3f6848 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51b29010970f470589b118efdb2d4a12'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:38.673390 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-cd3dd694-6a50-480e-913d-24fef97b8c41 None None] MFA Rules not processed for user `fa4c5732acb844369140e8d970577f94`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:38.676696 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-cd3dd694-6a50-480e-913d-24fef97b8c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:38.685169 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 872/1752] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:25:37 2022] DELETE /identity/v3/users/51b29010970f470589b118efdb2d4a12 => generated 0 bytes in 974 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:38.815311 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 881/1753] 10.222.0.44 () {58 vars in 1015 bytes} [Mon Aug 8 02:25:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:38.881283 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:38.939101 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b20304-6874-4546-8589-5cde9f3f6848 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:38.948299 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-15b20304-6874-4546-8589-5cde9f3f6848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:38.995749 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b20304-6874-4546-8589-5cde9f3f6848 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:38.995749 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f7708-6643-401f-9c29-66781fb62ced service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:38.995749 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f7708-6643-401f-9c29-66781fb62ced service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:38.995749 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f7708-6643-401f-9c29-66781fb62ced service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:38.996356 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f7708-6643-401f-9c29-66781fb62ced service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:39.002057 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f7708-6643-401f-9c29-66781fb62ced service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:39.004212 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f7708-6643-401f-9c29-66781fb62ced service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:39.018929 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 873/1754] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:39.132961 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3dd694-6a50-480e-913d-24fef97b8c41 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:39.134753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-cd3dd694-6a50-480e-913d-24fef97b8c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:39.347703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:39.381025 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3dd694-6a50-480e-913d-24fef97b8c41 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:39.400317 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70047cc-8313-41d0-9e60-1da97eb3f96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:39.400317 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70047cc-8313-41d0-9e60-1da97eb3f96e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:39.400317 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70047cc-8313-41d0-9e60-1da97eb3f96e admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:39.400317 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70047cc-8313-41d0-9e60-1da97eb3f96e admin admin] PATH_INFO: `/v3/projects/0133589ae2384ebe97d9033c51b685fa` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:39.421387 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70047cc-8313-41d0-9e60-1da97eb3f96e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0133589ae2384ebe97d9033c51b685fa)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:39.446548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70047cc-8313-41d0-9e60-1da97eb3f96e admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:39.903239 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-e70047cc-8313-41d0-9e60-1da97eb3f96e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0133589ae2384ebe97d9033c51b685fa', 'request_id': 'req-e70047cc-8313-41d0-9e60-1da97eb3f96e'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:39.912248 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-e70047cc-8313-41d0-9e60-1da97eb3f96e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0133589ae2384ebe97d9033c51b685fa', 'request_id': 'req-e70047cc-8313-41d0-9e60-1da97eb3f96e'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:39.940472 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-e70047cc-8313-41d0-9e60-1da97eb3f96e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0133589ae2384ebe97d9033c51b685fa', 'request_id': 'req-e70047cc-8313-41d0-9e60-1da97eb3f96e'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:40.072803 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-e70047cc-8313-41d0-9e60-1da97eb3f96e admin admin] The token cache is being invalidate because project 0133589ae2384ebe97d9033c51b685fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:25:40.072803 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-e70047cc-8313-41d0-9e60-1da97eb3f96e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:40.072803 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-e70047cc-8313-41d0-9e60-1da97eb3f96e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:40.073541 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 882/1755] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:25:39 2022] DELETE /identity/v3/projects/0133589ae2384ebe97d9033c51b685fa => generated 0 bytes in 941 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:40.079678 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357765b6-ec29-40e5-afd2-070ac49892df None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:40.080232 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357765b6-ec29-40e5-afd2-070ac49892df None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:40.080232 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357765b6-ec29-40e5-afd2-070ac49892df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:40.132584 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-357765b6-ec29-40e5-afd2-070ac49892df None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:40.134508 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-357765b6-ec29-40e5-afd2-070ac49892df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:40.306333 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c86d9-a225-4a15-a642-d8c3ca382272 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:40.306706 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c86d9-a225-4a15-a642-d8c3ca382272 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:40.307094 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c86d9-a225-4a15-a642-d8c3ca382272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:40.312879 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 874/1756] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:40.350459 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-7e2c86d9-a225-4a15-a642-d8c3ca382272 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:40.356765 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-7e2c86d9-a225-4a15-a642-d8c3ca382272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:40.459858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 883/1757] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:40.473615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357765b6-ec29-40e5-afd2-070ac49892df None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:40.490279 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357765b6-ec29-40e5-afd2-070ac49892df None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:40.519109 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ecfdb0-9dce-48a8-a002-6b8422472810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:40.519842 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecfdb0-9dce-48a8-a002-6b8422472810 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:40.520131 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecfdb0-9dce-48a8-a002-6b8422472810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:40.522157 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecfdb0-9dce-48a8-a002-6b8422472810 admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:40.522856 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ecfdb0-9dce-48a8-a002-6b8422472810 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:25:40.523170 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ecfdb0-9dce-48a8-a002-6b8422472810 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:40.525782 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ecfdb0-9dce-48a8-a002-6b8422472810 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:40.569571 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 875/1758] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:25:40.575585 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c86d9-a225-4a15-a642-d8c3ca382272 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:40.602249 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c86d9-a225-4a15-a642-d8c3ca382272 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:40.623425 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b875286e-5192-446b-af73-eff1cdf3305c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:40.624235 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875286e-5192-446b-af73-eff1cdf3305c admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:40.626097 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875286e-5192-446b-af73-eff1cdf3305c admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:40.627486 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875286e-5192-446b-af73-eff1cdf3305c admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:40.632650 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b875286e-5192-446b-af73-eff1cdf3305c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:40.640499 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b875286e-5192-446b-af73-eff1cdf3305c admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:41.257712 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 884/1759] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:25:40 2022] POST /identity/v3/projects => generated 381 bytes in 683 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:25:41.265350 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ecfdb0-9dce-48a8-a002-6b8422472810 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:41.279834 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ecfdb0-9dce-48a8-a002-6b8422472810 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:41.409618 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d359b-c83e-4e40-a63a-1955014889ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:41.411142 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d359b-c83e-4e40-a63a-1955014889ab admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:41.411804 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d359b-c83e-4e40-a63a-1955014889ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:41.412308 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d359b-c83e-4e40-a63a-1955014889ab admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:41.413547 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d359b-c83e-4e40-a63a-1955014889ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:41.418603 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d359b-c83e-4e40-a63a-1955014889ab admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:41.779970 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:41.794617 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 876/1760] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:25:41 2022] POST /identity/v3/users => generated 291 bytes in 530 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:25:41.799456 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b875286e-5192-446b-af73-eff1cdf3305c admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:41.824094 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b875286e-5192-446b-af73-eff1cdf3305c admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:41.842448 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337cdde8-ccfb-45c1-adbe-a8baa795f9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:41.843136 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337cdde8-ccfb-45c1-adbe-a8baa795f9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:41.843458 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337cdde8-ccfb-45c1-adbe-a8baa795f9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:41.843724 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337cdde8-ccfb-45c1-adbe-a8baa795f9e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:41.844420 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337cdde8-ccfb-45c1-adbe-a8baa795f9e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:41.856099 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337cdde8-ccfb-45c1-adbe-a8baa795f9e0 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:41.890289 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 885/1761] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:25:41.894260 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d359b-c83e-4e40-a63a-1955014889ab admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:41.908404 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d359b-c83e-4e40-a63a-1955014889ab admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:41.952946 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef1cca-235c-41d3-a11f-0dc1f53f88b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:41.958538 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef1cca-235c-41d3-a11f-0dc1f53f88b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:41.958538 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef1cca-235c-41d3-a11f-0dc1f53f88b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:41.958538 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef1cca-235c-41d3-a11f-0dc1f53f88b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:41.958538 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef1cca-235c-41d3-a11f-0dc1f53f88b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:41.958538 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef1cca-235c-41d3-a11f-0dc1f53f88b1 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:41.986120 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 877/1762] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:25:41.990649 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337cdde8-ccfb-45c1-adbe-a8baa795f9e0 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:42.001867 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337cdde8-ccfb-45c1-adbe-a8baa795f9e0 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:42.023659 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549c7a5-4601-4384-bfc0-d2a6d9af2568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:42.024347 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549c7a5-4601-4384-bfc0-d2a6d9af2568 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:42.024629 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549c7a5-4601-4384-bfc0-d2a6d9af2568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:42.025084 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549c7a5-4601-4384-bfc0-d2a6d9af2568 admin admin] PATH_INFO: `/v3/projects/98b047e2e4424debb3881da0c9a7a28f/users/3e3a36d437db4d51b7aa7e92bb039f99/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:42.062045 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549c7a5-4601-4384-bfc0-d2a6d9af2568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98b047e2e4424debb3881da0c9a7a28f, user_id=3e3a36d437db4d51b7aa7e92bb039f99, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:42.071652 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549c7a5-4601-4384-bfc0-d2a6d9af2568 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:42.202914 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 886/1763] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:25:41 2022] PUT /identity/v3/projects/98b047e2e4424debb3881da0c9a7a28f/users/3e3a36d437db4d51b7aa7e92bb039f99/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:42.214976 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173b029-bbba-4580-9c1d-018772ae5396 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:42.215289 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173b029-bbba-4580-9c1d-018772ae5396 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:42.215575 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173b029-bbba-4580-9c1d-018772ae5396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:42.287466 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-8173b029-bbba-4580-9c1d-018772ae5396 None None] MFA Rules not processed for user `3e3a36d437db4d51b7aa7e92bb039f99`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:42.288745 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-8173b029-bbba-4580-9c1d-018772ae5396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:42.509986 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 878/1764] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:42.512095 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549c7a5-4601-4384-bfc0-d2a6d9af2568 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:42.650479 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549c7a5-4601-4384-bfc0-d2a6d9af2568 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:42.687381 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19473c-d826-4a69-a4d9-41f1ec3e3a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:42.690665 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19473c-d826-4a69-a4d9-41f1ec3e3a83 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:42.690665 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19473c-d826-4a69-a4d9-41f1ec3e3a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:42.690665 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19473c-d826-4a69-a4d9-41f1ec3e3a83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:42.690665 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c19473c-d826-4a69-a4d9-41f1ec3e3a83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:42.707251 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c19473c-d826-4a69-a4d9-41f1ec3e3a83 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:42.912913 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 887/1765] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:25:42 2022] POST /identity/v3/projects => generated 381 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:25:42.916948 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173b029-bbba-4580-9c1d-018772ae5396 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:42.933782 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173b029-bbba-4580-9c1d-018772ae5396 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:42.944519 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19473c-d826-4a69-a4d9-41f1ec3e3a83 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:42.950791 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-2c19473c-d826-4a69-a4d9-41f1ec3e3a83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:43.114029 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19473c-d826-4a69-a4d9-41f1ec3e3a83 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:43.138702 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111b5de-ec61-406c-b760-7c7c029bfd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:43.138702 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111b5de-ec61-406c-b760-7c7c029bfd96 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:43.138702 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111b5de-ec61-406c-b760-7c7c029bfd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:43.138702 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111b5de-ec61-406c-b760-7c7c029bfd96 admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:43.139098 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111b5de-ec61-406c-b760-7c7c029bfd96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:43.145636 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111b5de-ec61-406c-b760-7c7c029bfd96 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:43.146585 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c8f65-04bf-4b66-a385-78d91bf007ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:43.147388 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c8f65-04bf-4b66-a385-78d91bf007ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:43.147774 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c8f65-04bf-4b66-a385-78d91bf007ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:43.148161 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c8f65-04bf-4b66-a385-78d91bf007ef admin admin] PATH_INFO: `/v3/users/4ef8b8cb04184d318b7c50ba64d3c90c` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:43.156408 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c8f65-04bf-4b66-a385-78d91bf007ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ef8b8cb04184d318b7c50ba64d3c90c)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:43.159240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c8f65-04bf-4b66-a385-78d91bf007ef admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:43.690479 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 879/1766] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:25:42 2022] POST /identity/v3/users => generated 297 bytes in 772 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:25:43.692742 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111b5de-ec61-406c-b760-7c7c029bfd96 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:43.708362 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111b5de-ec61-406c-b760-7c7c029bfd96 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:43.714114 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8595f-ec82-4dcf-b6be-c9740157411d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:43.714835 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8595f-ec82-4dcf-b6be-c9740157411d admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:43.715131 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8595f-ec82-4dcf-b6be-c9740157411d admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:43.715577 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8595f-ec82-4dcf-b6be-c9740157411d admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:43.716308 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff8595f-ec82-4dcf-b6be-c9740157411d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:43.718143 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff8595f-ec82-4dcf-b6be-c9740157411d admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:43.730153 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 880/1767] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:25:43.734037 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8595f-ec82-4dcf-b6be-c9740157411d admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:43.756636 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8595f-ec82-4dcf-b6be-c9740157411d admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:43.773441 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505cf9b7-f587-4ab7-8ba2-251d09f1196d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:43.774640 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505cf9b7-f587-4ab7-8ba2-251d09f1196d admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:43.775088 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505cf9b7-f587-4ab7-8ba2-251d09f1196d admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:43.775550 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505cf9b7-f587-4ab7-8ba2-251d09f1196d admin admin] PATH_INFO: `/v3/projects/d678d069607a4a268cc284e2643e179c/users/f5698d580535496bb41cef418c34353b/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:43.804931 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505cf9b7-f587-4ab7-8ba2-251d09f1196d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d678d069607a4a268cc284e2643e179c, user_id=f5698d580535496bb41cef418c34353b, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:43.812743 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505cf9b7-f587-4ab7-8ba2-251d09f1196d admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:43.886947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-629c8f65-04bf-4b66-a385-78d91bf007ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ef8b8cb04184d318b7c50ba64d3c90c'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:44.223074 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 881/1768] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:25:43 2022] PUT /identity/v3/projects/d678d069607a4a268cc284e2643e179c/users/f5698d580535496bb41cef418c34353b/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:44.224630 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362f337-d6bc-432e-bca7-9bcd6c89b516 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:44.236895 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362f337-d6bc-432e-bca7-9bcd6c89b516 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:44.237348 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362f337-d6bc-432e-bca7-9bcd6c89b516 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:44.243641 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 882/1769] 10.222.0.23 () {54 vars in 921 bytes} [Mon Aug 8 02:25:44 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:25:44.244568 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362f337-d6bc-432e-bca7-9bcd6c89b516 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:44.258680 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-629c8f65-04bf-4b66-a385-78d91bf007ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ef8b8cb04184d318b7c50ba64d3c90c'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:44.259770 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-629c8f65-04bf-4b66-a385-78d91bf007ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ef8b8cb04184d318b7c50ba64d3c90c'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:44.307709 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-629c8f65-04bf-4b66-a385-78d91bf007ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ef8b8cb04184d318b7c50ba64d3c90c'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:44.335057 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-629c8f65-04bf-4b66-a385-78d91bf007ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ef8b8cb04184d318b7c50ba64d3c90c'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:44.361670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 888/1770] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:25:42 2022] DELETE /identity/v3/users/4ef8b8cb04184d318b7c50ba64d3c90c => generated 0 bytes in 1418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:44.443154 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9d019-6206-4a52-bf33-4ad4166278ad None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:44.443154 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9d019-6206-4a52-bf33-4ad4166278ad None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:44.443154 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9d019-6206-4a52-bf33-4ad4166278ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:44.443154 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-3de9d019-6206-4a52-bf33-4ad4166278ad None None] MFA Rules not processed for user `5d89e0c7d62444e4b75d3f4da49b2bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:44.443154 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-3de9d019-6206-4a52-bf33-4ad4166278ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:44.597901 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362f337-d6bc-432e-bca7-9bcd6c89b516 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:44.610866 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 889/1771] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Aug 8 02:25:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:44.614977 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1df01-c240-4636-8785-10064984ee27 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:44.620699 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1df01-c240-4636-8785-10064984ee27 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:44.620699 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1df01-c240-4636-8785-10064984ee27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:44.667833 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-25b1df01-c240-4636-8785-10064984ee27 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:44.669426 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-25b1df01-c240-4636-8785-10064984ee27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:44.754708 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c9bc2-fd10-4e68-abcf-91e085f4e4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:44.761169 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c9bc2-fd10-4e68-abcf-91e085f4e4aa admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:44.761169 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c9bc2-fd10-4e68-abcf-91e085f4e4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:44.761169 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c9bc2-fd10-4e68-abcf-91e085f4e4aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:44.761169 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c9bc2-fd10-4e68-abcf-91e085f4e4aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:44.761169 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c9bc2-fd10-4e68-abcf-91e085f4e4aa admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:44.933044 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 890/1772] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:44.934169 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 883/1773] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 552 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:25:44.944898 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1df01-c240-4636-8785-10064984ee27 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:44.946318 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-25b1df01-c240-4636-8785-10064984ee27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:44.963868 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1df01-c240-4636-8785-10064984ee27 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:44.969048 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ebf23-b5fd-4b72-983b-65a02f50152e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:44.970208 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ebf23-b5fd-4b72-983b-65a02f50152e admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:44.970743 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ebf23-b5fd-4b72-983b-65a02f50152e admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:44.971171 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ebf23-b5fd-4b72-983b-65a02f50152e admin admin] PATH_INFO: `/v3/projects/d678d069607a4a268cc284e2643e179c/users/f5698d580535496bb41cef418c34353b/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:44.973422 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ebf23-b5fd-4b72-983b-65a02f50152e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d678d069607a4a268cc284e2643e179c, user_id=f5698d580535496bb41cef418c34353b, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:44.976765 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ebf23-b5fd-4b72-983b-65a02f50152e admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:44.988808 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 891/1774] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:25:44 2022] PUT /identity/v3/projects/d678d069607a4a268cc284e2643e179c/users/f5698d580535496bb41cef418c34353b/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:45.001199 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41c0cd-6e9d-4207-b37e-0820eac09c5a None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:45.002158 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41c0cd-6e9d-4207-b37e-0820eac09c5a None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:45.002645 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41c0cd-6e9d-4207-b37e-0820eac09c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:45.041529 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ebf23-b5fd-4b72-983b-65a02f50152e admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:45.043322 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-5b2ebf23-b5fd-4b72-983b-65a02f50152e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:45.066404 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-8a41c0cd-6e9d-4207-b37e-0820eac09c5a None None] MFA Rules not processed for user `f5698d580535496bb41cef418c34353b`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:45.068923 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-8a41c0cd-6e9d-4207-b37e-0820eac09c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:45.230468 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ebf23-b5fd-4b72-983b-65a02f50152e admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:45.236241 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 884/1775] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:44 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:45.244004 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb0fc4-7200-4724-88e3-07c82be82426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:45.244796 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb0fc4-7200-4724-88e3-07c82be82426 service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:45.246926 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb0fc4-7200-4724-88e3-07c82be82426 service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:45.248711 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb0fc4-7200-4724-88e3-07c82be82426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:45.253258 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41c0cd-6e9d-4207-b37e-0820eac09c5a None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:45.255299 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-8a41c0cd-6e9d-4207-b37e-0820eac09c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:45.493221 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41c0cd-6e9d-4207-b37e-0820eac09c5a None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:45.493221 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51705a-2206-4a21-98af-f87095a867a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:45.493221 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51705a-2206-4a21-98af-f87095a867a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:45.493221 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51705a-2206-4a21-98af-f87095a867a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:45.493563 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51705a-2206-4a21-98af-f87095a867a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:45.493654 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb0fc4-7200-4724-88e3-07c82be82426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:45.493654 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb0fc4-7200-4724-88e3-07c82be82426 service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:45.505437 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df51705a-2206-4a21-98af-f87095a867a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:45.508283 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df51705a-2206-4a21-98af-f87095a867a7 service cinder] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:45.518767 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 892/1776] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:25:45.522756 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 885/1777] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:45 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:45.629014 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb0fc4-7200-4724-88e3-07c82be82426 service neutron] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:45.630494 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-2ecb0fc4-7200-4724-88e3-07c82be82426 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:45.717755 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:45.778748 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb0fc4-7200-4724-88e3-07c82be82426 service neutron] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:45.789255 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379c170-012d-41d7-b614-64ee84483c66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:45.795118 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379c170-012d-41d7-b614-64ee84483c66 service nova] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:45.795118 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379c170-012d-41d7-b614-64ee84483c66 service nova] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:45.795118 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379c170-012d-41d7-b614-64ee84483c66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:45.804664 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379c170-012d-41d7-b614-64ee84483c66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:45.807928 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379c170-012d-41d7-b614-64ee84483c66 service nova] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:45.825508 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 893/1778] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:45.887458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51705a-2206-4a21-98af-f87095a867a7 service cinder] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:45.902877 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51705a-2206-4a21-98af-f87095a867a7 service cinder] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:45.919171 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df4292-c323-4981-9033-abf3819a0815 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:45.919171 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df4292-c323-4981-9033-abf3819a0815 service cinder] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:45.919171 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df4292-c323-4981-9033-abf3819a0815 service cinder] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:45.919171 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df4292-c323-4981-9033-abf3819a0815 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:45.935157 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-50df4292-c323-4981-9033-abf3819a0815 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:46.127381 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df4292-c323-4981-9033-abf3819a0815 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:46.127381 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df4292-c323-4981-9033-abf3819a0815 service cinder] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:46.127381 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 886/1779] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:45 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:25:46.940846 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379c170-012d-41d7-b614-64ee84483c66 service nova] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:46.942334 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-e379c170-012d-41d7-b614-64ee84483c66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:46.951939 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196c20a-fbb6-4c77-bf00-b677b19b67dd None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:46.952567 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196c20a-fbb6-4c77-bf00-b677b19b67dd None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:46.952567 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196c20a-fbb6-4c77-bf00-b677b19b67dd None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:46.955811 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 887/1780] 10.222.0.23 () {54 vars in 921 bytes} [Mon Aug 8 02:25:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:25:46.970876 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379c170-012d-41d7-b614-64ee84483c66 service nova] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:46.981690 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1872ea-7edc-4c69-93f7-76da34896f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:46.983567 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1872ea-7edc-4c69-93f7-76da34896f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:46.983567 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1872ea-7edc-4c69-93f7-76da34896f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:46.983567 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1872ea-7edc-4c69-93f7-76da34896f1a admin admin] PATH_INFO: `/v3/projects/5f590875e3c34d77839d0c8a418a0216` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:46.984542 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1872ea-7edc-4c69-93f7-76da34896f1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f590875e3c34d77839d0c8a418a0216)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:46.986941 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1872ea-7edc-4c69-93f7-76da34896f1a admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:46.995630 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126272a7-bd2e-4c3d-9b32-04f21abdc3bd None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:46.997865 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126272a7-bd2e-4c3d-9b32-04f21abdc3bd None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:46.998410 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126272a7-bd2e-4c3d-9b32-04f21abdc3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:47.074759 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-126272a7-bd2e-4c3d-9b32-04f21abdc3bd None None] MFA Rules not processed for user `5d89e0c7d62444e4b75d3f4da49b2bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:47.086545 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-126272a7-bd2e-4c3d-9b32-04f21abdc3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:47.107343 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 888/1781] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Aug 8 02:25:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:25:47.123032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126272a7-bd2e-4c3d-9b32-04f21abdc3bd None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:47.144939 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126272a7-bd2e-4c3d-9b32-04f21abdc3bd None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:47.153607 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ff7f9-fe64-41a9-b154-403cfcf6bde5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:47.155223 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ff7f9-fe64-41a9-b154-403cfcf6bde5 service nova] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:47.156165 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ff7f9-fe64-41a9-b154-403cfcf6bde5 service nova] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:47.157539 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ff7f9-fe64-41a9-b154-403cfcf6bde5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:47.173394 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ff7f9-fe64-41a9-b154-403cfcf6bde5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:47.177277 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ff7f9-fe64-41a9-b154-403cfcf6bde5 service nova] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:47.192795 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 889/1782] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:47.378093 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-ee1872ea-7edc-4c69-93f7-76da34896f1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f590875e3c34d77839d0c8a418a0216', 'request_id': 'req-ee1872ea-7edc-4c69-93f7-76da34896f1a'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:47.385892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-ee1872ea-7edc-4c69-93f7-76da34896f1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f590875e3c34d77839d0c8a418a0216', 'request_id': 'req-ee1872ea-7edc-4c69-93f7-76da34896f1a'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:47.396092 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-ee1872ea-7edc-4c69-93f7-76da34896f1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f590875e3c34d77839d0c8a418a0216', 'request_id': 'req-ee1872ea-7edc-4c69-93f7-76da34896f1a'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:47.708603 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-ee1872ea-7edc-4c69-93f7-76da34896f1a admin admin] The token cache is being invalidate because project 5f590875e3c34d77839d0c8a418a0216 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:25:47.708603 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-ee1872ea-7edc-4c69-93f7-76da34896f1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:47.719091 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-ee1872ea-7edc-4c69-93f7-76da34896f1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:47.719091 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 894/1783] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:25:46 2022] DELETE /identity/v3/projects/5f590875e3c34d77839d0c8a418a0216 => generated 0 bytes in 772 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:47.721833 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ff7f9-fe64-41a9-b154-403cfcf6bde5 service nova] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:47.733446 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ff7f9-fe64-41a9-b154-403cfcf6bde5 service nova] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:47.816921 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcff142-3bee-405f-8e38-2de7f90c369e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:47.816921 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcff142-3bee-405f-8e38-2de7f90c369e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:47.816921 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcff142-3bee-405f-8e38-2de7f90c369e admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:47.816921 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcff142-3bee-405f-8e38-2de7f90c369e admin admin] PATH_INFO: `/v3/users/453e1966193647f7a61a28fb46b4fdfe` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:47.817415 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcff142-3bee-405f-8e38-2de7f90c369e admin admin] RBAC: Authorizing `identity:delete_user(user_id=453e1966193647f7a61a28fb46b4fdfe)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:47.817415 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcff142-3bee-405f-8e38-2de7f90c369e admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:48.145455 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:48.159924 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-5fcff142-3bee-405f-8e38-2de7f90c369e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '453e1966193647f7a61a28fb46b4fdfe'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:48.328576 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-5fcff142-3bee-405f-8e38-2de7f90c369e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '453e1966193647f7a61a28fb46b4fdfe'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:48.330838 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-5fcff142-3bee-405f-8e38-2de7f90c369e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '453e1966193647f7a61a28fb46b4fdfe'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:48.331533 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-5fcff142-3bee-405f-8e38-2de7f90c369e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '453e1966193647f7a61a28fb46b4fdfe'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:48.346229 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-5fcff142-3bee-405f-8e38-2de7f90c369e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '453e1966193647f7a61a28fb46b4fdfe'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:48.364992 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 890/1784] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:25:47 2022] DELETE /identity/v3/users/453e1966193647f7a61a28fb46b4fdfe => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:49.171677 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1872ea-7edc-4c69-93f7-76da34896f1a admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:49.173711 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-ee1872ea-7edc-4c69-93f7-76da34896f1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:49.209111 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1872ea-7edc-4c69-93f7-76da34896f1a admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:49.265226 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0424f-8931-429a-8d0b-dd45dbd52452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:49.265942 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0424f-8931-429a-8d0b-dd45dbd52452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:49.266958 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0424f-8931-429a-8d0b-dd45dbd52452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:49.267241 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0424f-8931-429a-8d0b-dd45dbd52452 admin admin] PATH_INFO: `/v3/projects/8fc3e9a08325433694d26ebf505c0c57` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:49.268418 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b0424f-8931-429a-8d0b-dd45dbd52452 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fc3e9a08325433694d26ebf505c0c57)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:49.270340 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b0424f-8931-429a-8d0b-dd45dbd52452 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:49.627336 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-95b0424f-8931-429a-8d0b-dd45dbd52452 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fc3e9a08325433694d26ebf505c0c57', 'request_id': 'req-95b0424f-8931-429a-8d0b-dd45dbd52452'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:49.632780 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-95b0424f-8931-429a-8d0b-dd45dbd52452 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fc3e9a08325433694d26ebf505c0c57', 'request_id': 'req-95b0424f-8931-429a-8d0b-dd45dbd52452'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:49.638994 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-95b0424f-8931-429a-8d0b-dd45dbd52452 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fc3e9a08325433694d26ebf505c0c57', 'request_id': 'req-95b0424f-8931-429a-8d0b-dd45dbd52452'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:49.853122 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-95b0424f-8931-429a-8d0b-dd45dbd52452 admin admin] The token cache is being invalidate because project 8fc3e9a08325433694d26ebf505c0c57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:25:49.853399 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-95b0424f-8931-429a-8d0b-dd45dbd52452 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:49.853985 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-95b0424f-8931-429a-8d0b-dd45dbd52452 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:49.855751 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 895/1785] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:25:49 2022] DELETE /identity/v3/projects/8fc3e9a08325433694d26ebf505c0c57 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:25:49.859778 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcff142-3bee-405f-8e38-2de7f90c369e admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:49.861236 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-5fcff142-3bee-405f-8e38-2de7f90c369e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:49.874526 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcff142-3bee-405f-8e38-2de7f90c369e admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:49.929450 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad8638-838c-4d56-bf53-16ac2b960fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:49.930077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad8638-838c-4d56-bf53-16ac2b960fd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:49.930364 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad8638-838c-4d56-bf53-16ac2b960fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:49.930646 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad8638-838c-4d56-bf53-16ac2b960fd0 admin admin] PATH_INFO: `/v3/users/deccf9dfc00f414089342de8532f5fb1` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:49.931919 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad8638-838c-4d56-bf53-16ac2b960fd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=deccf9dfc00f414089342de8532f5fb1)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:49.933908 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad8638-838c-4d56-bf53-16ac2b960fd0 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:50.330039 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-19ad8638-838c-4d56-bf53-16ac2b960fd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deccf9dfc00f414089342de8532f5fb1'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:50.448350 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-19ad8638-838c-4d56-bf53-16ac2b960fd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deccf9dfc00f414089342de8532f5fb1'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:50.448969 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-19ad8638-838c-4d56-bf53-16ac2b960fd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deccf9dfc00f414089342de8532f5fb1'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:50.449584 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-19ad8638-838c-4d56-bf53-16ac2b960fd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deccf9dfc00f414089342de8532f5fb1'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:50.460242 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:50.466953 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-19ad8638-838c-4d56-bf53-16ac2b960fd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deccf9dfc00f414089342de8532f5fb1'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:50.476468 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 891/1786] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:25:49 2022] DELETE /identity/v3/users/deccf9dfc00f414089342de8532f5fb1 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:25:50.849216 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:52.219509 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0424f-8931-429a-8d0b-dd45dbd52452 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:52.221613 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-95b0424f-8931-429a-8d0b-dd45dbd52452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:52.236818 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0424f-8931-429a-8d0b-dd45dbd52452 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:52.319699 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14b77b-25b3-429e-958e-d7f3d825a26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:52.319699 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14b77b-25b3-429e-958e-d7f3d825a26b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:52.319699 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14b77b-25b3-429e-958e-d7f3d825a26b admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:52.319699 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14b77b-25b3-429e-958e-d7f3d825a26b admin admin] PATH_INFO: `/v3/projects/8c44ca44db684447a36675ef8205b0d3` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:52.321396 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a14b77b-25b3-429e-958e-d7f3d825a26b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c44ca44db684447a36675ef8205b0d3)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:52.323963 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a14b77b-25b3-429e-958e-d7f3d825a26b admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:52.600798 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-2a14b77b-25b3-429e-958e-d7f3d825a26b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c44ca44db684447a36675ef8205b0d3', 'request_id': 'req-2a14b77b-25b3-429e-958e-d7f3d825a26b'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:52.620307 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-2a14b77b-25b3-429e-958e-d7f3d825a26b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c44ca44db684447a36675ef8205b0d3', 'request_id': 'req-2a14b77b-25b3-429e-958e-d7f3d825a26b'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:52.637466 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-2a14b77b-25b3-429e-958e-d7f3d825a26b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c44ca44db684447a36675ef8205b0d3', 'request_id': 'req-2a14b77b-25b3-429e-958e-d7f3d825a26b'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:52.689039 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:52.744160 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-2a14b77b-25b3-429e-958e-d7f3d825a26b admin admin] The token cache is being invalidate because project 8c44ca44db684447a36675ef8205b0d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:25:52.744548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-2a14b77b-25b3-429e-958e-d7f3d825a26b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:52.745282 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-2a14b77b-25b3-429e-958e-d7f3d825a26b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:52.747053 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 896/1787] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:25:52 2022] DELETE /identity/v3/projects/8c44ca44db684447a36675ef8205b0d3 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:52.753184 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be10b62-60a8-45d9-aafa-00f550d43967 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:52.753974 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be10b62-60a8-45d9-aafa-00f550d43967 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:52.753974 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be10b62-60a8-45d9-aafa-00f550d43967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:52.773947 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-0be10b62-60a8-45d9-aafa-00f550d43967 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:52.775161 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-0be10b62-60a8-45d9-aafa-00f550d43967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:52.847217 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 892/1788] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:52.849065 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136b4e6-4480-43f6-97f7-b694c958c8a6 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:52.849468 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136b4e6-4480-43f6-97f7-b694c958c8a6 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:52.849851 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136b4e6-4480-43f6-97f7-b694c958c8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:52.873362 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-8136b4e6-4480-43f6-97f7-b694c958c8a6 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:52.875046 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-8136b4e6-4480-43f6-97f7-b694c958c8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:52.888907 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be10b62-60a8-45d9-aafa-00f550d43967 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:52.903646 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 897/1789] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:52.908765 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be10b62-60a8-45d9-aafa-00f550d43967 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:52.921145 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc867d80-3bce-40ef-9723-874b58225027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:52.922188 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc867d80-3bce-40ef-9723-874b58225027 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:52.923508 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc867d80-3bce-40ef-9723-874b58225027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:52.924236 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc867d80-3bce-40ef-9723-874b58225027 admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:52.925121 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc867d80-3bce-40ef-9723-874b58225027 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:25:52.925909 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc867d80-3bce-40ef-9723-874b58225027 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:52.927880 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc867d80-3bce-40ef-9723-874b58225027 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:52.943826 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 893/1790] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:25:52.948830 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136b4e6-4480-43f6-97f7-b694c958c8a6 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:52.970537 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136b4e6-4480-43f6-97f7-b694c958c8a6 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:52.983508 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa86ede-abcc-4928-9aaa-5f70a27783b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:52.984795 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa86ede-abcc-4928-9aaa-5f70a27783b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:52.985825 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa86ede-abcc-4928-9aaa-5f70a27783b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:52.986637 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa86ede-abcc-4928-9aaa-5f70a27783b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:52.987489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa86ede-abcc-4928-9aaa-5f70a27783b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:52.989609 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa86ede-abcc-4928-9aaa-5f70a27783b0 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:53.188965 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 898/1791] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:25:52 2022] POST /identity/v3/projects => generated 379 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:25:53.191448 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc867d80-3bce-40ef-9723-874b58225027 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:53.214298 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc867d80-3bce-40ef-9723-874b58225027 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:53.324635 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bfc278-8256-4c1c-b70b-103e273b80b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:53.327668 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfc278-8256-4c1c-b70b-103e273b80b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:53.327668 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfc278-8256-4c1c-b70b-103e273b80b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:53.327668 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfc278-8256-4c1c-b70b-103e273b80b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:53.327668 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bfc278-8256-4c1c-b70b-103e273b80b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:53.329811 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bfc278-8256-4c1c-b70b-103e273b80b2 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:53.526499 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 894/1792] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:25:53 2022] POST /identity/v3/users => generated 290 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:25:53.530221 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa86ede-abcc-4928-9aaa-5f70a27783b0 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:53.567821 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa86ede-abcc-4928-9aaa-5f70a27783b0 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:53.586499 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30fcd7-153b-41d8-b7eb-98a419523bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:53.587581 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30fcd7-153b-41d8-b7eb-98a419523bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:53.588158 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30fcd7-153b-41d8-b7eb-98a419523bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:53.589140 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30fcd7-153b-41d8-b7eb-98a419523bb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:53.592149 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30fcd7-153b-41d8-b7eb-98a419523bb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:53.594852 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30fcd7-153b-41d8-b7eb-98a419523bb3 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:53.614317 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 899/1793] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:25:53.617704 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bfc278-8256-4c1c-b70b-103e273b80b2 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:53.631719 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bfc278-8256-4c1c-b70b-103e273b80b2 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:53.644796 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c11fd3-1c6e-4eac-91c5-ba101033c1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:53.645443 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c11fd3-1c6e-4eac-91c5-ba101033c1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:53.645722 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c11fd3-1c6e-4eac-91c5-ba101033c1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:53.646005 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c11fd3-1c6e-4eac-91c5-ba101033c1f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:53.646864 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c11fd3-1c6e-4eac-91c5-ba101033c1f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:53.652663 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c11fd3-1c6e-4eac-91c5-ba101033c1f0 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:53.657381 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:53.670258 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 895/1794] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:25:53.675085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30fcd7-153b-41d8-b7eb-98a419523bb3 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:53.695726 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30fcd7-153b-41d8-b7eb-98a419523bb3 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:53.705829 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6075e-1d85-4905-9152-2e694f635bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:53.713797 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6075e-1d85-4905-9152-2e694f635bba admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:53.714367 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6075e-1d85-4905-9152-2e694f635bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:53.715038 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6075e-1d85-4905-9152-2e694f635bba admin admin] PATH_INFO: `/v3/projects/1a41bf3eac6f43fe8086e954ff60a2ee/users/763755c1d8844979bd637c97ea886eb5/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:53.760404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6075e-1d85-4905-9152-2e694f635bba admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a41bf3eac6f43fe8086e954ff60a2ee, user_id=763755c1d8844979bd637c97ea886eb5, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:53.764829 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6075e-1d85-4905-9152-2e694f635bba admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:53.904758 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 900/1795] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:25:53 2022] PUT /identity/v3/projects/1a41bf3eac6f43fe8086e954ff60a2ee/users/763755c1d8844979bd637c97ea886eb5/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:25:53.916532 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2295f1b-9069-48a9-8d05-02cada2cbab9 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:53.917127 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2295f1b-9069-48a9-8d05-02cada2cbab9 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:53.917127 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2295f1b-9069-48a9-8d05-02cada2cbab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:53.952771 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-a2295f1b-9069-48a9-8d05-02cada2cbab9 None None] MFA Rules not processed for user `763755c1d8844979bd637c97ea886eb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:53.954719 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-a2295f1b-9069-48a9-8d05-02cada2cbab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:54.084171 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 896/1796] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:54.088996 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6075e-1d85-4905-9152-2e694f635bba admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:54.175732 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6075e-1d85-4905-9152-2e694f635bba admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:54.176949 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f7f859-2038-4282-9217-1934ada495c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:54.177752 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7f859-2038-4282-9217-1934ada495c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:54.178191 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7f859-2038-4282-9217-1934ada495c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:54.178654 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7f859-2038-4282-9217-1934ada495c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:54.179544 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f7f859-2038-4282-9217-1934ada495c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:54.181733 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f7f859-2038-4282-9217-1934ada495c5 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:54.431005 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 901/1797] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:25:54 2022] POST /identity/v3/projects => generated 379 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:25:54.434329 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2295f1b-9069-48a9-8d05-02cada2cbab9 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:54.454896 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2295f1b-9069-48a9-8d05-02cada2cbab9 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:54.586609 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217d0b5-d0c8-4d87-ba35-bb0ecadbb944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:54.587987 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217d0b5-d0c8-4d87-ba35-bb0ecadbb944 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:54.588278 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217d0b5-d0c8-4d87-ba35-bb0ecadbb944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:54.588553 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217d0b5-d0c8-4d87-ba35-bb0ecadbb944 admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:54.589205 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c217d0b5-d0c8-4d87-ba35-bb0ecadbb944 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:54.591509 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c217d0b5-d0c8-4d87-ba35-bb0ecadbb944 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:54.765038 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 897/1798] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:25:54 2022] POST /identity/v3/users => generated 296 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:25:54.766600 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f7f859-2038-4282-9217-1934ada495c5 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:54.782904 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f7f859-2038-4282-9217-1934ada495c5 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:54.789210 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540bbc02-ddc8-468d-b306-5ef86e45e2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:54.790463 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540bbc02-ddc8-468d-b306-5ef86e45e2ea admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:54.790913 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540bbc02-ddc8-468d-b306-5ef86e45e2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:54.791430 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540bbc02-ddc8-468d-b306-5ef86e45e2ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:54.792659 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540bbc02-ddc8-468d-b306-5ef86e45e2ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:54.795081 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540bbc02-ddc8-468d-b306-5ef86e45e2ea admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:54.811493 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 902/1799] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:25:54.817231 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217d0b5-d0c8-4d87-ba35-bb0ecadbb944 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:54.838440 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217d0b5-d0c8-4d87-ba35-bb0ecadbb944 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:54.838440 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817d2f2-9e5c-4b22-aa51-55c6ec4d8285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:54.838819 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817d2f2-9e5c-4b22-aa51-55c6ec4d8285 admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:54.838929 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817d2f2-9e5c-4b22-aa51-55c6ec4d8285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:54.839210 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817d2f2-9e5c-4b22-aa51-55c6ec4d8285 admin admin] PATH_INFO: `/v3/projects/02a99413bf1840c5b76a044275f00be2/users/6538ffbe74b440deb33503b46c5af7e6/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:54.913459 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d817d2f2-9e5c-4b22-aa51-55c6ec4d8285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02a99413bf1840c5b76a044275f00be2, user_id=6538ffbe74b440deb33503b46c5af7e6, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:54.916322 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d817d2f2-9e5c-4b22-aa51-55c6ec4d8285 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:55.043147 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9d6eb-10f9-4270-b805-29bb36269fc2 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:55.046270 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9d6eb-10f9-4270-b805-29bb36269fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:55.046270 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9d6eb-10f9-4270-b805-29bb36269fc2 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:55.046270 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 903/1800] 10.222.0.23 () {54 vars in 921 bytes} [Mon Aug 8 02:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:25:55.050176 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 898/1801] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:25:54 2022] PUT /identity/v3/projects/02a99413bf1840c5b76a044275f00be2/users/6538ffbe74b440deb33503b46c5af7e6/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:55.054169 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9d6eb-10f9-4270-b805-29bb36269fc2 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:55.066506 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd57595-5f1a-48cd-9cf4-9f463b4225bc None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:55.066506 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd57595-5f1a-48cd-9cf4-9f463b4225bc None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:55.066506 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd57595-5f1a-48cd-9cf4-9f463b4225bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:55.112661 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-8cd57595-5f1a-48cd-9cf4-9f463b4225bc None None] MFA Rules not processed for user `5d89e0c7d62444e4b75d3f4da49b2bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:55.116559 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-8cd57595-5f1a-48cd-9cf4-9f463b4225bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:55.263080 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9d6eb-10f9-4270-b805-29bb36269fc2 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:55.285026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f93be0-73ef-4244-abc2-2f96cd9ed745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:55.298411 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f93be0-73ef-4244-abc2-2f96cd9ed745 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:55.298676 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f93be0-73ef-4244-abc2-2f96cd9ed745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:55.303534 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f93be0-73ef-4244-abc2-2f96cd9ed745 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:55.304179 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f93be0-73ef-4244-abc2-2f96cd9ed745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:55.307915 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f93be0-73ef-4244-abc2-2f96cd9ed745 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:55.327999 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 899/1802] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Aug 8 02:25:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:55.330229 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 904/1803] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:25:55.334320 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd57595-5f1a-48cd-9cf4-9f463b4225bc None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:55.343118 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f93be0-73ef-4244-abc2-2f96cd9ed745 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:55.345467 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-e7f93be0-73ef-4244-abc2-2f96cd9ed745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:55.348317 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd57595-5f1a-48cd-9cf4-9f463b4225bc None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:55.353883 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f51b87-e320-4ede-b006-d8c6cabe0385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:55.354558 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f51b87-e320-4ede-b006-d8c6cabe0385 admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:55.354844 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f51b87-e320-4ede-b006-d8c6cabe0385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:55.355265 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f51b87-e320-4ede-b006-d8c6cabe0385 admin admin] PATH_INFO: `/v3/projects/02a99413bf1840c5b76a044275f00be2/users/6538ffbe74b440deb33503b46c5af7e6/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:55.358901 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f51b87-e320-4ede-b006-d8c6cabe0385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02a99413bf1840c5b76a044275f00be2, user_id=6538ffbe74b440deb33503b46c5af7e6, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:55.362288 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f51b87-e320-4ede-b006-d8c6cabe0385 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:55.370790 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f93be0-73ef-4244-abc2-2f96cd9ed745 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:55.387415 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 900/1804] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:25:55 2022] PUT /identity/v3/projects/02a99413bf1840c5b76a044275f00be2/users/6538ffbe74b440deb33503b46c5af7e6/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:25:55.389091 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b1075-0a5c-430a-95c3-cbb805ceee33 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:55.389386 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b1075-0a5c-430a-95c3-cbb805ceee33 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:55.389671 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b1075-0a5c-430a-95c3-cbb805ceee33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:55.451857 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-9c5b1075-0a5c-430a-95c3-cbb805ceee33 None None] MFA Rules not processed for user `6538ffbe74b440deb33503b46c5af7e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:55.453574 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-9c5b1075-0a5c-430a-95c3-cbb805ceee33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:55.496941 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4f532-f2c6-47c4-bce4-4ae45a3c4b95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:55.497877 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4f532-f2c6-47c4-bce4-4ae45a3c4b95 service nova] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:55.498249 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4f532-f2c6-47c4-bce4-4ae45a3c4b95 service nova] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:55.499030 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4f532-f2c6-47c4-bce4-4ae45a3c4b95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:55.513806 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d4f532-f2c6-47c4-bce4-4ae45a3c4b95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:55.515941 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d4f532-f2c6-47c4-bce4-4ae45a3c4b95 service nova] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:55.530162 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 905/1805] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:25:55.548571 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 901/1806] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:55 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:55.559832 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4f532-f2c6-47c4-bce4-4ae45a3c4b95 service nova] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:55.561392 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-b8d4f532-f2c6-47c4-bce4-4ae45a3c4b95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:55.624935 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4f532-f2c6-47c4-bce4-4ae45a3c4b95 service nova] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:55.629324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28632c83-f95b-4e9a-91e7-f18dbcd18bad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:55.630208 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28632c83-f95b-4e9a-91e7-f18dbcd18bad service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:55.630500 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28632c83-f95b-4e9a-91e7-f18dbcd18bad service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:55.630769 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28632c83-f95b-4e9a-91e7-f18dbcd18bad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:55.642040 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28632c83-f95b-4e9a-91e7-f18dbcd18bad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:55.643477 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28632c83-f95b-4e9a-91e7-f18dbcd18bad service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:55.671333 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 906/1807] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:55 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:25:56.485402 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b1075-0a5c-430a-95c3-cbb805ceee33 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:56.574423 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b1075-0a5c-430a-95c3-cbb805ceee33 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:56.580934 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f3336-a9e8-4025-b9a0-7c0a7a1fd11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:56.581956 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f3336-a9e8-4025-b9a0-7c0a7a1fd11d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:56.582489 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f3336-a9e8-4025-b9a0-7c0a7a1fd11d admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:56.583662 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f3336-a9e8-4025-b9a0-7c0a7a1fd11d admin admin] PATH_INFO: `/v3/users/763755c1d8844979bd637c97ea886eb5` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:56.585127 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f3336-a9e8-4025-b9a0-7c0a7a1fd11d admin admin] RBAC: Authorizing `identity:delete_user(user_id=763755c1d8844979bd637c97ea886eb5)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:56.587641 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f3336-a9e8-4025-b9a0-7c0a7a1fd11d admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:56.828646 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-5f1f3336-a9e8-4025-b9a0-7c0a7a1fd11d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '763755c1d8844979bd637c97ea886eb5'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:56.955711 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-5f1f3336-a9e8-4025-b9a0-7c0a7a1fd11d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '763755c1d8844979bd637c97ea886eb5'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:56.956923 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-5f1f3336-a9e8-4025-b9a0-7c0a7a1fd11d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '763755c1d8844979bd637c97ea886eb5'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:56.957585 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-5f1f3336-a9e8-4025-b9a0-7c0a7a1fd11d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '763755c1d8844979bd637c97ea886eb5'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:56.975276 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-5f1f3336-a9e8-4025-b9a0-7c0a7a1fd11d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '763755c1d8844979bd637c97ea886eb5'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:57.003242 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 902/1808] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:25:56 2022] DELETE /identity/v3/users/763755c1d8844979bd637c97ea886eb5 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:57.005653 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc8161-9d36-45e2-a6a9-0efbe01e85c0 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:57.006074 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc8161-9d36-45e2-a6a9-0efbe01e85c0 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:57.006313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc8161-9d36-45e2-a6a9-0efbe01e85c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:57.039126 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-f4fc8161-9d36-45e2-a6a9-0efbe01e85c0 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:25:57.039126 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-f4fc8161-9d36-45e2-a6a9-0efbe01e85c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:57.121870 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 907/1809] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:25:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:25:57.132857 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f3336-a9e8-4025-b9a0-7c0a7a1fd11d admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:57.134506 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-5f1f3336-a9e8-4025-b9a0-7c0a7a1fd11d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:57.190326 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f3336-a9e8-4025-b9a0-7c0a7a1fd11d admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:57.193976 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faac452-6616-4bd5-84b0-9473d2e12cc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:57.194557 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faac452-6616-4bd5-84b0-9473d2e12cc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:57.194839 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faac452-6616-4bd5-84b0-9473d2e12cc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:57.195137 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faac452-6616-4bd5-84b0-9473d2e12cc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:57.218699 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faac452-6616-4bd5-84b0-9473d2e12cc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:57.221490 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faac452-6616-4bd5-84b0-9473d2e12cc9 service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:57.236887 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 903/1810] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:25:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:25:57.759562 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc8161-9d36-45e2-a6a9-0efbe01e85c0 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:57.761259 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-f4fc8161-9d36-45e2-a6a9-0efbe01e85c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:57.783746 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc8161-9d36-45e2-a6a9-0efbe01e85c0 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:57.796327 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a443218-0a0e-48da-810c-c1bbab0bb36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:57.796961 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a443218-0a0e-48da-810c-c1bbab0bb36c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:57.797247 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a443218-0a0e-48da-810c-c1bbab0bb36c admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:57.798108 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a443218-0a0e-48da-810c-c1bbab0bb36c admin admin] PATH_INFO: `/v3/projects/1a41bf3eac6f43fe8086e954ff60a2ee` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:57.799445 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a443218-0a0e-48da-810c-c1bbab0bb36c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a41bf3eac6f43fe8086e954ff60a2ee)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:57.801341 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a443218-0a0e-48da-810c-c1bbab0bb36c admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:57.964586 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-3a443218-0a0e-48da-810c-c1bbab0bb36c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a41bf3eac6f43fe8086e954ff60a2ee', 'request_id': 'req-3a443218-0a0e-48da-810c-c1bbab0bb36c'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:57.970911 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-3a443218-0a0e-48da-810c-c1bbab0bb36c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a41bf3eac6f43fe8086e954ff60a2ee', 'request_id': 'req-3a443218-0a0e-48da-810c-c1bbab0bb36c'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:57.978709 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-3a443218-0a0e-48da-810c-c1bbab0bb36c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a41bf3eac6f43fe8086e954ff60a2ee', 'request_id': 'req-3a443218-0a0e-48da-810c-c1bbab0bb36c'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:58.070889 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-3a443218-0a0e-48da-810c-c1bbab0bb36c admin admin] The token cache is being invalidate because project 1a41bf3eac6f43fe8086e954ff60a2ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:25:58.071548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-3a443218-0a0e-48da-810c-c1bbab0bb36c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:58.071875 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-3a443218-0a0e-48da-810c-c1bbab0bb36c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:58.073435 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 908/1811] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:25:57 2022] DELETE /identity/v3/projects/1a41bf3eac6f43fe8086e954ff60a2ee => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:58.077409 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faac452-6616-4bd5-84b0-9473d2e12cc9 service neutron] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:58.092045 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faac452-6616-4bd5-84b0-9473d2e12cc9 service neutron] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:58.181248 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f71bd51-5dad-4170-a701-4adc1bb3ddd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:58.182641 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71bd51-5dad-4170-a701-4adc1bb3ddd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:58.183024 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71bd51-5dad-4170-a701-4adc1bb3ddd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:58.183476 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71bd51-5dad-4170-a701-4adc1bb3ddd6 admin admin] PATH_INFO: `/v3/users/6538ffbe74b440deb33503b46c5af7e6` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:58.185069 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f71bd51-5dad-4170-a701-4adc1bb3ddd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6538ffbe74b440deb33503b46c5af7e6)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:58.187261 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f71bd51-5dad-4170-a701-4adc1bb3ddd6 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:58.474185 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-3f71bd51-5dad-4170-a701-4adc1bb3ddd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6538ffbe74b440deb33503b46c5af7e6'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:58.549210 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-3f71bd51-5dad-4170-a701-4adc1bb3ddd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6538ffbe74b440deb33503b46c5af7e6'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:58.550092 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-3f71bd51-5dad-4170-a701-4adc1bb3ddd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6538ffbe74b440deb33503b46c5af7e6'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:58.550935 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-3f71bd51-5dad-4170-a701-4adc1bb3ddd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6538ffbe74b440deb33503b46c5af7e6'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:58.576955 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-3f71bd51-5dad-4170-a701-4adc1bb3ddd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6538ffbe74b440deb33503b46c5af7e6'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:58.602774 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 904/1812] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:25:58 2022] DELETE /identity/v3/users/6538ffbe74b440deb33503b46c5af7e6 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:25:58.620502 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:58.970451 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:59.533913 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a443218-0a0e-48da-810c-c1bbab0bb36c admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:59.536466 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-3a443218-0a0e-48da-810c-c1bbab0bb36c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:59.540767 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f71bd51-5dad-4170-a701-4adc1bb3ddd6 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:25:59.542162 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-3f71bd51-5dad-4170-a701-4adc1bb3ddd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:25:59.550860 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a443218-0a0e-48da-810c-c1bbab0bb36c admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:59.608946 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f71bd51-5dad-4170-a701-4adc1bb3ddd6 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:25:59.610941 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82126d-6d94-4c95-a2ef-6e03c79e0c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:59.611609 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82126d-6d94-4c95-a2ef-6e03c79e0c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:59.611894 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82126d-6d94-4c95-a2ef-6e03c79e0c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:59.612171 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82126d-6d94-4c95-a2ef-6e03c79e0c08 admin admin] PATH_INFO: `/v3/projects/02a99413bf1840c5b76a044275f00be2` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:59.613265 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82126d-6d94-4c95-a2ef-6e03c79e0c08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02a99413bf1840c5b76a044275f00be2)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:59.613568 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b40fe-21f4-4e7b-8dd4-1123212040e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:25:59.614192 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b40fe-21f4-4e7b-8dd4-1123212040e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:25:59.614479 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b40fe-21f4-4e7b-8dd4-1123212040e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:25:59.614759 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b40fe-21f4-4e7b-8dd4-1123212040e7 admin admin] PATH_INFO: `/v3/users/3e3a36d437db4d51b7aa7e92bb039f99` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:25:59.615194 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82126d-6d94-4c95-a2ef-6e03c79e0c08 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:59.615930 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b40fe-21f4-4e7b-8dd4-1123212040e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e3a36d437db4d51b7aa7e92bb039f99)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:25:59.617858 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b40fe-21f4-4e7b-8dd4-1123212040e7 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:25:59.855133 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-fe9b40fe-21f4-4e7b-8dd4-1123212040e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e3a36d437db4d51b7aa7e92bb039f99'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:59.856291 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-ae82126d-6d94-4c95-a2ef-6e03c79e0c08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02a99413bf1840c5b76a044275f00be2', 'request_id': 'req-ae82126d-6d94-4c95-a2ef-6e03c79e0c08'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:59.864162 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-ae82126d-6d94-4c95-a2ef-6e03c79e0c08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02a99413bf1840c5b76a044275f00be2', 'request_id': 'req-ae82126d-6d94-4c95-a2ef-6e03c79e0c08'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:59.871897 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-ae82126d-6d94-4c95-a2ef-6e03c79e0c08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02a99413bf1840c5b76a044275f00be2', 'request_id': 'req-ae82126d-6d94-4c95-a2ef-6e03c79e0c08'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:59.974361 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-fe9b40fe-21f4-4e7b-8dd4-1123212040e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e3a36d437db4d51b7aa7e92bb039f99'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:59.974935 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-fe9b40fe-21f4-4e7b-8dd4-1123212040e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e3a36d437db4d51b7aa7e92bb039f99'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:59.975566 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-fe9b40fe-21f4-4e7b-8dd4-1123212040e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e3a36d437db4d51b7aa7e92bb039f99'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:25:59.988641 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-fe9b40fe-21f4-4e7b-8dd4-1123212040e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e3a36d437db4d51b7aa7e92bb039f99'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:00.002032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 905/1813] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:25:59 2022] DELETE /identity/v3/users/3e3a36d437db4d51b7aa7e92bb039f99 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:26:00.008977 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3499427-6f4d-4a31-b219-f3a30f94c26d None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:00.008977 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3499427-6f4d-4a31-b219-f3a30f94c26d None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:00.008977 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3499427-6f4d-4a31-b219-f3a30f94c26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:00.033074 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-f3499427-6f4d-4a31-b219-f3a30f94c26d None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:00.033619 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-f3499427-6f4d-4a31-b219-f3a30f94c26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:00.042084 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-ae82126d-6d94-4c95-a2ef-6e03c79e0c08 admin admin] The token cache is being invalidate because project 02a99413bf1840c5b76a044275f00be2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:26:00.042377 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-ae82126d-6d94-4c95-a2ef-6e03c79e0c08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:00.045621 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-ae82126d-6d94-4c95-a2ef-6e03c79e0c08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:00.047580 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 909/1814] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:25:59 2022] DELETE /identity/v3/projects/02a99413bf1840c5b76a044275f00be2 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:00.053188 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35fd1a1-1b96-4cac-b2c5-8abe673475d2 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:00.054141 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35fd1a1-1b96-4cac-b2c5-8abe673475d2 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:00.054413 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35fd1a1-1b96-4cac-b2c5-8abe673475d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:00.074261 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-c35fd1a1-1b96-4cac-b2c5-8abe673475d2 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:00.075577 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-c35fd1a1-1b96-4cac-b2c5-8abe673475d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:00.106419 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 906/1815] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:00.117698 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3499427-6f4d-4a31-b219-f3a30f94c26d None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:00.119139 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-f3499427-6f4d-4a31-b219-f3a30f94c26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:00.149756 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 910/1816] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:00.158418 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b66ba-10f7-4538-b269-704bc0229c16 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:00.158708 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b66ba-10f7-4538-b269-704bc0229c16 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:00.158988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b66ba-10f7-4538-b269-704bc0229c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:00.193342 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-df5b66ba-10f7-4538-b269-704bc0229c16 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:00.195927 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-df5b66ba-10f7-4538-b269-704bc0229c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:00.206698 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 911/1817] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:26:00.210798 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b66ba-10f7-4538-b269-704bc0229c16 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:00.221028 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b66ba-10f7-4538-b269-704bc0229c16 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:00.225741 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3499427-6f4d-4a31-b219-f3a30f94c26d None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:00.226731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b1a6c-3936-46db-9dba-185b62894018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:00.227962 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b1a6c-3936-46db-9dba-185b62894018 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:00.228504 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b1a6c-3936-46db-9dba-185b62894018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:00.229058 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b1a6c-3936-46db-9dba-185b62894018 admin admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:00.229604 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16473159-3245-4081-a17a-d845546a33ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:00.230141 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52b1a6c-3936-46db-9dba-185b62894018 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:26:00.230351 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16473159-3245-4081-a17a-d845546a33ae service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:00.230510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16473159-3245-4081-a17a-d845546a33ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:00.230759 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16473159-3245-4081-a17a-d845546a33ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:00.231259 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52b1a6c-3936-46db-9dba-185b62894018 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:00.233266 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52b1a6c-3936-46db-9dba-185b62894018 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:00.241846 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16473159-3245-4081-a17a-d845546a33ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:00.242978 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16473159-3245-4081-a17a-d845546a33ae service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:00.249761 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 912/1818] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:26:00.257009 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b1a6c-3936-46db-9dba-185b62894018 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:00.264787 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 907/1819] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:26:00.274275 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b1a6c-3936-46db-9dba-185b62894018 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:00.279939 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d08d3-a554-47c8-89b3-9f286b9d6505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:00.280831 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d08d3-a554-47c8-89b3-9f286b9d6505 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:00.281278 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d08d3-a554-47c8-89b3-9f286b9d6505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:00.281566 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d08d3-a554-47c8-89b3-9f286b9d6505 admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:00.282555 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d08d3-a554-47c8-89b3-9f286b9d6505 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:00.284699 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d08d3-a554-47c8-89b3-9f286b9d6505 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:00.493137 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 913/1820] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:26:00 2022] POST /identity/v3/projects => generated 371 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:26:00.494205 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16473159-3245-4081-a17a-d845546a33ae service neutron] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:00.506909 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16473159-3245-4081-a17a-d845546a33ae service neutron] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:00.600998 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668e731-24a0-491e-b701-80a5b7663708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:00.602542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668e731-24a0-491e-b701-80a5b7663708 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:00.603059 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668e731-24a0-491e-b701-80a5b7663708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:00.603614 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668e731-24a0-491e-b701-80a5b7663708 admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:00.604334 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0668e731-24a0-491e-b701-80a5b7663708 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:00.606661 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0668e731-24a0-491e-b701-80a5b7663708 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:00.725428 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 908/1821] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:26:00 2022] POST /identity/v3/users => generated 286 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:26:00.730256 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d08d3-a554-47c8-89b3-9f286b9d6505 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:00.752771 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d08d3-a554-47c8-89b3-9f286b9d6505 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:00.771763 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917fe25-1542-4917-b011-ff1d6a81a1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:00.772429 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917fe25-1542-4917-b011-ff1d6a81a1a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:00.772659 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917fe25-1542-4917-b011-ff1d6a81a1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:00.772938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917fe25-1542-4917-b011-ff1d6a81a1a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:00.773588 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d917fe25-1542-4917-b011-ff1d6a81a1a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:00.778986 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d917fe25-1542-4917-b011-ff1d6a81a1a5 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:00.800526 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 914/1822] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:26:00.802049 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668e731-24a0-491e-b701-80a5b7663708 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:00.818335 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668e731-24a0-491e-b701-80a5b7663708 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:00.836170 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e942b-7702-45c9-ab5e-173b42c99c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:00.836857 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e942b-7702-45c9-ab5e-173b42c99c44 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:00.837230 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e942b-7702-45c9-ab5e-173b42c99c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:00.837916 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e942b-7702-45c9-ab5e-173b42c99c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:00.838585 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e942b-7702-45c9-ab5e-173b42c99c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:00.840726 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e942b-7702-45c9-ab5e-173b42c99c44 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:00.866122 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 909/1823] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:26:00.868245 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917fe25-1542-4917-b011-ff1d6a81a1a5 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:00.881093 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917fe25-1542-4917-b011-ff1d6a81a1a5 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:00.891269 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e942b-7702-45c9-ab5e-173b42c99c44 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:00.893196 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-ab6e942b-7702-45c9-ab5e-173b42c99c44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:00.895589 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce3d48-c171-4138-9f1a-f690b05e23f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:00.896521 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce3d48-c171-4138-9f1a-f690b05e23f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:00.897011 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce3d48-c171-4138-9f1a-f690b05e23f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:00.897500 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce3d48-c171-4138-9f1a-f690b05e23f5 admin admin] PATH_INFO: `/v3/projects/f5849ce2aca04f15bcd9a99f517dcb6f/users/c94045a5bb0848b3a168917d81ee56b2/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:00.911527 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e942b-7702-45c9-ab5e-173b42c99c44 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:00.918178 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607a2f7-a95d-46a1-b159-ea94cf20a7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:00.918816 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607a2f7-a95d-46a1-b159-ea94cf20a7b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:00.919403 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607a2f7-a95d-46a1-b159-ea94cf20a7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:00.919692 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607a2f7-a95d-46a1-b159-ea94cf20a7b6 admin admin] PATH_INFO: `/v3/projects/98b047e2e4424debb3881da0c9a7a28f` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:00.920873 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5607a2f7-a95d-46a1-b159-ea94cf20a7b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98b047e2e4424debb3881da0c9a7a28f)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:00.921624 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce3d48-c171-4138-9f1a-f690b05e23f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5849ce2aca04f15bcd9a99f517dcb6f, user_id=c94045a5bb0848b3a168917d81ee56b2, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:00.928063 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5607a2f7-a95d-46a1-b159-ea94cf20a7b6 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:00.928860 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce3d48-c171-4138-9f1a-f690b05e23f5 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:01.026174 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 915/1824] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:26:00 2022] PUT /identity/v3/projects/f5849ce2aca04f15bcd9a99f517dcb6f/users/c94045a5bb0848b3a168917d81ee56b2/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:01.026174 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce3d48-c171-4138-9f1a-f690b05e23f5 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:01.037812 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-8bce3d48-c171-4138-9f1a-f690b05e23f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:01.103918 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce3d48-c171-4138-9f1a-f690b05e23f5 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:01.108765 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37681c3f-c155-4d85-bf1f-12fd34b35824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:01.109395 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37681c3f-c155-4d85-bf1f-12fd34b35824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:01.109681 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37681c3f-c155-4d85-bf1f-12fd34b35824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:01.110484 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37681c3f-c155-4d85-bf1f-12fd34b35824 admin admin] PATH_INFO: `/v3/users/1fa75cc084344a7aaa28848c6f1b4c5a` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:01.111699 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37681c3f-c155-4d85-bf1f-12fd34b35824 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fa75cc084344a7aaa28848c6f1b4c5a)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:01.113614 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37681c3f-c155-4d85-bf1f-12fd34b35824 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:01.136167 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-5607a2f7-a95d-46a1-b159-ea94cf20a7b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98b047e2e4424debb3881da0c9a7a28f', 'request_id': 'req-5607a2f7-a95d-46a1-b159-ea94cf20a7b6'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:01.142424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-5607a2f7-a95d-46a1-b159-ea94cf20a7b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98b047e2e4424debb3881da0c9a7a28f', 'request_id': 'req-5607a2f7-a95d-46a1-b159-ea94cf20a7b6'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:01.149179 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-5607a2f7-a95d-46a1-b159-ea94cf20a7b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98b047e2e4424debb3881da0c9a7a28f', 'request_id': 'req-5607a2f7-a95d-46a1-b159-ea94cf20a7b6'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:01.270961 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-5607a2f7-a95d-46a1-b159-ea94cf20a7b6 admin admin] The token cache is being invalidate because project 98b047e2e4424debb3881da0c9a7a28f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:26:01.271172 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-5607a2f7-a95d-46a1-b159-ea94cf20a7b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:01.271852 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-5607a2f7-a95d-46a1-b159-ea94cf20a7b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:01.273366 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 910/1825] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:26:00 2022] DELETE /identity/v3/projects/98b047e2e4424debb3881da0c9a7a28f => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:01.274548 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71c7a6-3e2d-488b-b31c-0ae2c6f6093a None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:01.274833 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71c7a6-3e2d-488b-b31c-0ae2c6f6093a None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:01.275111 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71c7a6-3e2d-488b-b31c-0ae2c6f6093a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:01.293296 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-bb71c7a6-3e2d-488b-b31c-0ae2c6f6093a None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:01.294482 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-bb71c7a6-3e2d-488b-b31c-0ae2c6f6093a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:01.334881 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-37681c3f-c155-4d85-bf1f-12fd34b35824 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fa75cc084344a7aaa28848c6f1b4c5a'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:01.351651 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 911/1826] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:01.352724 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71c7a6-3e2d-488b-b31c-0ae2c6f6093a None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:01.354036 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-bb71c7a6-3e2d-488b-b31c-0ae2c6f6093a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:01.366513 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71c7a6-3e2d-488b-b31c-0ae2c6f6093a None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:01.377761 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75910bfe-84d7-46f1-8724-28ffc9d168f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:01.378517 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75910bfe-84d7-46f1-8724-28ffc9d168f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:01.378702 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75910bfe-84d7-46f1-8724-28ffc9d168f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:01.378947 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75910bfe-84d7-46f1-8724-28ffc9d168f6 admin admin] PATH_INFO: `/v3/users/f5698d580535496bb41cef418c34353b` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:01.380312 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75910bfe-84d7-46f1-8724-28ffc9d168f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5698d580535496bb41cef418c34353b)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:01.383287 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75910bfe-84d7-46f1-8724-28ffc9d168f6 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:01.417550 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-37681c3f-c155-4d85-bf1f-12fd34b35824 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fa75cc084344a7aaa28848c6f1b4c5a'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:01.418210 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-37681c3f-c155-4d85-bf1f-12fd34b35824 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fa75cc084344a7aaa28848c6f1b4c5a'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:01.430656 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-37681c3f-c155-4d85-bf1f-12fd34b35824 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fa75cc084344a7aaa28848c6f1b4c5a'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:01.437507 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-37681c3f-c155-4d85-bf1f-12fd34b35824 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fa75cc084344a7aaa28848c6f1b4c5a'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:01.444312 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 916/1827] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:26:01 2022] DELETE /identity/v3/users/1fa75cc084344a7aaa28848c6f1b4c5a => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:01.445041 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37681c3f-c155-4d85-bf1f-12fd34b35824 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:01.446404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-37681c3f-c155-4d85-bf1f-12fd34b35824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:01.505844 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37681c3f-c155-4d85-bf1f-12fd34b35824 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:01.510287 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e16db0-22fb-4ba0-bec1-699c6b887ca3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:01.512610 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e16db0-22fb-4ba0-bec1-699c6b887ca3 service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:01.512903 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e16db0-22fb-4ba0-bec1-699c6b887ca3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:01.513183 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e16db0-22fb-4ba0-bec1-699c6b887ca3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:01.516878 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-44e16db0-22fb-4ba0-bec1-699c6b887ca3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:01.598609 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e16db0-22fb-4ba0-bec1-699c6b887ca3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:01.600101 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e16db0-22fb-4ba0-bec1-699c6b887ca3 service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:01.611239 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 917/1828] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:26:01.614909 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f6dc3-f7a8-4094-bec4-2bf3820068f7 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:01.614909 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f6dc3-f7a8-4094-bec4-2bf3820068f7 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:01.614909 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f6dc3-f7a8-4094-bec4-2bf3820068f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:01.633728 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-cd9f6dc3-f7a8-4094-bec4-2bf3820068f7 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:01.635003 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-cd9f6dc3-f7a8-4094-bec4-2bf3820068f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:01.645266 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 918/1829] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:01.662248 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f6dc3-f7a8-4094-bec4-2bf3820068f7 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:01.664841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-75910bfe-84d7-46f1-8724-28ffc9d168f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5698d580535496bb41cef418c34353b'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:01.674051 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f6dc3-f7a8-4094-bec4-2bf3820068f7 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:01.677725 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7caa5e9-affc-40fc-b8e3-bad70b204e55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:01.678331 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7caa5e9-affc-40fc-b8e3-bad70b204e55 service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:01.678614 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7caa5e9-affc-40fc-b8e3-bad70b204e55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:01.678913 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7caa5e9-affc-40fc-b8e3-bad70b204e55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:01.688047 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7caa5e9-affc-40fc-b8e3-bad70b204e55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:01.692593 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7caa5e9-affc-40fc-b8e3-bad70b204e55 service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:01.699240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 919/1830] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:26:01.746155 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-75910bfe-84d7-46f1-8724-28ffc9d168f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5698d580535496bb41cef418c34353b'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:01.746875 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-75910bfe-84d7-46f1-8724-28ffc9d168f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5698d580535496bb41cef418c34353b'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:01.747796 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-75910bfe-84d7-46f1-8724-28ffc9d168f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5698d580535496bb41cef418c34353b'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:01.767244 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-75910bfe-84d7-46f1-8724-28ffc9d168f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5698d580535496bb41cef418c34353b'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:01.790335 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 912/1831] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:26:01 2022] DELETE /identity/v3/users/f5698d580535496bb41cef418c34353b => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:02.494588 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7caa5e9-affc-40fc-b8e3-bad70b204e55 service neutron] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:02.496036 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-d7caa5e9-affc-40fc-b8e3-bad70b204e55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:02.510707 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7caa5e9-affc-40fc-b8e3-bad70b204e55 service neutron] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:02.560213 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75910bfe-84d7-46f1-8724-28ffc9d168f6 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:02.562429 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-75910bfe-84d7-46f1-8724-28ffc9d168f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:02.578872 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db970d10-516b-48e4-a303-ad169c2b0528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:02.580069 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db970d10-516b-48e4-a303-ad169c2b0528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:02.582590 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db970d10-516b-48e4-a303-ad169c2b0528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:02.582590 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db970d10-516b-48e4-a303-ad169c2b0528 admin admin] PATH_INFO: `/v3/projects/5bd684389eb240418bb4e7a3ff6bb41a` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:02.582590 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db970d10-516b-48e4-a303-ad169c2b0528 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bd684389eb240418bb4e7a3ff6bb41a)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:02.584217 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db970d10-516b-48e4-a303-ad169c2b0528 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:02.697577 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75910bfe-84d7-46f1-8724-28ffc9d168f6 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:02.716071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b1809-1d62-4782-8822-ada7c2682468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:02.717559 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b1809-1d62-4782-8822-ada7c2682468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:02.721645 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b1809-1d62-4782-8822-ada7c2682468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:02.721645 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b1809-1d62-4782-8822-ada7c2682468 admin admin] PATH_INFO: `/v3/projects/d678d069607a4a268cc284e2643e179c` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:02.721645 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b1809-1d62-4782-8822-ada7c2682468 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d678d069607a4a268cc284e2643e179c)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:02.723204 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b1809-1d62-4782-8822-ada7c2682468 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:02.787762 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-db970d10-516b-48e4-a303-ad169c2b0528 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bd684389eb240418bb4e7a3ff6bb41a', 'request_id': 'req-db970d10-516b-48e4-a303-ad169c2b0528'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:02.801127 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-db970d10-516b-48e4-a303-ad169c2b0528 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bd684389eb240418bb4e7a3ff6bb41a', 'request_id': 'req-db970d10-516b-48e4-a303-ad169c2b0528'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:02.815317 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-db970d10-516b-48e4-a303-ad169c2b0528 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bd684389eb240418bb4e7a3ff6bb41a', 'request_id': 'req-db970d10-516b-48e4-a303-ad169c2b0528'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:02.918625 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-389b1809-1d62-4782-8822-ada7c2682468 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd678d069607a4a268cc284e2643e179c', 'request_id': 'req-389b1809-1d62-4782-8822-ada7c2682468'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:02.923993 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-389b1809-1d62-4782-8822-ada7c2682468 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd678d069607a4a268cc284e2643e179c', 'request_id': 'req-389b1809-1d62-4782-8822-ada7c2682468'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:02.930270 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-389b1809-1d62-4782-8822-ada7c2682468 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd678d069607a4a268cc284e2643e179c', 'request_id': 'req-389b1809-1d62-4782-8822-ada7c2682468'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:02.959925 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-db970d10-516b-48e4-a303-ad169c2b0528 admin admin] The token cache is being invalidate because project 5bd684389eb240418bb4e7a3ff6bb41a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:26:02.959925 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-db970d10-516b-48e4-a303-ad169c2b0528 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:02.959925 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-db970d10-516b-48e4-a303-ad169c2b0528 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:02.959925 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 920/1832] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:26:02 2022] DELETE /identity/v3/projects/5bd684389eb240418bb4e7a3ff6bb41a => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:02.960677 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db970d10-516b-48e4-a303-ad169c2b0528 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:02.962312 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-db970d10-516b-48e4-a303-ad169c2b0528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:03.055090 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db970d10-516b-48e4-a303-ad169c2b0528 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:03.055370 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-389b1809-1d62-4782-8822-ada7c2682468 admin admin] The token cache is being invalidate because project d678d069607a4a268cc284e2643e179c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:26:03.055370 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-389b1809-1d62-4782-8822-ada7c2682468 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:03.056130 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-389b1809-1d62-4782-8822-ada7c2682468 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:03.058464 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 913/1833] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:26:02 2022] DELETE /identity/v3/projects/d678d069607a4a268cc284e2643e179c => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:26:03.063453 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c406b3-de05-4129-9f1d-b169d28f9199 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:03.064012 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c406b3-de05-4129-9f1d-b169d28f9199 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:03.064502 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c406b3-de05-4129-9f1d-b169d28f9199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:03.115596 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-a5c406b3-de05-4129-9f1d-b169d28f9199 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:03.117227 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-a5c406b3-de05-4129-9f1d-b169d28f9199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:03.171179 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fcb31e-ebe5-4490-bcdd-82c32522ce5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:03.171872 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcb31e-ebe5-4490-bcdd-82c32522ce5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:03.172173 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcb31e-ebe5-4490-bcdd-82c32522ce5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:03.172466 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcb31e-ebe5-4490-bcdd-82c32522ce5b admin admin] PATH_INFO: `/v3/users/ce55551fb0714dfe9ba9beb38eec6d30` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:03.174287 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fcb31e-ebe5-4490-bcdd-82c32522ce5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce55551fb0714dfe9ba9beb38eec6d30)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:03.177296 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fcb31e-ebe5-4490-bcdd-82c32522ce5b admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:03.193223 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 914/1834] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:03.215579 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:03.215689 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e473588-84da-4934-bc49-7321cc89b89a None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:03.215689 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e473588-84da-4934-bc49-7321cc89b89a None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:03.215689 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e473588-84da-4934-bc49-7321cc89b89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:03.252738 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-3e473588-84da-4934-bc49-7321cc89b89a None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:03.254657 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-3e473588-84da-4934-bc49-7321cc89b89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:03.266098 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 915/1835] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:03.270436 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e473588-84da-4934-bc49-7321cc89b89a None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:03.281851 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e473588-84da-4934-bc49-7321cc89b89a None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:03.287830 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abacf8a3-d62a-4f16-99cd-2de7c2b931a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:03.289721 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abacf8a3-d62a-4f16-99cd-2de7c2b931a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:03.290331 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abacf8a3-d62a-4f16-99cd-2de7c2b931a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:03.290934 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abacf8a3-d62a-4f16-99cd-2de7c2b931a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:03.292008 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abacf8a3-d62a-4f16-99cd-2de7c2b931a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:26:03.292883 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abacf8a3-d62a-4f16-99cd-2de7c2b931a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:03.294631 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abacf8a3-d62a-4f16-99cd-2de7c2b931a4 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:03.322856 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 916/1836] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:26:03.323916 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abacf8a3-d62a-4f16-99cd-2de7c2b931a4 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:03.356110 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abacf8a3-d62a-4f16-99cd-2de7c2b931a4 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:03.375096 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f467066-d4fe-45c0-b0a3-2312b5668c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:03.376584 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f467066-d4fe-45c0-b0a3-2312b5668c40 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:03.376874 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f467066-d4fe-45c0-b0a3-2312b5668c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:03.383861 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f467066-d4fe-45c0-b0a3-2312b5668c40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:03.393647 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f467066-d4fe-45c0-b0a3-2312b5668c40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:03.395099 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f467066-d4fe-45c0-b0a3-2312b5668c40 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:03.521021 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c5fcb31e-ebe5-4490-bcdd-82c32522ce5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce55551fb0714dfe9ba9beb38eec6d30'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:03.551747 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 917/1837] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:26:03 2022] POST /identity/v3/projects => generated 357 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:26:03.552853 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f467066-d4fe-45c0-b0a3-2312b5668c40 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:03.609436 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c5fcb31e-ebe5-4490-bcdd-82c32522ce5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce55551fb0714dfe9ba9beb38eec6d30'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:03.611178 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c5fcb31e-ebe5-4490-bcdd-82c32522ce5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce55551fb0714dfe9ba9beb38eec6d30'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:03.633756 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c5fcb31e-ebe5-4490-bcdd-82c32522ce5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce55551fb0714dfe9ba9beb38eec6d30'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:03.637260 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f467066-d4fe-45c0-b0a3-2312b5668c40 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:03.641890 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc123b-feab-486e-a0df-bbff8400a197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:03.642608 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc123b-feab-486e-a0df-bbff8400a197 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:03.642897 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc123b-feab-486e-a0df-bbff8400a197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:03.643173 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc123b-feab-486e-a0df-bbff8400a197 admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:03.643826 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc123b-feab-486e-a0df-bbff8400a197 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:03.645894 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc123b-feab-486e-a0df-bbff8400a197 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:03.646003 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c5fcb31e-ebe5-4490-bcdd-82c32522ce5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce55551fb0714dfe9ba9beb38eec6d30'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:03.660068 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 921/1838] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:26:02 2022] DELETE /identity/v3/users/ce55551fb0714dfe9ba9beb38eec6d30 => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:26:03.740816 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 918/1839] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:26:03 2022] POST /identity/v3/users => generated 279 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:26:03.752516 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fcb31e-ebe5-4490-bcdd-82c32522ce5b admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:03.754609 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-c5fcb31e-ebe5-4490-bcdd-82c32522ce5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:03.832919 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fcb31e-ebe5-4490-bcdd-82c32522ce5b admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:03.866567 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ed4eb-6e51-4ba8-af16-f4807be31704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:03.866567 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ed4eb-6e51-4ba8-af16-f4807be31704 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:03.866567 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ed4eb-6e51-4ba8-af16-f4807be31704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:03.866567 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ed4eb-6e51-4ba8-af16-f4807be31704 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:03.867037 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ed4eb-6e51-4ba8-af16-f4807be31704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:03.867037 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ed4eb-6e51-4ba8-af16-f4807be31704 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:03.867037 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 922/1840] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:26:03.885657 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc123b-feab-486e-a0df-bbff8400a197 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:03.896950 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc123b-feab-486e-a0df-bbff8400a197 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:03.901837 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab75507-f264-44af-a1cd-695cc9609224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:03.902670 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab75507-f264-44af-a1cd-695cc9609224 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:03.902963 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab75507-f264-44af-a1cd-695cc9609224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:03.903245 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab75507-f264-44af-a1cd-695cc9609224 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:03.903931 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab75507-f264-44af-a1cd-695cc9609224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:03.905552 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab75507-f264-44af-a1cd-695cc9609224 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:03.918952 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 919/1841] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:26:03.926957 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ed4eb-6e51-4ba8-af16-f4807be31704 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:03.958755 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ed4eb-6e51-4ba8-af16-f4807be31704 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:03.958755 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c0e6d-1e97-4e78-ac33-c4c0923f9cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:03.958755 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c0e6d-1e97-4e78-ac33-c4c0923f9cdc admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:03.958755 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c0e6d-1e97-4e78-ac33-c4c0923f9cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:03.959147 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c0e6d-1e97-4e78-ac33-c4c0923f9cdc admin admin] PATH_INFO: `/v3/projects/64fb076e649d40c18b218e4dc6fdb8a1/users/cefdf054643f4ec09e496867e642282d/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:03.978999 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c0e6d-1e97-4e78-ac33-c4c0923f9cdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=64fb076e649d40c18b218e4dc6fdb8a1, user_id=cefdf054643f4ec09e496867e642282d, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:03.985928 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c0e6d-1e97-4e78-ac33-c4c0923f9cdc admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:04.175491 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 923/1842] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:26:03 2022] PUT /identity/v3/projects/64fb076e649d40c18b218e4dc6fdb8a1/users/cefdf054643f4ec09e496867e642282d/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:26:04.175794 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858362a2-3559-4af7-bc32-1ceaa1932f99 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:04.176095 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858362a2-3559-4af7-bc32-1ceaa1932f99 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:04.176743 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858362a2-3559-4af7-bc32-1ceaa1932f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:04.183170 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:04.241466 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-858362a2-3559-4af7-bc32-1ceaa1932f99 None None] MFA Rules not processed for user `cefdf054643f4ec09e496867e642282d`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:04.242835 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-858362a2-3559-4af7-bc32-1ceaa1932f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:04.363020 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 920/1843] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:04 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:26:04.364386 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c0e6d-1e97-4e78-ac33-c4c0923f9cdc admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:04.524627 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c0e6d-1e97-4e78-ac33-c4c0923f9cdc admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:04.529961 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c751b1b-3aff-4e26-9dbd-0395aea2840e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:04.530688 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c751b1b-3aff-4e26-9dbd-0395aea2840e admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:04.531087 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c751b1b-3aff-4e26-9dbd-0395aea2840e admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:04.531470 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c751b1b-3aff-4e26-9dbd-0395aea2840e admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:04.532746 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c751b1b-3aff-4e26-9dbd-0395aea2840e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:04.534741 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c751b1b-3aff-4e26-9dbd-0395aea2840e admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:04.675619 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858362a2-3559-4af7-bc32-1ceaa1932f99 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:04.675619 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-858362a2-3559-4af7-bc32-1ceaa1932f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:04.689754 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858362a2-3559-4af7-bc32-1ceaa1932f99 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:04.696794 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65826bd-da42-49db-befe-5ec9f977f9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:04.697564 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65826bd-da42-49db-befe-5ec9f977f9d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:04.698365 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65826bd-da42-49db-befe-5ec9f977f9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:04.699056 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65826bd-da42-49db-befe-5ec9f977f9d5 admin admin] PATH_INFO: `/v3/projects/21a8a8be78664b30b04b7aa4d1a23706` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:04.701643 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65826bd-da42-49db-befe-5ec9f977f9d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21a8a8be78664b30b04b7aa4d1a23706)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:04.705140 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65826bd-da42-49db-befe-5ec9f977f9d5 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:04.788823 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 924/1844] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:26:04 2022] POST /identity/v3/projects => generated 357 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:26:04.792821 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c751b1b-3aff-4e26-9dbd-0395aea2840e admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:04.890226 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c751b1b-3aff-4e26-9dbd-0395aea2840e admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:04.901492 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d49397-cf4e-47e1-b199-502d027fb222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:04.901492 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d49397-cf4e-47e1-b199-502d027fb222 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:04.901492 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d49397-cf4e-47e1-b199-502d027fb222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:04.901492 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d49397-cf4e-47e1-b199-502d027fb222 admin admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:04.901817 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d49397-cf4e-47e1-b199-502d027fb222 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:04.901817 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d49397-cf4e-47e1-b199-502d027fb222 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:04.927306 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c65826bd-da42-49db-befe-5ec9f977f9d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21a8a8be78664b30b04b7aa4d1a23706', 'request_id': 'req-c65826bd-da42-49db-befe-5ec9f977f9d5'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:04.934055 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c65826bd-da42-49db-befe-5ec9f977f9d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21a8a8be78664b30b04b7aa4d1a23706', 'request_id': 'req-c65826bd-da42-49db-befe-5ec9f977f9d5'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:04.940755 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c65826bd-da42-49db-befe-5ec9f977f9d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21a8a8be78664b30b04b7aa4d1a23706', 'request_id': 'req-c65826bd-da42-49db-befe-5ec9f977f9d5'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:05.079757 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c65826bd-da42-49db-befe-5ec9f977f9d5 admin admin] The token cache is being invalidate because project 21a8a8be78664b30b04b7aa4d1a23706 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:26:05.079757 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c65826bd-da42-49db-befe-5ec9f977f9d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:05.080022 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c65826bd-da42-49db-befe-5ec9f977f9d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:05.083886 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 921/1845] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:26:04 2022] DELETE /identity/v3/projects/21a8a8be78664b30b04b7aa4d1a23706 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:05.085305 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b802243-38d4-4aec-b3b9-3b3c325ef223 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:05.085692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 925/1846] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:26:04 2022] POST /identity/v3/users => generated 285 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:26:05.085891 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b802243-38d4-4aec-b3b9-3b3c325ef223 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:05.086228 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b802243-38d4-4aec-b3b9-3b3c325ef223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:05.089110 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79cec3-9fb0-4d58-84f2-c63e01a9eaba None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:05.089578 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79cec3-9fb0-4d58-84f2-c63e01a9eaba None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:05.090405 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79cec3-9fb0-4d58-84f2-c63e01a9eaba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:05.117547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-4a79cec3-9fb0-4d58-84f2-c63e01a9eaba None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:05.119523 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-4a79cec3-9fb0-4d58-84f2-c63e01a9eaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:05.122084 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-2b802243-38d4-4aec-b3b9-3b3c325ef223 None None] MFA Rules not processed for user `c94045a5bb0848b3a168917d81ee56b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:05.123514 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-2b802243-38d4-4aec-b3b9-3b3c325ef223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:05.195066 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 926/1847] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:05.195066 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79cec3-9fb0-4d58-84f2-c63e01a9eaba None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:05.196615 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-4a79cec3-9fb0-4d58-84f2-c63e01a9eaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:05.214418 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79cec3-9fb0-4d58-84f2-c63e01a9eaba None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:05.219898 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9b939-0584-4d71-ad12-58ed3c5ed584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:05.220781 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9b939-0584-4d71-ad12-58ed3c5ed584 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:05.221071 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9b939-0584-4d71-ad12-58ed3c5ed584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:05.221351 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9b939-0584-4d71-ad12-58ed3c5ed584 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:05.222083 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c9b939-0584-4d71-ad12-58ed3c5ed584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:05.224931 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c9b939-0584-4d71-ad12-58ed3c5ed584 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:05.240546 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 927/1848] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:26:05.241020 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 922/1849] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:05.241877 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e15aa-3763-4816-b00d-122976abb3d2 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:05.242155 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e15aa-3763-4816-b00d-122976abb3d2 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:05.242434 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e15aa-3763-4816-b00d-122976abb3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:05.251142 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b802243-38d4-4aec-b3b9-3b3c325ef223 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:05.252574 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-2b802243-38d4-4aec-b3b9-3b3c325ef223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:05.262948 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-aa6e15aa-3763-4816-b00d-122976abb3d2 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:05.265426 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-aa6e15aa-3763-4816-b00d-122976abb3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:05.269816 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b802243-38d4-4aec-b3b9-3b3c325ef223 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:05.276804 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1beb4e-062d-4c6f-b5de-405d5ef23122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:05.290682 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 928/1850] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:05.290849 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1beb4e-062d-4c6f-b5de-405d5ef23122 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:05.290849 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1beb4e-062d-4c6f-b5de-405d5ef23122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:05.290849 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1beb4e-062d-4c6f-b5de-405d5ef23122 admin admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:05.290849 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1beb4e-062d-4c6f-b5de-405d5ef23122 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:05.291132 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e15aa-3763-4816-b00d-122976abb3d2 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:05.291275 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1beb4e-062d-4c6f-b5de-405d5ef23122 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:05.294201 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e15aa-3763-4816-b00d-122976abb3d2 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:05.300087 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7c327-4fa5-4e2d-a9dc-9ec82dfb490f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:05.300754 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7c327-4fa5-4e2d-a9dc-9ec82dfb490f admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:05.301034 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7c327-4fa5-4e2d-a9dc-9ec82dfb490f admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:05.301310 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7c327-4fa5-4e2d-a9dc-9ec82dfb490f admin admin] PATH_INFO: `/v3/projects/1da806392c7c464787f76bb0cd08158e/users/ad6b0d40be9241aaab5d95910b1f7a6a/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:05.317388 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7c327-4fa5-4e2d-a9dc-9ec82dfb490f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1da806392c7c464787f76bb0cd08158e, user_id=ad6b0d40be9241aaab5d95910b1f7a6a, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:05.320245 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7c327-4fa5-4e2d-a9dc-9ec82dfb490f admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:05.476514 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 923/1851] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:26:05 2022] POST /identity/v3/projects => generated 373 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:26:05.478573 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 929/1852] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:26:05 2022] PUT /identity/v3/projects/1da806392c7c464787f76bb0cd08158e/users/ad6b0d40be9241aaab5d95910b1f7a6a/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:05.479601 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7c327-4fa5-4e2d-a9dc-9ec82dfb490f admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:05.480760 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1beb4e-062d-4c6f-b5de-405d5ef23122 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:05.546187 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1beb4e-062d-4c6f-b5de-405d5ef23122 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:05.547219 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7c327-4fa5-4e2d-a9dc-9ec82dfb490f admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:05.552262 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e6314-d913-4a79-99ac-1629cbb4f1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:05.552742 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd52f06-1560-4422-9963-e6848d69c2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:05.552878 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e6314-d913-4a79-99ac-1629cbb4f1ba admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:05.553052 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e6314-d913-4a79-99ac-1629cbb4f1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:05.553336 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e6314-d913-4a79-99ac-1629cbb4f1ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:05.553464 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd52f06-1560-4422-9963-e6848d69c2bd admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:05.553623 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd52f06-1560-4422-9963-e6848d69c2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:05.553899 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd52f06-1560-4422-9963-e6848d69c2bd admin admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:05.553983 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e6314-d913-4a79-99ac-1629cbb4f1ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:26:05.554281 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e6314-d913-4a79-99ac-1629cbb4f1ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:05.554699 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd52f06-1560-4422-9963-e6848d69c2bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:05.555916 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e6314-d913-4a79-99ac-1629cbb4f1ba admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:05.556632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd52f06-1560-4422-9963-e6848d69c2bd admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:05.568865 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 924/1853] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:26:05.576116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e6314-d913-4a79-99ac-1629cbb4f1ba admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:05.580574 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e6314-d913-4a79-99ac-1629cbb4f1ba admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:05.585777 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddcf02f-ae28-43b9-9543-90a0c77cbbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:05.586386 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddcf02f-ae28-43b9-9543-90a0c77cbbb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:05.586670 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddcf02f-ae28-43b9-9543-90a0c77cbbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:05.586951 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddcf02f-ae28-43b9-9543-90a0c77cbbb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:05.587679 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddcf02f-ae28-43b9-9543-90a0c77cbbb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:05.589271 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddcf02f-ae28-43b9-9543-90a0c77cbbb0 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:05.601013 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 925/1854] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:26:05.601683 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddcf02f-ae28-43b9-9543-90a0c77cbbb0 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:05.611919 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddcf02f-ae28-43b9-9543-90a0c77cbbb0 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:05.616513 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95cf15-9be7-405d-bc1f-d33587c81ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:05.617097 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95cf15-9be7-405d-bc1f-d33587c81ebd admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:05.617376 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95cf15-9be7-405d-bc1f-d33587c81ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:05.617650 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95cf15-9be7-405d-bc1f-d33587c81ebd admin admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:05.618292 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c95cf15-9be7-405d-bc1f-d33587c81ebd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:05.620182 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c95cf15-9be7-405d-bc1f-d33587c81ebd admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:05.679653 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 930/1855] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:26:05 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:26:05.679653 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd52f06-1560-4422-9963-e6848d69c2bd admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:05.691602 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd52f06-1560-4422-9963-e6848d69c2bd admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:05.696819 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2349d0-fa6c-46f9-b661-7ab218e50104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:05.697752 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2349d0-fa6c-46f9-b661-7ab218e50104 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:05.698310 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2349d0-fa6c-46f9-b661-7ab218e50104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:05.698747 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2349d0-fa6c-46f9-b661-7ab218e50104 admin admin] PATH_INFO: `/v3/projects/1da806392c7c464787f76bb0cd08158e/users/ad6b0d40be9241aaab5d95910b1f7a6a/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:05.701493 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2349d0-fa6c-46f9-b661-7ab218e50104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1da806392c7c464787f76bb0cd08158e, user_id=ad6b0d40be9241aaab5d95910b1f7a6a, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:05.705169 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2349d0-fa6c-46f9-b661-7ab218e50104 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:05.726223 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 931/1856] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:26:05 2022] PUT /identity/v3/projects/1da806392c7c464787f76bb0cd08158e/users/ad6b0d40be9241aaab5d95910b1f7a6a/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:05.740536 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2349d0-fa6c-46f9-b661-7ab218e50104 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:05.776883 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 926/1857] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:26:05 2022] POST /identity/v3/projects => generated 367 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:26:05.778893 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe5e60-e36b-4ea3-8562-9ed39cb5b00d None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:05.795758 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe5e60-e36b-4ea3-8562-9ed39cb5b00d None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:05.795758 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe5e60-e36b-4ea3-8562-9ed39cb5b00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:05.830455 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-03fe5e60-e36b-4ea3-8562-9ed39cb5b00d None None] MFA Rules not processed for user `ad6b0d40be9241aaab5d95910b1f7a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:05.830455 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-03fe5e60-e36b-4ea3-8562-9ed39cb5b00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:05.830660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2349d0-fa6c-46f9-b661-7ab218e50104 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:05.913758 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 927/1858] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:05 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:05.914784 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe5e60-e36b-4ea3-8562-9ed39cb5b00d None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:05.929223 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe5e60-e36b-4ea3-8562-9ed39cb5b00d None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:05.939555 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa0e7e2-baac-4bae-a35a-65036d455f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:05.939555 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa0e7e2-baac-4bae-a35a-65036d455f9a admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:05.939555 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa0e7e2-baac-4bae-a35a-65036d455f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:05.939555 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa0e7e2-baac-4bae-a35a-65036d455f9a admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:05.939918 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa0e7e2-baac-4bae-a35a-65036d455f9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:05.941772 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa0e7e2-baac-4bae-a35a-65036d455f9a admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:05.944482 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29941ea-e7cc-4853-95a1-f58c321a2bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:05.946449 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29941ea-e7cc-4853-95a1-f58c321a2bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:05.946746 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29941ea-e7cc-4853-95a1-f58c321a2bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:05.947028 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29941ea-e7cc-4853-95a1-f58c321a2bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:05.950105 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29941ea-e7cc-4853-95a1-f58c321a2bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:05.955264 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29941ea-e7cc-4853-95a1-f58c321a2bd1 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:05.977264 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 932/1859] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:26:05.977264 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29941ea-e7cc-4853-95a1-f58c321a2bd1 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:05.980368 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-e29941ea-e7cc-4853-95a1-f58c321a2bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:06.046803 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29941ea-e7cc-4853-95a1-f58c321a2bd1 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:06.050955 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 928/1860] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:26:05 2022] POST /identity/v3/users => generated 284 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:26:06.052027 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa0e7e2-baac-4bae-a35a-65036d455f9a admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:06.052158 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7de59-8e56-4e42-a50e-39ebcaf08ae1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:06.052642 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7de59-8e56-4e42-a50e-39ebcaf08ae1 service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:06.052982 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7de59-8e56-4e42-a50e-39ebcaf08ae1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:06.053274 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7de59-8e56-4e42-a50e-39ebcaf08ae1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:06.065904 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7de59-8e56-4e42-a50e-39ebcaf08ae1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:06.068404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7de59-8e56-4e42-a50e-39ebcaf08ae1 service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:06.071859 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa0e7e2-baac-4bae-a35a-65036d455f9a admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:06.083750 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db901d-021e-417c-9dbe-6bce05d51359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:06.084817 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db901d-021e-417c-9dbe-6bce05d51359 admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:06.085103 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db901d-021e-417c-9dbe-6bce05d51359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:06.085379 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db901d-021e-417c-9dbe-6bce05d51359 admin admin] PATH_INFO: `/v3/projects/b7f0847b1bc44400a01f21fa059a50bf/users/a9ba1e53f33741f6b24775e994f0507f/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:06.088003 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 933/1861] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:05 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:26:06.090092 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7de59-8e56-4e42-a50e-39ebcaf08ae1 service cinder] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:06.116810 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7de59-8e56-4e42-a50e-39ebcaf08ae1 service cinder] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:06.125232 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db901d-021e-417c-9dbe-6bce05d51359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7f0847b1bc44400a01f21fa059a50bf, user_id=a9ba1e53f33741f6b24775e994f0507f, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:06.142399 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b9b6a-50b8-458d-8769-e7297912ada4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:06.143024 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b9b6a-50b8-458d-8769-e7297912ada4 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:06.144472 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db901d-021e-417c-9dbe-6bce05d51359 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:06.145708 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b9b6a-50b8-458d-8769-e7297912ada4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:06.146022 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b9b6a-50b8-458d-8769-e7297912ada4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:06.155591 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b9b6a-50b8-458d-8769-e7297912ada4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:06.155591 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b9b6a-50b8-458d-8769-e7297912ada4 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:06.162604 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 934/1862] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:26:06.166835 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b9b6a-50b8-458d-8769-e7297912ada4 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:06.177322 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b9b6a-50b8-458d-8769-e7297912ada4 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:06.182486 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a13753-860d-4626-95e0-95362e31978d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:06.183095 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a13753-860d-4626-95e0-95362e31978d admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:06.183396 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a13753-860d-4626-95e0-95362e31978d admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:06.183682 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a13753-860d-4626-95e0-95362e31978d admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:06.184328 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a13753-860d-4626-95e0-95362e31978d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:06.185915 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a13753-860d-4626-95e0-95362e31978d admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:06.197459 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 935/1863] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:26:06.205144 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a13753-860d-4626-95e0-95362e31978d admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:06.215790 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a13753-860d-4626-95e0-95362e31978d admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:06.221230 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045603ee-b82f-4cef-bbb4-e2c487ae29b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:06.222213 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045603ee-b82f-4cef-bbb4-e2c487ae29b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:06.222534 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045603ee-b82f-4cef-bbb4-e2c487ae29b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:06.222772 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045603ee-b82f-4cef-bbb4-e2c487ae29b4 admin admin] PATH_INFO: `/v3/projects/6590d60a217f47c6a7888e2314319aee/users/8f6c371016d142d0b349d3c61744976a/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:06.239552 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045603ee-b82f-4cef-bbb4-e2c487ae29b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6590d60a217f47c6a7888e2314319aee, user_id=8f6c371016d142d0b349d3c61744976a, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:06.244104 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045603ee-b82f-4cef-bbb4-e2c487ae29b4 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:06.261143 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 929/1864] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:26:06 2022] PUT /identity/v3/projects/b7f0847b1bc44400a01f21fa059a50bf/users/a9ba1e53f33741f6b24775e994f0507f/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:06.267505 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db901d-021e-417c-9dbe-6bce05d51359 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:06.318003 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 936/1865] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:26:06 2022] PUT /identity/v3/projects/6590d60a217f47c6a7888e2314319aee/users/8f6c371016d142d0b349d3c61744976a/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:06.332938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31c311-58d7-4156-b74d-b9e03223890d None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:06.333283 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31c311-58d7-4156-b74d-b9e03223890d None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:06.333569 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31c311-58d7-4156-b74d-b9e03223890d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:06.365124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-da31c311-58d7-4156-b74d-b9e03223890d None None] MFA Rules not processed for user `8f6c371016d142d0b349d3c61744976a`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:06.366735 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-da31c311-58d7-4156-b74d-b9e03223890d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:06.444937 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db901d-021e-417c-9dbe-6bce05d51359 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:06.487868 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 937/1866] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:26:06.491201 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31c311-58d7-4156-b74d-b9e03223890d None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:06.530973 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b3415-fdd8-48cc-9708-5c7d0f07208f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:06.532397 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b3415-fdd8-48cc-9708-5c7d0f07208f admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:06.538124 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b3415-fdd8-48cc-9708-5c7d0f07208f admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:06.538124 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b3415-fdd8-48cc-9708-5c7d0f07208f admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:06.538124 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b3415-fdd8-48cc-9708-5c7d0f07208f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:06.538124 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b3415-fdd8-48cc-9708-5c7d0f07208f admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:06.550766 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 930/1867] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:26:06.550766 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b3415-fdd8-48cc-9708-5c7d0f07208f admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:06.575795 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b3415-fdd8-48cc-9708-5c7d0f07208f admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:06.575987 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31c311-58d7-4156-b74d-b9e03223890d None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:06.576449 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c576d2c-4b46-4b1c-a878-027513f7a8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:06.577226 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c576d2c-4b46-4b1c-a878-027513f7a8f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:06.577904 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c576d2c-4b46-4b1c-a878-027513f7a8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:06.578417 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c576d2c-4b46-4b1c-a878-027513f7a8f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:06.579652 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c576d2c-4b46-4b1c-a878-027513f7a8f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:06.580562 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357adcb1-b3aa-4a32-a8b1-90619b992e60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:06.581410 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357adcb1-b3aa-4a32-a8b1-90619b992e60 service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:06.581808 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357adcb1-b3aa-4a32-a8b1-90619b992e60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:06.582312 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357adcb1-b3aa-4a32-a8b1-90619b992e60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:06.583064 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c576d2c-4b46-4b1c-a878-027513f7a8f2 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:06.590321 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-357adcb1-b3aa-4a32-a8b1-90619b992e60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:06.664660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357adcb1-b3aa-4a32-a8b1-90619b992e60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:06.670356 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357adcb1-b3aa-4a32-a8b1-90619b992e60 service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:06.675378 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 938/1868] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:06 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:26:06.676202 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357adcb1-b3aa-4a32-a8b1-90619b992e60 service cinder] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:06.688368 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357adcb1-b3aa-4a32-a8b1-90619b992e60 service cinder] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:06.693721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad12bd8-68e1-4827-bb1e-276a4042ef20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:06.694581 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad12bd8-68e1-4827-bb1e-276a4042ef20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:06.694864 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad12bd8-68e1-4827-bb1e-276a4042ef20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:06.695144 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad12bd8-68e1-4827-bb1e-276a4042ef20 admin admin] PATH_INFO: `/v3/projects/b7f0847b1bc44400a01f21fa059a50bf/users/a9ba1e53f33741f6b24775e994f0507f/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:06.697270 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad12bd8-68e1-4827-bb1e-276a4042ef20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7f0847b1bc44400a01f21fa059a50bf, user_id=a9ba1e53f33741f6b24775e994f0507f, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:06.700061 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad12bd8-68e1-4827-bb1e-276a4042ef20 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:06.711753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 931/1869] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:26:06 2022] POST /identity/v3/projects => generated 369 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:26:06.715834 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c576d2c-4b46-4b1c-a878-027513f7a8f2 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:06.717596 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 939/1870] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:26:06 2022] PUT /identity/v3/projects/b7f0847b1bc44400a01f21fa059a50bf/users/a9ba1e53f33741f6b24775e994f0507f/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:06.822170 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c576d2c-4b46-4b1c-a878-027513f7a8f2 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:06.831234 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ce43e-e0b4-4ae3-9e75-e7b6c83fe677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:06.831234 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ce43e-e0b4-4ae3-9e75-e7b6c83fe677 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:06.831234 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ce43e-e0b4-4ae3-9e75-e7b6c83fe677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:06.831234 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ce43e-e0b4-4ae3-9e75-e7b6c83fe677 admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:06.832689 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ce43e-e0b4-4ae3-9e75-e7b6c83fe677 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:06.834666 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ce43e-e0b4-4ae3-9e75-e7b6c83fe677 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:07.055057 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 932/1871] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:26:06 2022] POST /identity/v3/users => generated 291 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:26:07.059312 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad12bd8-68e1-4827-bb1e-276a4042ef20 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:07.126368 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad12bd8-68e1-4827-bb1e-276a4042ef20 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:07.131445 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab15454-f39b-4f05-8768-a8519f8d806a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:07.132158 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab15454-f39b-4f05-8768-a8519f8d806a admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:07.132509 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab15454-f39b-4f05-8768-a8519f8d806a admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:07.132851 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab15454-f39b-4f05-8768-a8519f8d806a admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:07.133601 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab15454-f39b-4f05-8768-a8519f8d806a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:07.135327 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab15454-f39b-4f05-8768-a8519f8d806a admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:07.152728 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 940/1872] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:26:07.158319 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ce43e-e0b4-4ae3-9e75-e7b6c83fe677 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:07.169278 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ce43e-e0b4-4ae3-9e75-e7b6c83fe677 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:07.183242 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b505778b-58a3-4101-89bd-3618c9a9c5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:07.183973 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505778b-58a3-4101-89bd-3618c9a9c5c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:07.184468 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505778b-58a3-4101-89bd-3618c9a9c5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:07.184815 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505778b-58a3-4101-89bd-3618c9a9c5c9 admin admin] PATH_INFO: `/v3/projects/a9039e737f7548ad93e73b93e316b9c6/users/f41efc59b8e5463eb39069a0ea80a770/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:07.222576 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b505778b-58a3-4101-89bd-3618c9a9c5c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9039e737f7548ad93e73b93e316b9c6, user_id=f41efc59b8e5463eb39069a0ea80a770, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:07.226612 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b505778b-58a3-4101-89bd-3618c9a9c5c9 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:07.395287 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 933/1873] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:26:07 2022] PUT /identity/v3/projects/a9039e737f7548ad93e73b93e316b9c6/users/f41efc59b8e5463eb39069a0ea80a770/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:07.399262 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab15454-f39b-4f05-8768-a8519f8d806a admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:07.412564 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab15454-f39b-4f05-8768-a8519f8d806a admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:07.499146 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b444e-dbef-4251-a9d5-a87a1bd60c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:07.499902 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b444e-dbef-4251-a9d5-a87a1bd60c17 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:07.500274 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b444e-dbef-4251-a9d5-a87a1bd60c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:07.501147 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b444e-dbef-4251-a9d5-a87a1bd60c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:07.502682 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b444e-dbef-4251-a9d5-a87a1bd60c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:07.504586 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b444e-dbef-4251-a9d5-a87a1bd60c17 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:07.517038 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 941/1874] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:26:07.518630 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:07.520908 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b505778b-58a3-4101-89bd-3618c9a9c5c9 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:07.533745 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b505778b-58a3-4101-89bd-3618c9a9c5c9 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:07.538876 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ece97-ce9d-4700-95cf-afdae85540a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:07.539312 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ece97-ce9d-4700-95cf-afdae85540a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:07.539693 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ece97-ce9d-4700-95cf-afdae85540a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:07.539903 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ece97-ce9d-4700-95cf-afdae85540a4 admin admin] PATH_INFO: `/v3/projects/a9039e737f7548ad93e73b93e316b9c6/users/f41efc59b8e5463eb39069a0ea80a770/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:07.541821 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ece97-ce9d-4700-95cf-afdae85540a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9039e737f7548ad93e73b93e316b9c6, user_id=f41efc59b8e5463eb39069a0ea80a770, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:07.544705 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ece97-ce9d-4700-95cf-afdae85540a4 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:07.556364 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 934/1875] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:26:07 2022] PUT /identity/v3/projects/a9039e737f7548ad93e73b93e316b9c6/users/f41efc59b8e5463eb39069a0ea80a770/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:26:07.569855 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde314da-f968-48d7-8b59-f45a85bfbe23 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:07.571990 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde314da-f968-48d7-8b59-f45a85bfbe23 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:07.571990 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde314da-f968-48d7-8b59-f45a85bfbe23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:07.610631 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-fde314da-f968-48d7-8b59-f45a85bfbe23 None None] MFA Rules not processed for user `f41efc59b8e5463eb39069a0ea80a770`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:07.611545 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-fde314da-f968-48d7-8b59-f45a85bfbe23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:07.752784 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 942/1876] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:07 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:07.757903 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ece97-ce9d-4700-95cf-afdae85540a4 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:07.843154 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ece97-ce9d-4700-95cf-afdae85540a4 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:07.848297 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f535d9c-0d22-4065-a4cc-1d1907bfd39a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:07.849160 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f535d9c-0d22-4065-a4cc-1d1907bfd39a service cinder] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:07.849528 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f535d9c-0d22-4065-a4cc-1d1907bfd39a service cinder] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:07.850026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f535d9c-0d22-4065-a4cc-1d1907bfd39a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:07.861531 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f535d9c-0d22-4065-a4cc-1d1907bfd39a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:07.862988 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f535d9c-0d22-4065-a4cc-1d1907bfd39a service cinder] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:07.873465 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 935/1877] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:07 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:26:08.022786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde314da-f968-48d7-8b59-f45a85bfbe23 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:08.036616 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde314da-f968-48d7-8b59-f45a85bfbe23 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:08.040643 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f370c-398d-4f79-80c0-39cde29c0dec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:08.041263 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f370c-398d-4f79-80c0-39cde29c0dec service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:08.041564 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f370c-398d-4f79-80c0-39cde29c0dec service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:08.041842 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f370c-398d-4f79-80c0-39cde29c0dec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:08.103017 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:08.106041 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f370c-398d-4f79-80c0-39cde29c0dec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:08.108472 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f370c-398d-4f79-80c0-39cde29c0dec service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:08.118317 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 943/1878] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:26:08.904086 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:09.369223 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41f8fc-e72b-4af6-b6a5-6757a7ccdad1 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:09.369223 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41f8fc-e72b-4af6-b6a5-6757a7ccdad1 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:09.369223 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41f8fc-e72b-4af6-b6a5-6757a7ccdad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:09.425652 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-1a41f8fc-e72b-4af6-b6a5-6757a7ccdad1 None None] MFA Rules not processed for user `a9ba1e53f33741f6b24775e994f0507f`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:09.427627 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-1a41f8fc-e72b-4af6-b6a5-6757a7ccdad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:09.532998 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 936/1879] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:09.545089 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c020358-81a1-4cc5-a759-74e8c1d1cbd5 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:09.549397 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c020358-81a1-4cc5-a759-74e8c1d1cbd5 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:09.549397 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c020358-81a1-4cc5-a759-74e8c1d1cbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:09.590586 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-2c020358-81a1-4cc5-a759-74e8c1d1cbd5 None None] MFA Rules not processed for user `c94045a5bb0848b3a168917d81ee56b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:09.592802 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-2c020358-81a1-4cc5-a759-74e8c1d1cbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:09.721871 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 944/1880] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:09.733234 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41f8fc-e72b-4af6-b6a5-6757a7ccdad1 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:09.734662 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-1a41f8fc-e72b-4af6-b6a5-6757a7ccdad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:09.818979 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41f8fc-e72b-4af6-b6a5-6757a7ccdad1 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:09.824843 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3aa597-f45e-4f0e-8291-710cd8ecb272 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:09.825460 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3aa597-f45e-4f0e-8291-710cd8ecb272 service nova] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:09.825743 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3aa597-f45e-4f0e-8291-710cd8ecb272 service nova] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:09.826332 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3aa597-f45e-4f0e-8291-710cd8ecb272 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:09.837489 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3aa597-f45e-4f0e-8291-710cd8ecb272 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:09.839212 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3aa597-f45e-4f0e-8291-710cd8ecb272 service nova] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:09.849263 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 937/1881] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:26:11.528558 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:12.267187 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:14.086517 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c020358-81a1-4cc5-a759-74e8c1d1cbd5 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:14.150589 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c020358-81a1-4cc5-a759-74e8c1d1cbd5 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:14.157498 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e83383-0beb-4c99-ad6a-56d3762dfc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:14.157498 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e83383-0beb-4c99-ad6a-56d3762dfc38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:14.157498 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e83383-0beb-4c99-ad6a-56d3762dfc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:14.157498 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e83383-0beb-4c99-ad6a-56d3762dfc38 admin admin] PATH_INFO: `/v3/users/8f6c371016d142d0b349d3c61744976a` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:14.158646 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e83383-0beb-4c99-ad6a-56d3762dfc38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f6c371016d142d0b349d3c61744976a)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:14.160644 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e83383-0beb-4c99-ad6a-56d3762dfc38 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:14.347099 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-17e83383-0beb-4c99-ad6a-56d3762dfc38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f6c371016d142d0b349d3c61744976a'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:14.431408 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-17e83383-0beb-4c99-ad6a-56d3762dfc38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f6c371016d142d0b349d3c61744976a'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:14.432077 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-17e83383-0beb-4c99-ad6a-56d3762dfc38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f6c371016d142d0b349d3c61744976a'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:14.445119 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-17e83383-0beb-4c99-ad6a-56d3762dfc38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f6c371016d142d0b349d3c61744976a'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:14.451871 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-17e83383-0beb-4c99-ad6a-56d3762dfc38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f6c371016d142d0b349d3c61744976a'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:14.458022 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 945/1882] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:26:14 2022] DELETE /identity/v3/users/8f6c371016d142d0b349d3c61744976a => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:14.462618 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ade65-0b61-44a6-bfc5-250ffbd05104 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:14.463257 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ade65-0b61-44a6-bfc5-250ffbd05104 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:14.463257 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ade65-0b61-44a6-bfc5-250ffbd05104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:14.483465 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-0d3ade65-0b61-44a6-bfc5-250ffbd05104 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:14.485187 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-0d3ade65-0b61-44a6-bfc5-250ffbd05104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:14.545143 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 938/1883] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:14.555759 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e83383-0beb-4c99-ad6a-56d3762dfc38 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:14.557293 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-17e83383-0beb-4c99-ad6a-56d3762dfc38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:14.619035 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e83383-0beb-4c99-ad6a-56d3762dfc38 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:14.623035 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7aa42-84d0-4603-95e5-0285b11b43d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:14.628671 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7aa42-84d0-4603-95e5-0285b11b43d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:14.628671 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7aa42-84d0-4603-95e5-0285b11b43d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:14.628671 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7aa42-84d0-4603-95e5-0285b11b43d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:14.634371 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d7aa42-84d0-4603-95e5-0285b11b43d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:14.635849 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d7aa42-84d0-4603-95e5-0285b11b43d7 service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:14.645511 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 946/1884] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:26:15.001131 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:15.403206 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:15.417751 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ade65-0b61-44a6-bfc5-250ffbd05104 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:15.419274 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-0d3ade65-0b61-44a6-bfc5-250ffbd05104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:15.431539 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ade65-0b61-44a6-bfc5-250ffbd05104 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:15.436467 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17fd88-f7c3-4598-b3e4-8b9adab4d369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:15.437166 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17fd88-f7c3-4598-b3e4-8b9adab4d369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:15.437452 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17fd88-f7c3-4598-b3e4-8b9adab4d369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:15.437735 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17fd88-f7c3-4598-b3e4-8b9adab4d369 admin admin] PATH_INFO: `/v3/projects/6590d60a217f47c6a7888e2314319aee` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:15.438947 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17fd88-f7c3-4598-b3e4-8b9adab4d369 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6590d60a217f47c6a7888e2314319aee)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:15.440957 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17fd88-f7c3-4598-b3e4-8b9adab4d369 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:15.585115 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-2b17fd88-f7c3-4598-b3e4-8b9adab4d369 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6590d60a217f47c6a7888e2314319aee', 'request_id': 'req-2b17fd88-f7c3-4598-b3e4-8b9adab4d369'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:15.590325 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-2b17fd88-f7c3-4598-b3e4-8b9adab4d369 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6590d60a217f47c6a7888e2314319aee', 'request_id': 'req-2b17fd88-f7c3-4598-b3e4-8b9adab4d369'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:15.596929 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-2b17fd88-f7c3-4598-b3e4-8b9adab4d369 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6590d60a217f47c6a7888e2314319aee', 'request_id': 'req-2b17fd88-f7c3-4598-b3e4-8b9adab4d369'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:15.713528 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-2b17fd88-f7c3-4598-b3e4-8b9adab4d369 admin admin] The token cache is being invalidate because project 6590d60a217f47c6a7888e2314319aee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:26:15.713912 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-2b17fd88-f7c3-4598-b3e4-8b9adab4d369 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:15.714942 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-2b17fd88-f7c3-4598-b3e4-8b9adab4d369 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:15.718082 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 939/1885] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:26:15 2022] DELETE /identity/v3/projects/6590d60a217f47c6a7888e2314319aee => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:15.723770 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7aa42-84d0-4603-95e5-0285b11b43d7 service neutron] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:15.733231 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7aa42-84d0-4603-95e5-0285b11b43d7 service neutron] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:15.844866 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b8e19-16bb-4415-89c8-64b7ffe347dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:15.845453 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b8e19-16bb-4415-89c8-64b7ffe347dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:15.845919 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b8e19-16bb-4415-89c8-64b7ffe347dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:15.846200 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b8e19-16bb-4415-89c8-64b7ffe347dd admin admin] PATH_INFO: `/v3/users/f41efc59b8e5463eb39069a0ea80a770` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:15.847947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b8e19-16bb-4415-89c8-64b7ffe347dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f41efc59b8e5463eb39069a0ea80a770)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:15.849658 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b8e19-16bb-4415-89c8-64b7ffe347dd admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:16.146575 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-423b8e19-16bb-4415-89c8-64b7ffe347dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f41efc59b8e5463eb39069a0ea80a770'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:16.258316 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-423b8e19-16bb-4415-89c8-64b7ffe347dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f41efc59b8e5463eb39069a0ea80a770'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:16.259060 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-423b8e19-16bb-4415-89c8-64b7ffe347dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f41efc59b8e5463eb39069a0ea80a770'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:16.274294 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-423b8e19-16bb-4415-89c8-64b7ffe347dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f41efc59b8e5463eb39069a0ea80a770'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:16.283322 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-423b8e19-16bb-4415-89c8-64b7ffe347dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f41efc59b8e5463eb39069a0ea80a770'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:16.311415 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 947/1886] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:26:15 2022] DELETE /identity/v3/users/f41efc59b8e5463eb39069a0ea80a770 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:16.950693 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17fd88-f7c3-4598-b3e4-8b9adab4d369 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:16.952268 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-2b17fd88-f7c3-4598-b3e4-8b9adab4d369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:16.982240 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17fd88-f7c3-4598-b3e4-8b9adab4d369 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:17.046340 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70df5c-de20-4704-b77d-0126a87747c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:17.047488 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70df5c-de20-4704-b77d-0126a87747c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:17.047775 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70df5c-de20-4704-b77d-0126a87747c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:17.048055 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70df5c-de20-4704-b77d-0126a87747c9 admin admin] PATH_INFO: `/v3/projects/a9039e737f7548ad93e73b93e316b9c6` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:17.049826 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b70df5c-de20-4704-b77d-0126a87747c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9039e737f7548ad93e73b93e316b9c6)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:17.051990 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b70df5c-de20-4704-b77d-0126a87747c9 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:17.155996 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:17.274248 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-1b70df5c-de20-4704-b77d-0126a87747c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9039e737f7548ad93e73b93e316b9c6', 'request_id': 'req-1b70df5c-de20-4704-b77d-0126a87747c9'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:17.279923 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-1b70df5c-de20-4704-b77d-0126a87747c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9039e737f7548ad93e73b93e316b9c6', 'request_id': 'req-1b70df5c-de20-4704-b77d-0126a87747c9'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:17.286843 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-1b70df5c-de20-4704-b77d-0126a87747c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9039e737f7548ad93e73b93e316b9c6', 'request_id': 'req-1b70df5c-de20-4704-b77d-0126a87747c9'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:17.480683 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-1b70df5c-de20-4704-b77d-0126a87747c9 admin admin] The token cache is being invalidate because project a9039e737f7548ad93e73b93e316b9c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:26:17.481023 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-1b70df5c-de20-4704-b77d-0126a87747c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:17.481788 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-1b70df5c-de20-4704-b77d-0126a87747c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:17.483386 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 940/1887] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:26:16 2022] DELETE /identity/v3/projects/a9039e737f7548ad93e73b93e316b9c6 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:26:17.488473 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2dc65-a2e2-45a3-b29f-5b425295ad41 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:17.488986 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2dc65-a2e2-45a3-b29f-5b425295ad41 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:17.489079 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2dc65-a2e2-45a3-b29f-5b425295ad41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:17.510196 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-9fd2dc65-a2e2-45a3-b29f-5b425295ad41 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:17.511460 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-9fd2dc65-a2e2-45a3-b29f-5b425295ad41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:17.589322 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 948/1888] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:26:17.597259 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909358c5-3c18-4f07-ba43-60e960d488b4 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:17.597851 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909358c5-3c18-4f07-ba43-60e960d488b4 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:17.598363 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909358c5-3c18-4f07-ba43-60e960d488b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:17.618728 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-909358c5-3c18-4f07-ba43-60e960d488b4 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:17.620225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-909358c5-3c18-4f07-ba43-60e960d488b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:17.622491 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:17.631637 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 941/1889] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:17.643229 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2dc65-a2e2-45a3-b29f-5b425295ad41 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:17.688949 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2dc65-a2e2-45a3-b29f-5b425295ad41 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:17.692103 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4595730-a28c-422c-8033-788c3d671304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:17.692926 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4595730-a28c-422c-8033-788c3d671304 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:17.693211 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4595730-a28c-422c-8033-788c3d671304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:17.693517 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4595730-a28c-422c-8033-788c3d671304 admin admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:17.694171 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4595730-a28c-422c-8033-788c3d671304 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:26:17.694476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4595730-a28c-422c-8033-788c3d671304 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:17.696135 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4595730-a28c-422c-8033-788c3d671304 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:17.709127 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 949/1890] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:26:17.713717 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909358c5-3c18-4f07-ba43-60e960d488b4 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:17.724712 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909358c5-3c18-4f07-ba43-60e960d488b4 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:17.730326 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e7f48-9593-453c-92f8-212532a4ba1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:17.731005 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e7f48-9593-453c-92f8-212532a4ba1b admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:17.731238 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e7f48-9593-453c-92f8-212532a4ba1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:17.731545 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e7f48-9593-453c-92f8-212532a4ba1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:17.732210 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e7f48-9593-453c-92f8-212532a4ba1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:17.734185 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e7f48-9593-453c-92f8-212532a4ba1b admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:17.895451 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 942/1891] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:26:17 2022] POST /identity/v3/projects => generated 399 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:26:17.896650 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4595730-a28c-422c-8033-788c3d671304 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:17.906616 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4595730-a28c-422c-8033-788c3d671304 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:17.966123 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37cfef0-26a4-4874-b0e8-bae39369628b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:17.966986 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37cfef0-26a4-4874-b0e8-bae39369628b admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:17.967274 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37cfef0-26a4-4874-b0e8-bae39369628b admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:17.967572 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37cfef0-26a4-4874-b0e8-bae39369628b admin admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:17.968193 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37cfef0-26a4-4874-b0e8-bae39369628b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:17.970171 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37cfef0-26a4-4874-b0e8-bae39369628b admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:18.118067 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 950/1892] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:26:17 2022] POST /identity/v3/users => generated 300 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:26:18.126509 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e7f48-9593-453c-92f8-212532a4ba1b admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:18.133694 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e7f48-9593-453c-92f8-212532a4ba1b admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:18.138806 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8e0c0-45f5-4845-9c2f-81de4bd53911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:18.139376 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8e0c0-45f5-4845-9c2f-81de4bd53911 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:18.139683 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8e0c0-45f5-4845-9c2f-81de4bd53911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:18.139962 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8e0c0-45f5-4845-9c2f-81de4bd53911 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:18.140720 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c8e0c0-45f5-4845-9c2f-81de4bd53911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:18.143066 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c8e0c0-45f5-4845-9c2f-81de4bd53911 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:18.154288 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 943/1893] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:26:18.158852 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37cfef0-26a4-4874-b0e8-bae39369628b admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:18.169219 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37cfef0-26a4-4874-b0e8-bae39369628b admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:18.174394 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c164c2-b281-4d0a-8722-0a596632183b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:18.175004 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c164c2-b281-4d0a-8722-0a596632183b admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:18.175289 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c164c2-b281-4d0a-8722-0a596632183b admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:18.175631 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c164c2-b281-4d0a-8722-0a596632183b admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:18.176273 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c164c2-b281-4d0a-8722-0a596632183b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:18.177912 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c164c2-b281-4d0a-8722-0a596632183b admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:18.189363 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 951/1894] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:26:18.193431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8e0c0-45f5-4845-9c2f-81de4bd53911 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:18.205144 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8e0c0-45f5-4845-9c2f-81de4bd53911 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:18.210770 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32a5cc-3ef1-4ad3-81ae-3f05f4d4e292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:18.211462 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32a5cc-3ef1-4ad3-81ae-3f05f4d4e292 admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:18.211749 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32a5cc-3ef1-4ad3-81ae-3f05f4d4e292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:18.212030 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32a5cc-3ef1-4ad3-81ae-3f05f4d4e292 admin admin] PATH_INFO: `/v3/projects/1f5300bb210e40199991becc3260756b/users/193c0f78f5da4b35ad6d8793c57e3196/roles/5691bce246d6452990f13933e19f2825` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:18.229056 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32a5cc-3ef1-4ad3-81ae-3f05f4d4e292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f5300bb210e40199991becc3260756b, user_id=193c0f78f5da4b35ad6d8793c57e3196, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:18.231742 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32a5cc-3ef1-4ad3-81ae-3f05f4d4e292 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:18.357563 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 944/1895] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:26:18 2022] PUT /identity/v3/projects/1f5300bb210e40199991becc3260756b/users/193c0f78f5da4b35ad6d8793c57e3196/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:18.368105 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bd113-3441-4d35-acb9-768997b0db8a None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:18.368347 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bd113-3441-4d35-acb9-768997b0db8a None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:18.368628 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bd113-3441-4d35-acb9-768997b0db8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:18.408050 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-b41bd113-3441-4d35-acb9-768997b0db8a None None] MFA Rules not processed for user `193c0f78f5da4b35ad6d8793c57e3196`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:18.409324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-b41bd113-3441-4d35-acb9-768997b0db8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:18.475514 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 952/1896] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:18 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:18.480050 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32a5cc-3ef1-4ad3-81ae-3f05f4d4e292 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:18.544763 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32a5cc-3ef1-4ad3-81ae-3f05f4d4e292 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:18.551628 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55f618-9eaa-4450-80f7-ca829f82bf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:18.552241 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55f618-9eaa-4450-80f7-ca829f82bf14 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:18.552528 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55f618-9eaa-4450-80f7-ca829f82bf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:18.552806 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55f618-9eaa-4450-80f7-ca829f82bf14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:18.553450 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b55f618-9eaa-4450-80f7-ca829f82bf14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:18.555867 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b55f618-9eaa-4450-80f7-ca829f82bf14 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:18.664084 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 945/1897] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:26:18 2022] POST /identity/v3/projects => generated 401 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:26:18.668932 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bd113-3441-4d35-acb9-768997b0db8a None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:18.678326 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bd113-3441-4d35-acb9-768997b0db8a None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:18.791544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:18.805500 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f8ed13-e846-4432-b474-3179b4f9ed70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:18.806663 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8ed13-e846-4432-b474-3179b4f9ed70 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:18.811589 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8ed13-e846-4432-b474-3179b4f9ed70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:18.812104 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8ed13-e846-4432-b474-3179b4f9ed70 admin admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:18.813432 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f8ed13-e846-4432-b474-3179b4f9ed70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:18.815532 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f8ed13-e846-4432-b474-3179b4f9ed70 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:18.958031 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 953/1898] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:26:18 2022] POST /identity/v3/users => generated 307 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:26:18.961897 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55f618-9eaa-4450-80f7-ca829f82bf14 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:18.978518 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55f618-9eaa-4450-80f7-ca829f82bf14 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:18.989323 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f819f-8d47-4d9f-a26a-e6e245a7986d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:18.991298 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f819f-8d47-4d9f-a26a-e6e245a7986d admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:18.991298 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f819f-8d47-4d9f-a26a-e6e245a7986d admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:18.995257 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f819f-8d47-4d9f-a26a-e6e245a7986d admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:18.995257 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f819f-8d47-4d9f-a26a-e6e245a7986d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:18.995257 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f819f-8d47-4d9f-a26a-e6e245a7986d admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:19.010312 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 946/1899] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:26:19.016551 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f8ed13-e846-4432-b474-3179b4f9ed70 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:19.028205 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f8ed13-e846-4432-b474-3179b4f9ed70 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:19.032797 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae87128-a9b8-4f27-88d4-9920d36bda66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:19.033464 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae87128-a9b8-4f27-88d4-9920d36bda66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:19.033745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae87128-a9b8-4f27-88d4-9920d36bda66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:19.034869 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae87128-a9b8-4f27-88d4-9920d36bda66 admin admin] PATH_INFO: `/v3/projects/6c16bf06654c4abdb728a90c166370c9/users/e91ad11a7ec14ef1801fa78ef3fc3187/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:19.050001 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae87128-a9b8-4f27-88d4-9920d36bda66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c16bf06654c4abdb728a90c166370c9, user_id=e91ad11a7ec14ef1801fa78ef3fc3187, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:19.052741 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae87128-a9b8-4f27-88d4-9920d36bda66 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:19.169889 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 954/1900] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:26:19 2022] PUT /identity/v3/projects/6c16bf06654c4abdb728a90c166370c9/users/e91ad11a7ec14ef1801fa78ef3fc3187/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:26:19.173913 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f819f-8d47-4d9f-a26a-e6e245a7986d admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:19.183930 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f819f-8d47-4d9f-a26a-e6e245a7986d admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:19.239830 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947667b-dce7-4741-b139-530888686475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:19.240436 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947667b-dce7-4741-b139-530888686475 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:19.240721 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947667b-dce7-4741-b139-530888686475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:19.241007 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947667b-dce7-4741-b139-530888686475 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:19.241639 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1947667b-dce7-4741-b139-530888686475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:19.243215 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1947667b-dce7-4741-b139-530888686475 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:19.253170 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 947/1901] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:26:19.257388 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae87128-a9b8-4f27-88d4-9920d36bda66 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:19.268464 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae87128-a9b8-4f27-88d4-9920d36bda66 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:19.273083 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc0d23-e217-4877-bfe1-b73ec85a2561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:19.273732 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc0d23-e217-4877-bfe1-b73ec85a2561 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:19.274018 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc0d23-e217-4877-bfe1-b73ec85a2561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:19.274298 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc0d23-e217-4877-bfe1-b73ec85a2561 admin admin] PATH_INFO: `/v3/projects/6c16bf06654c4abdb728a90c166370c9/users/e91ad11a7ec14ef1801fa78ef3fc3187/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:19.276342 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc0d23-e217-4877-bfe1-b73ec85a2561 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c16bf06654c4abdb728a90c166370c9, user_id=e91ad11a7ec14ef1801fa78ef3fc3187, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:19.278958 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc0d23-e217-4877-bfe1-b73ec85a2561 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:19.289172 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 955/1902] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:26:19 2022] PUT /identity/v3/projects/6c16bf06654c4abdb728a90c166370c9/users/e91ad11a7ec14ef1801fa78ef3fc3187/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:19.304562 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8131996-42fc-4fe1-8915-948ed4955a93 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:19.304894 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8131996-42fc-4fe1-8915-948ed4955a93 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:19.305178 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8131996-42fc-4fe1-8915-948ed4955a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:19.333665 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-c8131996-42fc-4fe1-8915-948ed4955a93 None None] MFA Rules not processed for user `e91ad11a7ec14ef1801fa78ef3fc3187`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:19.334875 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-c8131996-42fc-4fe1-8915-948ed4955a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:19.412532 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 948/1903] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:19 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:19.423408 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc0d23-e217-4877-bfe1-b73ec85a2561 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:19.425094 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-9ebc0d23-e217-4877-bfe1-b73ec85a2561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:19.482101 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc0d23-e217-4877-bfe1-b73ec85a2561 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:19.486249 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f3b01-d8ed-40c7-a8c2-ac8f8c46fc16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:19.487236 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f3b01-d8ed-40c7-a8c2-ac8f8c46fc16 service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:19.487552 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f3b01-d8ed-40c7-a8c2-ac8f8c46fc16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:19.487832 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f3b01-d8ed-40c7-a8c2-ac8f8c46fc16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:19.497723 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36f3b01-d8ed-40c7-a8c2-ac8f8c46fc16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:19.499172 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36f3b01-d8ed-40c7-a8c2-ac8f8c46fc16 service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:19.509561 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 956/1904] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:19 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:26:19.842391 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8131996-42fc-4fe1-8915-948ed4955a93 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:19.843846 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-c8131996-42fc-4fe1-8915-948ed4955a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:19.856229 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8131996-42fc-4fe1-8915-948ed4955a93 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:19.859800 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07fa5b0-3866-4147-b5b7-2860470cc996 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:19.860346 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fa5b0-3866-4147-b5b7-2860470cc996 service cinder] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:19.860628 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fa5b0-3866-4147-b5b7-2860470cc996 service cinder] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:19.860906 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fa5b0-3866-4147-b5b7-2860470cc996 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:19.917791 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07fa5b0-3866-4147-b5b7-2860470cc996 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:19.919290 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07fa5b0-3866-4147-b5b7-2860470cc996 service cinder] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:19.928596 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 949/1905] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:19 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:26:20.007104 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:20.974011 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:21.763000 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:24.073777 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:24.455321 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:24.746841 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1f203-b819-4cc9-ac90-44695c4a1549 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:24.747309 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1f203-b819-4cc9-ac90-44695c4a1549 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:24.747635 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1f203-b819-4cc9-ac90-44695c4a1549 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:24.749048 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 957/1906] 10.222.0.23 () {54 vars in 921 bytes} [Mon Aug 8 02:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:26:24.784914 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb10d63-b6f7-406e-8329-c3117ad33936 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:24.785121 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb10d63-b6f7-406e-8329-c3117ad33936 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:24.785614 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb10d63-b6f7-406e-8329-c3117ad33936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:24.814979 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-dbb10d63-b6f7-406e-8329-c3117ad33936 None None] MFA Rules not processed for user `43a39dd539974180a8165e34de57b552`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:24.816945 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-dbb10d63-b6f7-406e-8329-c3117ad33936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:24.906367 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 950/1907] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Aug 8 02:26:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:24.927909 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1f203-b819-4cc9-ac90-44695c4a1549 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:24.929832 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-32a1f203-b819-4cc9-ac90-44695c4a1549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:24.952006 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1f203-b819-4cc9-ac90-44695c4a1549 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:24.957955 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68dd1a-5cfe-440c-962f-794281381a75 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43a39dd539974180a8165e34de57b552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:24.958612 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68dd1a-5cfe-440c-962f-794281381a75 service placement] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:24.959275 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68dd1a-5cfe-440c-962f-794281381a75 service placement] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:24.959596 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68dd1a-5cfe-440c-962f-794281381a75 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:24.969632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68dd1a-5cfe-440c-962f-794281381a75 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:24.974797 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68dd1a-5cfe-440c-962f-794281381a75 service placement] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:24.982236 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 958/1908] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:26:24.990179 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb10d63-b6f7-406e-8329-c3117ad33936 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:24.991904 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-dbb10d63-b6f7-406e-8329-c3117ad33936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:25.075872 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb10d63-b6f7-406e-8329-c3117ad33936 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:25.081135 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28bdaa5-22c4-46d1-917c-b00f460911b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:25.081773 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28bdaa5-22c4-46d1-917c-b00f460911b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:25.082058 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28bdaa5-22c4-46d1-917c-b00f460911b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:25.082339 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28bdaa5-22c4-46d1-917c-b00f460911b1 admin admin] PATH_INFO: `/v3/users/2825bb31d1de466d80fcfd3e66bd7fae` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:25.083621 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28bdaa5-22c4-46d1-917c-b00f460911b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2825bb31d1de466d80fcfd3e66bd7fae)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:25.085578 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28bdaa5-22c4-46d1-917c-b00f460911b1 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:25.376732 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c28bdaa5-22c4-46d1-917c-b00f460911b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2825bb31d1de466d80fcfd3e66bd7fae'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:25.459330 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c28bdaa5-22c4-46d1-917c-b00f460911b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2825bb31d1de466d80fcfd3e66bd7fae'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:25.459979 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c28bdaa5-22c4-46d1-917c-b00f460911b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2825bb31d1de466d80fcfd3e66bd7fae'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:25.460590 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c28bdaa5-22c4-46d1-917c-b00f460911b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2825bb31d1de466d80fcfd3e66bd7fae'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:25.473234 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c28bdaa5-22c4-46d1-917c-b00f460911b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2825bb31d1de466d80fcfd3e66bd7fae'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:25.486718 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 951/1909] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:26:24 2022] DELETE /identity/v3/users/2825bb31d1de466d80fcfd3e66bd7fae => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:25.566157 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68dd1a-5cfe-440c-962f-794281381a75 service placement] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:25.578074 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68dd1a-5cfe-440c-962f-794281381a75 service placement] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:25.647432 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f0277-7ec9-4d20-9d37-0a2c978be70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:25.648137 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f0277-7ec9-4d20-9d37-0a2c978be70c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:25.648430 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f0277-7ec9-4d20-9d37-0a2c978be70c admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:25.648736 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f0277-7ec9-4d20-9d37-0a2c978be70c admin admin] PATH_INFO: `/v3/users/193c0f78f5da4b35ad6d8793c57e3196` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:25.649964 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f0277-7ec9-4d20-9d37-0a2c978be70c admin admin] RBAC: Authorizing `identity:delete_user(user_id=193c0f78f5da4b35ad6d8793c57e3196)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:25.651941 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f0277-7ec9-4d20-9d37-0a2c978be70c admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:25.758669 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28bdaa5-22c4-46d1-917c-b00f460911b1 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:25.760898 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-c28bdaa5-22c4-46d1-917c-b00f460911b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:25.788114 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28bdaa5-22c4-46d1-917c-b00f460911b1 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:25.792932 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e1d52-c3a1-4af6-af8e-1679cb2a4772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:25.793568 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e1d52-c3a1-4af6-af8e-1679cb2a4772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:25.793851 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e1d52-c3a1-4af6-af8e-1679cb2a4772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:25.794129 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e1d52-c3a1-4af6-af8e-1679cb2a4772 admin admin] PATH_INFO: `/v3/projects/4369767ae33e4c518c08b981a63fa391` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:25.795252 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e1d52-c3a1-4af6-af8e-1679cb2a4772 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4369767ae33e4c518c08b981a63fa391)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:25.797292 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e1d52-c3a1-4af6-af8e-1679cb2a4772 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:25.858282 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-d64f0277-7ec9-4d20-9d37-0a2c978be70c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '193c0f78f5da4b35ad6d8793c57e3196'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:25.939745 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-a56e1d52-c3a1-4af6-af8e-1679cb2a4772 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4369767ae33e4c518c08b981a63fa391', 'request_id': 'req-a56e1d52-c3a1-4af6-af8e-1679cb2a4772'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:25.946728 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-a56e1d52-c3a1-4af6-af8e-1679cb2a4772 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4369767ae33e4c518c08b981a63fa391', 'request_id': 'req-a56e1d52-c3a1-4af6-af8e-1679cb2a4772'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:25.952687 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-d64f0277-7ec9-4d20-9d37-0a2c978be70c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '193c0f78f5da4b35ad6d8793c57e3196'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:25.953832 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-d64f0277-7ec9-4d20-9d37-0a2c978be70c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '193c0f78f5da4b35ad6d8793c57e3196'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:25.960516 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-a56e1d52-c3a1-4af6-af8e-1679cb2a4772 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4369767ae33e4c518c08b981a63fa391', 'request_id': 'req-a56e1d52-c3a1-4af6-af8e-1679cb2a4772'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:25.972297 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-d64f0277-7ec9-4d20-9d37-0a2c978be70c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '193c0f78f5da4b35ad6d8793c57e3196'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:25.979646 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-d64f0277-7ec9-4d20-9d37-0a2c978be70c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '193c0f78f5da4b35ad6d8793c57e3196'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:25.986021 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 959/1910] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:26:25 2022] DELETE /identity/v3/users/193c0f78f5da4b35ad6d8793c57e3196 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:25.990513 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c9873-6bfd-4ef3-a6f1-7411d84f7976 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:25.994783 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c9873-6bfd-4ef3-a6f1-7411d84f7976 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:25.994783 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c9873-6bfd-4ef3-a6f1-7411d84f7976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:26.014544 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-c73c9873-6bfd-4ef3-a6f1-7411d84f7976 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:26.017471 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-c73c9873-6bfd-4ef3-a6f1-7411d84f7976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:26.079526 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 960/1911] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:26.090387 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c9873-6bfd-4ef3-a6f1-7411d84f7976 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:26.091806 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-c73c9873-6bfd-4ef3-a6f1-7411d84f7976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:26.126709 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-a56e1d52-c3a1-4af6-af8e-1679cb2a4772 admin admin] The token cache is being invalidate because project 4369767ae33e4c518c08b981a63fa391 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:26:26.126709 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-a56e1d52-c3a1-4af6-af8e-1679cb2a4772 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:26.126709 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-a56e1d52-c3a1-4af6-af8e-1679cb2a4772 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:26.135139 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 952/1912] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:26:25 2022] DELETE /identity/v3/projects/4369767ae33e4c518c08b981a63fa391 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:26.142288 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553000a7-7cd9-49d0-ace8-978062643484 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:26.142734 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553000a7-7cd9-49d0-ace8-978062643484 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:26.143021 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553000a7-7cd9-49d0-ace8-978062643484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:26.157371 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c9873-6bfd-4ef3-a6f1-7411d84f7976 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:26.161200 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae68d3-b38c-4833-a0d3-3e23856d8d6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:26.161813 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae68d3-b38c-4833-a0d3-3e23856d8d6d service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:26.162100 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae68d3-b38c-4833-a0d3-3e23856d8d6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:26.162377 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae68d3-b38c-4833-a0d3-3e23856d8d6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:26.164252 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-e7ae68d3-b38c-4833-a0d3-3e23856d8d6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:26.165314 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-553000a7-7cd9-49d0-ace8-978062643484 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:26.167464 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-553000a7-7cd9-49d0-ace8-978062643484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:26.176880 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae68d3-b38c-4833-a0d3-3e23856d8d6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:26.178349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae68d3-b38c-4833-a0d3-3e23856d8d6d service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:26.179493 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 953/1913] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:26:26.186759 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05bd94-e4a0-492e-824d-d45a2b1f0c0e None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:26.187053 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05bd94-e4a0-492e-824d-d45a2b1f0c0e None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:26.187334 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05bd94-e4a0-492e-824d-d45a2b1f0c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:26.191625 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 961/1914] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:26:26.219571 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-ff05bd94-e4a0-492e-824d-d45a2b1f0c0e None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:26.220837 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-ff05bd94-e4a0-492e-824d-d45a2b1f0c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:26.237688 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 954/1915] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:26:26.244972 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae68d3-b38c-4833-a0d3-3e23856d8d6d service neutron] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:26.254865 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae68d3-b38c-4833-a0d3-3e23856d8d6d service neutron] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:26.260162 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8089f-c9a0-4ee7-8fee-b410fa46aa32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:26.260772 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8089f-c9a0-4ee7-8fee-b410fa46aa32 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:26.261114 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8089f-c9a0-4ee7-8fee-b410fa46aa32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:26.261394 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8089f-c9a0-4ee7-8fee-b410fa46aa32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:26.262041 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b8089f-c9a0-4ee7-8fee-b410fa46aa32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:26:26.262351 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b8089f-c9a0-4ee7-8fee-b410fa46aa32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:26.264016 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b8089f-c9a0-4ee7-8fee-b410fa46aa32 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:26.283482 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 962/1916] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:26:26.284870 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05bd94-e4a0-492e-824d-d45a2b1f0c0e None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:26.294242 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05bd94-e4a0-492e-824d-d45a2b1f0c0e None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:26.299989 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38897a-da63-4e8c-8f9a-71e676d815f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:26.300737 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38897a-da63-4e8c-8f9a-71e676d815f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:26.301122 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38897a-da63-4e8c-8f9a-71e676d815f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:26.301590 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38897a-da63-4e8c-8f9a-71e676d815f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:26.302180 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d38897a-da63-4e8c-8f9a-71e676d815f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:26.304243 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d38897a-da63-4e8c-8f9a-71e676d815f0 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:26.468820 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 955/1917] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:26:26 2022] POST /identity/v3/projects => generated 375 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:26:26.482357 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8089f-c9a0-4ee7-8fee-b410fa46aa32 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:26.493299 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8089f-c9a0-4ee7-8fee-b410fa46aa32 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:26.559130 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a5b9f-4f6f-4739-8fae-a8d745bdad52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:26.559794 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a5b9f-4f6f-4739-8fae-a8d745bdad52 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:26.560076 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a5b9f-4f6f-4739-8fae-a8d745bdad52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:26.560345 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a5b9f-4f6f-4739-8fae-a8d745bdad52 admin admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:26.561843 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a5b9f-4f6f-4739-8fae-a8d745bdad52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:26.565447 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a5b9f-4f6f-4739-8fae-a8d745bdad52 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:26.627836 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38897a-da63-4e8c-8f9a-71e676d815f0 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:26.629673 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-8d38897a-da63-4e8c-8f9a-71e676d815f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:26.646099 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38897a-da63-4e8c-8f9a-71e676d815f0 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:26.652974 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e49df-06c4-48c2-b17a-39c3048d71cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:26.653602 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e49df-06c4-48c2-b17a-39c3048d71cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:26.653812 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e49df-06c4-48c2-b17a-39c3048d71cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:26.654101 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e49df-06c4-48c2-b17a-39c3048d71cd admin admin] PATH_INFO: `/v3/projects/1f5300bb210e40199991becc3260756b` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:26.655272 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e49df-06c4-48c2-b17a-39c3048d71cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f5300bb210e40199991becc3260756b)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:26.657914 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e49df-06c4-48c2-b17a-39c3048d71cd admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:26.700027 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 963/1918] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:26:26 2022] POST /identity/v3/users => generated 288 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:26:26.704482 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a5b9f-4f6f-4739-8fae-a8d745bdad52 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:26.714238 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a5b9f-4f6f-4739-8fae-a8d745bdad52 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:26.718907 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b90231-fc57-4276-8320-0d6ec04aa552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:26.720175 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b90231-fc57-4276-8320-0d6ec04aa552 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:26.720935 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b90231-fc57-4276-8320-0d6ec04aa552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:26.721223 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b90231-fc57-4276-8320-0d6ec04aa552 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:26.721867 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b90231-fc57-4276-8320-0d6ec04aa552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:26.723594 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b90231-fc57-4276-8320-0d6ec04aa552 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:26.733968 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 964/1919] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:26:26.737753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b90231-fc57-4276-8320-0d6ec04aa552 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:26.747020 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b90231-fc57-4276-8320-0d6ec04aa552 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:26.752172 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ec5f8-0c37-4fcf-82a0-0c637591a80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:26.755007 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ec5f8-0c37-4fcf-82a0-0c637591a80b admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:26.755007 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ec5f8-0c37-4fcf-82a0-0c637591a80b admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:26.755007 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ec5f8-0c37-4fcf-82a0-0c637591a80b admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:26.755007 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ec5f8-0c37-4fcf-82a0-0c637591a80b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:26.755481 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ec5f8-0c37-4fcf-82a0-0c637591a80b admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:26.765039 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 965/1920] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:26:26.769413 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ec5f8-0c37-4fcf-82a0-0c637591a80b admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:26.778547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ec5f8-0c37-4fcf-82a0-0c637591a80b admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:26.791521 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-243e49df-06c4-48c2-b17a-39c3048d71cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f5300bb210e40199991becc3260756b', 'request_id': 'req-243e49df-06c4-48c2-b17a-39c3048d71cd'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:26.798040 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-243e49df-06c4-48c2-b17a-39c3048d71cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f5300bb210e40199991becc3260756b', 'request_id': 'req-243e49df-06c4-48c2-b17a-39c3048d71cd'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:26.803195 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-243e49df-06c4-48c2-b17a-39c3048d71cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f5300bb210e40199991becc3260756b', 'request_id': 'req-243e49df-06c4-48c2-b17a-39c3048d71cd'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:26.834337 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755fdd9a-0ae4-49bd-b706-18765051430f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:26.835001 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fdd9a-0ae4-49bd-b706-18765051430f admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:26.835289 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fdd9a-0ae4-49bd-b706-18765051430f admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:26.835600 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fdd9a-0ae4-49bd-b706-18765051430f admin admin] PATH_INFO: `/v3/projects/91b2d3afc51244a6ad979123a4c7c508/users/0a1e57c6f1114324bbe7e609d9e23974/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:26.850102 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755fdd9a-0ae4-49bd-b706-18765051430f admin admin] RBAC: Authorizing `identity:create_grant(project_id=91b2d3afc51244a6ad979123a4c7c508, user_id=0a1e57c6f1114324bbe7e609d9e23974, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:26.852785 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755fdd9a-0ae4-49bd-b706-18765051430f admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:26.904902 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-243e49df-06c4-48c2-b17a-39c3048d71cd admin admin] The token cache is being invalidate because project 1f5300bb210e40199991becc3260756b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:26:26.905754 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-243e49df-06c4-48c2-b17a-39c3048d71cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:26.906429 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-243e49df-06c4-48c2-b17a-39c3048d71cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:26.908022 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 956/1921] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:26:26 2022] DELETE /identity/v3/projects/1f5300bb210e40199991becc3260756b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:26:26.911852 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e49df-06c4-48c2-b17a-39c3048d71cd admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:26.913157 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-243e49df-06c4-48c2-b17a-39c3048d71cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:26.925539 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e49df-06c4-48c2-b17a-39c3048d71cd admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:26.930068 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8b2cd-6c95-4380-a19d-7f553d1ad6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:26.930689 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8b2cd-6c95-4380-a19d-7f553d1ad6ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:26.930975 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8b2cd-6c95-4380-a19d-7f553d1ad6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:26.931254 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8b2cd-6c95-4380-a19d-7f553d1ad6ba admin admin] PATH_INFO: `/v3/users/e91ad11a7ec14ef1801fa78ef3fc3187` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:26.932394 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8b2cd-6c95-4380-a19d-7f553d1ad6ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=e91ad11a7ec14ef1801fa78ef3fc3187)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:26.934288 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8b2cd-6c95-4380-a19d-7f553d1ad6ba admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:26.979665 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 966/1922] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:26:26 2022] PUT /identity/v3/projects/91b2d3afc51244a6ad979123a4c7c508/users/0a1e57c6f1114324bbe7e609d9e23974/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:26:26.989713 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641686ad-1a16-4257-bdee-e096662aacd1 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:26.989996 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641686ad-1a16-4257-bdee-e096662aacd1 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:26.990265 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641686ad-1a16-4257-bdee-e096662aacd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:27.017521 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-641686ad-1a16-4257-bdee-e096662aacd1 None None] MFA Rules not processed for user `0a1e57c6f1114324bbe7e609d9e23974`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:27.018825 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-641686ad-1a16-4257-bdee-e096662aacd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:27.084728 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 967/1923] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:26:27.095903 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641686ad-1a16-4257-bdee-e096662aacd1 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:27.097219 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-641686ad-1a16-4257-bdee-e096662aacd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:27.174184 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641686ad-1a16-4257-bdee-e096662aacd1 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:27.180983 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e52e3d-cfa2-4662-b023-aab9ade06390 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:27.181455 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-1da8b2cd-6c95-4380-a19d-7f553d1ad6ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e91ad11a7ec14ef1801fa78ef3fc3187'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:27.181581 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e52e3d-cfa2-4662-b023-aab9ade06390 service nova] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:27.181884 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e52e3d-cfa2-4662-b023-aab9ade06390 service nova] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:27.182134 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e52e3d-cfa2-4662-b023-aab9ade06390 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:27.191416 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e52e3d-cfa2-4662-b023-aab9ade06390 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:27.193022 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e52e3d-cfa2-4662-b023-aab9ade06390 service nova] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:27.202073 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 968/1924] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:26:27.315496 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-1da8b2cd-6c95-4380-a19d-7f553d1ad6ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e91ad11a7ec14ef1801fa78ef3fc3187'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:27.316234 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-1da8b2cd-6c95-4380-a19d-7f553d1ad6ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e91ad11a7ec14ef1801fa78ef3fc3187'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:27.316926 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-1da8b2cd-6c95-4380-a19d-7f553d1ad6ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e91ad11a7ec14ef1801fa78ef3fc3187'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:27.330774 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-1da8b2cd-6c95-4380-a19d-7f553d1ad6ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e91ad11a7ec14ef1801fa78ef3fc3187'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:27.343674 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 957/1925] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:26:26 2022] DELETE /identity/v3/users/e91ad11a7ec14ef1801fa78ef3fc3187 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:26:27.592080 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e52e3d-cfa2-4662-b023-aab9ade06390 service nova] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:27.593737 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-49e52e3d-cfa2-4662-b023-aab9ade06390 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:27.661030 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e52e3d-cfa2-4662-b023-aab9ade06390 service nova] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:27.732716 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208f728-0e95-418a-b9ed-c041151ffd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:27.733367 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208f728-0e95-418a-b9ed-c041151ffd41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:27.733633 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208f728-0e95-418a-b9ed-c041151ffd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:27.733911 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208f728-0e95-418a-b9ed-c041151ffd41 admin admin] PATH_INFO: `/v3/users/0a1e57c6f1114324bbe7e609d9e23974` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:27.735050 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6208f728-0e95-418a-b9ed-c041151ffd41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a1e57c6f1114324bbe7e609d9e23974)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:27.737025 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6208f728-0e95-418a-b9ed-c041151ffd41 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:27.888110 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8b2cd-6c95-4380-a19d-7f553d1ad6ba admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:27.889523 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-1da8b2cd-6c95-4380-a19d-7f553d1ad6ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:27.903386 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8b2cd-6c95-4380-a19d-7f553d1ad6ba admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:27.908383 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0289d-7b02-4119-8990-e69193fe1d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:27.909161 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0289d-7b02-4119-8990-e69193fe1d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:27.909444 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0289d-7b02-4119-8990-e69193fe1d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:27.909730 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0289d-7b02-4119-8990-e69193fe1d1e admin admin] PATH_INFO: `/v3/projects/6c16bf06654c4abdb728a90c166370c9` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:27.910904 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0289d-7b02-4119-8990-e69193fe1d1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c16bf06654c4abdb728a90c166370c9)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:27.912918 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0289d-7b02-4119-8990-e69193fe1d1e admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:27.981108 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-6208f728-0e95-418a-b9ed-c041151ffd41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a1e57c6f1114324bbe7e609d9e23974'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:28.059949 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-b0c0289d-7b02-4119-8990-e69193fe1d1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c16bf06654c4abdb728a90c166370c9', 'request_id': 'req-b0c0289d-7b02-4119-8990-e69193fe1d1e'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:28.066374 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-b0c0289d-7b02-4119-8990-e69193fe1d1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c16bf06654c4abdb728a90c166370c9', 'request_id': 'req-b0c0289d-7b02-4119-8990-e69193fe1d1e'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:28.072714 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-b0c0289d-7b02-4119-8990-e69193fe1d1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c16bf06654c4abdb728a90c166370c9', 'request_id': 'req-b0c0289d-7b02-4119-8990-e69193fe1d1e'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:28.073770 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-6208f728-0e95-418a-b9ed-c041151ffd41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a1e57c6f1114324bbe7e609d9e23974'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:28.074443 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-6208f728-0e95-418a-b9ed-c041151ffd41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a1e57c6f1114324bbe7e609d9e23974'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:28.087284 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-6208f728-0e95-418a-b9ed-c041151ffd41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a1e57c6f1114324bbe7e609d9e23974'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:28.093949 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-6208f728-0e95-418a-b9ed-c041151ffd41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a1e57c6f1114324bbe7e609d9e23974'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:28.099904 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 969/1926] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:26:27 2022] DELETE /identity/v3/users/0a1e57c6f1114324bbe7e609d9e23974 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:28.104339 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6466ae-f6eb-4666-93dd-71a06625d3f7 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:28.104632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6466ae-f6eb-4666-93dd-71a06625d3f7 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:28.104908 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6466ae-f6eb-4666-93dd-71a06625d3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:28.124304 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-fc6466ae-f6eb-4666-93dd-71a06625d3f7 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:28.126186 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-fc6466ae-f6eb-4666-93dd-71a06625d3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:28.183219 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 970/1927] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:26:28.192760 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6466ae-f6eb-4666-93dd-71a06625d3f7 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:28.194104 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-fc6466ae-f6eb-4666-93dd-71a06625d3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:28.211921 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-b0c0289d-7b02-4119-8990-e69193fe1d1e admin admin] The token cache is being invalidate because project 6c16bf06654c4abdb728a90c166370c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:26:28.212140 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-b0c0289d-7b02-4119-8990-e69193fe1d1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:28.212930 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-b0c0289d-7b02-4119-8990-e69193fe1d1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:28.214416 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 958/1928] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:26:27 2022] DELETE /identity/v3/projects/6c16bf06654c4abdb728a90c166370c9 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:26:28.219700 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdaa2c-c51f-4ed4-88ff-08315bda5d24 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:28.220050 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdaa2c-c51f-4ed4-88ff-08315bda5d24 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:28.220425 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdaa2c-c51f-4ed4-88ff-08315bda5d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:28.239426 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-4fcdaa2c-c51f-4ed4-88ff-08315bda5d24 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:28.240741 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-4fcdaa2c-c51f-4ed4-88ff-08315bda5d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:28.248720 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 959/1929] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:28.250818 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6466ae-f6eb-4666-93dd-71a06625d3f7 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:28.259462 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338726ff-1254-494e-8126-51d6a8e143f2 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:28.259751 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338726ff-1254-494e-8126-51d6a8e143f2 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:28.260029 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338726ff-1254-494e-8126-51d6a8e143f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:28.263189 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889aa4d2-aec2-414c-9261-8ee3cbc54590 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:28.264165 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889aa4d2-aec2-414c-9261-8ee3cbc54590 service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:28.264460 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889aa4d2-aec2-414c-9261-8ee3cbc54590 service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:28.265698 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889aa4d2-aec2-414c-9261-8ee3cbc54590 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:28.268072 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-889aa4d2-aec2-414c-9261-8ee3cbc54590 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:28.282445 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889aa4d2-aec2-414c-9261-8ee3cbc54590 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:28.283937 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889aa4d2-aec2-414c-9261-8ee3cbc54590 service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:28.284863 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-338726ff-1254-494e-8126-51d6a8e143f2 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:28.286060 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-338726ff-1254-494e-8126-51d6a8e143f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:28.293855 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 960/1930] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:26:28.294213 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 971/1931] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:26:28.298215 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338726ff-1254-494e-8126-51d6a8e143f2 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:28.308219 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338726ff-1254-494e-8126-51d6a8e143f2 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:28.314152 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb7e62-4c0f-4d4a-bddf-33492f7bc554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:28.314746 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb7e62-4c0f-4d4a-bddf-33492f7bc554 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:28.315026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb7e62-4c0f-4d4a-bddf-33492f7bc554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:28.315304 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb7e62-4c0f-4d4a-bddf-33492f7bc554 admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:28.315978 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb7e62-4c0f-4d4a-bddf-33492f7bc554 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:26:28.316280 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb7e62-4c0f-4d4a-bddf-33492f7bc554 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:28.317860 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb7e62-4c0f-4d4a-bddf-33492f7bc554 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:28.332838 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 961/1932] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:26:28.337099 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889aa4d2-aec2-414c-9261-8ee3cbc54590 service neutron] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:28.347187 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889aa4d2-aec2-414c-9261-8ee3cbc54590 service neutron] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:28.352115 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7b3b7-7adf-4a00-8a3b-df9075d5cae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:28.352717 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7b3b7-7adf-4a00-8a3b-df9075d5cae2 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:28.352997 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7b3b7-7adf-4a00-8a3b-df9075d5cae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:28.353273 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7b3b7-7adf-4a00-8a3b-df9075d5cae2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:28.354025 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7b3b7-7adf-4a00-8a3b-df9075d5cae2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:28.355974 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7b3b7-7adf-4a00-8a3b-df9075d5cae2 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:28.363274 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:28.534346 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 972/1933] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:26:28 2022] POST /identity/v3/projects => generated 371 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:26:28.535575 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb7e62-4c0f-4d4a-bddf-33492f7bc554 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:28.546058 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb7e62-4c0f-4d4a-bddf-33492f7bc554 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:28.647907 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5515aa-039f-4f7a-a191-377c28fe6c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:28.648598 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5515aa-039f-4f7a-a191-377c28fe6c0a admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:28.648955 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5515aa-039f-4f7a-a191-377c28fe6c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:28.649299 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5515aa-039f-4f7a-a191-377c28fe6c0a admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:28.650125 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5515aa-039f-4f7a-a191-377c28fe6c0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:28.652071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5515aa-039f-4f7a-a191-377c28fe6c0a admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:28.806933 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 962/1934] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:26:28 2022] POST /identity/v3/users => generated 286 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:26:28.811220 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7b3b7-7adf-4a00-8a3b-df9075d5cae2 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:28.822081 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7b3b7-7adf-4a00-8a3b-df9075d5cae2 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:28.826571 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647325aa-7eda-4bbb-83c4-22945acb8a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:28.827161 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647325aa-7eda-4bbb-83c4-22945acb8a0b admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:28.827483 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647325aa-7eda-4bbb-83c4-22945acb8a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:28.827779 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647325aa-7eda-4bbb-83c4-22945acb8a0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:28.828907 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647325aa-7eda-4bbb-83c4-22945acb8a0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:28.832165 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647325aa-7eda-4bbb-83c4-22945acb8a0b admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:28.832940 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:28.840241 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5515aa-039f-4f7a-a191-377c28fe6c0a admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:28.844944 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-ec5515aa-039f-4f7a-a191-377c28fe6c0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:28.845271 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 973/1935] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:26:28.848388 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647325aa-7eda-4bbb-83c4-22945acb8a0b admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:28.859953 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647325aa-7eda-4bbb-83c4-22945acb8a0b admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:28.865774 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554a361-1fbe-4e5f-b7e1-38629b278e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:28.866913 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554a361-1fbe-4e5f-b7e1-38629b278e7f admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:28.867469 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554a361-1fbe-4e5f-b7e1-38629b278e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:28.868023 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554a361-1fbe-4e5f-b7e1-38629b278e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:28.868630 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7554a361-1fbe-4e5f-b7e1-38629b278e7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:28.870483 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7554a361-1fbe-4e5f-b7e1-38629b278e7f admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:28.870833 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5515aa-039f-4f7a-a191-377c28fe6c0a admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:28.876608 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1eed20-0af3-49bc-bf3b-7ef5c23fa84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:28.877270 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1eed20-0af3-49bc-bf3b-7ef5c23fa84d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:28.877553 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1eed20-0af3-49bc-bf3b-7ef5c23fa84d admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:28.877831 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1eed20-0af3-49bc-bf3b-7ef5c23fa84d admin admin] PATH_INFO: `/v3/projects/91b2d3afc51244a6ad979123a4c7c508` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:28.879049 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1eed20-0af3-49bc-bf3b-7ef5c23fa84d admin admin] RBAC: Authorizing `identity:delete_project(project_id=91b2d3afc51244a6ad979123a4c7c508)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:28.881798 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1eed20-0af3-49bc-bf3b-7ef5c23fa84d admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:28.883186 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 974/1936] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:26:28.887514 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554a361-1fbe-4e5f-b7e1-38629b278e7f admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:28.899886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554a361-1fbe-4e5f-b7e1-38629b278e7f admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:28.905179 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707c6f4-0e71-4f3a-a8e5-3038b83d15c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:28.905817 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707c6f4-0e71-4f3a-a8e5-3038b83d15c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:28.906162 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707c6f4-0e71-4f3a-a8e5-3038b83d15c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:28.907169 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707c6f4-0e71-4f3a-a8e5-3038b83d15c4 admin admin] PATH_INFO: `/v3/projects/1cdb819d4ee14cf5b88da385f4a74fda/users/1cc1e75117a247718ee6976b92c52ef9/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:28.923080 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4707c6f4-0e71-4f3a-a8e5-3038b83d15c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cdb819d4ee14cf5b88da385f4a74fda, user_id=1cc1e75117a247718ee6976b92c52ef9, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:28.925914 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4707c6f4-0e71-4f3a-a8e5-3038b83d15c4 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:29.091133 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 975/1937] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:26:28 2022] PUT /identity/v3/projects/1cdb819d4ee14cf5b88da385f4a74fda/users/1cc1e75117a247718ee6976b92c52ef9/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:29.103347 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-ae1eed20-0af3-49bc-bf3b-7ef5c23fa84d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91b2d3afc51244a6ad979123a4c7c508', 'request_id': 'req-ae1eed20-0af3-49bc-bf3b-7ef5c23fa84d'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:29.104636 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9c7fe-2b57-4d0e-bb39-ad81381737b0 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:29.104924 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9c7fe-2b57-4d0e-bb39-ad81381737b0 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:29.105200 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9c7fe-2b57-4d0e-bb39-ad81381737b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:29.110021 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-ae1eed20-0af3-49bc-bf3b-7ef5c23fa84d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91b2d3afc51244a6ad979123a4c7c508', 'request_id': 'req-ae1eed20-0af3-49bc-bf3b-7ef5c23fa84d'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:29.116852 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-ae1eed20-0af3-49bc-bf3b-7ef5c23fa84d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91b2d3afc51244a6ad979123a4c7c508', 'request_id': 'req-ae1eed20-0af3-49bc-bf3b-7ef5c23fa84d'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:29.124243 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-40f9c7fe-2b57-4d0e-bb39-ad81381737b0 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:29.126169 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-40f9c7fe-2b57-4d0e-bb39-ad81381737b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:29.188823 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 976/1938] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:29.198139 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-ae1eed20-0af3-49bc-bf3b-7ef5c23fa84d admin admin] The token cache is being invalidate because project 91b2d3afc51244a6ad979123a4c7c508 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:26:29.198551 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-ae1eed20-0af3-49bc-bf3b-7ef5c23fa84d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:29.202297 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-ae1eed20-0af3-49bc-bf3b-7ef5c23fa84d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:29.202426 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9c7fe-2b57-4d0e-bb39-ad81381737b0 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:29.206004 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-40f9c7fe-2b57-4d0e-bb39-ad81381737b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:29.210539 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 963/1939] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:26:28 2022] DELETE /identity/v3/projects/91b2d3afc51244a6ad979123a4c7c508 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:29.212380 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7452d-b6d8-4a25-85b4-3de144517518 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:29.212942 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7452d-b6d8-4a25-85b4-3de144517518 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:29.213936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7452d-b6d8-4a25-85b4-3de144517518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:29.238361 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-4df7452d-b6d8-4a25-85b4-3de144517518 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:29.240019 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-4df7452d-b6d8-4a25-85b4-3de144517518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:29.249618 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 964/1940] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:29.257688 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67bd78a-6947-475b-9a8a-50bb053244f0 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:29.257975 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67bd78a-6947-475b-9a8a-50bb053244f0 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:29.258258 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67bd78a-6947-475b-9a8a-50bb053244f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:29.271241 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9c7fe-2b57-4d0e-bb39-ad81381737b0 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:29.274931 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77167a89-6fb0-466f-9554-2fdec3986907 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:29.275566 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77167a89-6fb0-466f-9554-2fdec3986907 service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:29.275851 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77167a89-6fb0-466f-9554-2fdec3986907 service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:29.276235 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77167a89-6fb0-466f-9554-2fdec3986907 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:29.277519 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-a67bd78a-6947-475b-9a8a-50bb053244f0 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:29.277940 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-77167a89-6fb0-466f-9554-2fdec3986907 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:29.278701 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-a67bd78a-6947-475b-9a8a-50bb053244f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:29.286720 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 965/1941] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:26:29.290623 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77167a89-6fb0-466f-9554-2fdec3986907 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:29.292064 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77167a89-6fb0-466f-9554-2fdec3986907 service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:29.297469 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67bd78a-6947-475b-9a8a-50bb053244f0 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:29.301596 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 977/1942] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:26:29.306521 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67bd78a-6947-475b-9a8a-50bb053244f0 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:29.311565 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd07224-7008-4c1a-9a6a-e5801878b507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:29.312252 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd07224-7008-4c1a-9a6a-e5801878b507 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:29.312537 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd07224-7008-4c1a-9a6a-e5801878b507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:29.313337 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd07224-7008-4c1a-9a6a-e5801878b507 admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:29.313987 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd07224-7008-4c1a-9a6a-e5801878b507 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:26:29.314295 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd07224-7008-4c1a-9a6a-e5801878b507 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:29.316003 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd07224-7008-4c1a-9a6a-e5801878b507 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:29.327797 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 966/1943] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:26:29.333394 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77167a89-6fb0-466f-9554-2fdec3986907 service neutron] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:29.342807 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77167a89-6fb0-466f-9554-2fdec3986907 service neutron] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:29.347414 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab69a6e-8b34-414b-a8b5-07fff1b161c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:29.347986 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab69a6e-8b34-414b-a8b5-07fff1b161c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:29.348264 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab69a6e-8b34-414b-a8b5-07fff1b161c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:29.348536 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab69a6e-8b34-414b-a8b5-07fff1b161c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:29.349154 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab69a6e-8b34-414b-a8b5-07fff1b161c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:29.351021 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab69a6e-8b34-414b-a8b5-07fff1b161c5 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:29.395557 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd07224-7008-4c1a-9a6a-e5801878b507 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:29.397294 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-4bd07224-7008-4c1a-9a6a-e5801878b507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:29.410229 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd07224-7008-4c1a-9a6a-e5801878b507 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:29.415326 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f5a02-bf25-4e9e-a615-88c15095b637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:29.415495 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f5a02-bf25-4e9e-a615-88c15095b637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:29.415776 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f5a02-bf25-4e9e-a615-88c15095b637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:29.416050 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f5a02-bf25-4e9e-a615-88c15095b637 admin admin] PATH_INFO: `/v3/users/cefdf054643f4ec09e496867e642282d` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:29.417164 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f5a02-bf25-4e9e-a615-88c15095b637 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cefdf054643f4ec09e496867e642282d)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:29.419048 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f5a02-bf25-4e9e-a615-88c15095b637 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:29.491426 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 978/1944] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:26:29 2022] POST /identity/v3/projects => generated 371 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:26:29.495349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab69a6e-8b34-414b-a8b5-07fff1b161c5 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:29.572041 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab69a6e-8b34-414b-a8b5-07fff1b161c5 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:29.576652 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab75a0-50e4-44eb-9221-475844ca29f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:29.577258 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab75a0-50e4-44eb-9221-475844ca29f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:29.577538 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab75a0-50e4-44eb-9221-475844ca29f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:29.577808 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab75a0-50e4-44eb-9221-475844ca29f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:29.578446 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab75a0-50e4-44eb-9221-475844ca29f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:29.580644 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab75a0-50e4-44eb-9221-475844ca29f0 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:29.688082 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 979/1945] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:26:29 2022] POST /identity/v3/users => generated 286 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:26:29.691649 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab75a0-50e4-44eb-9221-475844ca29f0 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:29.704414 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab75a0-50e4-44eb-9221-475844ca29f0 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:29.709654 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d15c7-5903-4d2e-a26c-a5f52f3f3bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:29.710268 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d15c7-5903-4d2e-a26c-a5f52f3f3bca admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:29.710555 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d15c7-5903-4d2e-a26c-a5f52f3f3bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:29.710843 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d15c7-5903-4d2e-a26c-a5f52f3f3bca admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:29.711525 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d15c7-5903-4d2e-a26c-a5f52f3f3bca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:29.713148 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d15c7-5903-4d2e-a26c-a5f52f3f3bca admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:29.725188 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 980/1946] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:26:29.729297 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d15c7-5903-4d2e-a26c-a5f52f3f3bca admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:29.739013 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d15c7-5903-4d2e-a26c-a5f52f3f3bca admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:29.743815 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7eb2d-c0a0-499a-8de8-76c7433400bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:29.744513 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7eb2d-c0a0-499a-8de8-76c7433400bc admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:29.744867 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7eb2d-c0a0-499a-8de8-76c7433400bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:29.745213 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7eb2d-c0a0-499a-8de8-76c7433400bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:29.745923 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c7eb2d-c0a0-499a-8de8-76c7433400bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:29.747714 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c7eb2d-c0a0-499a-8de8-76c7433400bc admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:29.762365 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 981/1947] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:26:29.763248 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7eb2d-c0a0-499a-8de8-76c7433400bc admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:29.773541 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7eb2d-c0a0-499a-8de8-76c7433400bc admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:29.778473 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-880f5a02-bf25-4e9e-a615-88c15095b637 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cefdf054643f4ec09e496867e642282d'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:29.778622 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665009b-2ba6-4344-b965-a6235da90ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:29.779242 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665009b-2ba6-4344-b965-a6235da90ff0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:29.779576 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665009b-2ba6-4344-b965-a6235da90ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:29.779858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665009b-2ba6-4344-b965-a6235da90ff0 admin admin] PATH_INFO: `/v3/projects/fab4c11597ee4b33b5358f0160b6c5ff/users/95f29579dc8d40c2b916592913f01a00/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:29.796631 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c665009b-2ba6-4344-b965-a6235da90ff0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fab4c11597ee4b33b5358f0160b6c5ff, user_id=95f29579dc8d40c2b916592913f01a00, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:29.799737 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c665009b-2ba6-4344-b965-a6235da90ff0 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:29.926606 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-880f5a02-bf25-4e9e-a615-88c15095b637 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cefdf054643f4ec09e496867e642282d'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:29.927261 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-880f5a02-bf25-4e9e-a615-88c15095b637 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cefdf054643f4ec09e496867e642282d'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:29.928149 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-880f5a02-bf25-4e9e-a615-88c15095b637 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cefdf054643f4ec09e496867e642282d'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:29.933476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 982/1948] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:26:29 2022] PUT /identity/v3/projects/fab4c11597ee4b33b5358f0160b6c5ff/users/95f29579dc8d40c2b916592913f01a00/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:29.942455 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-880f5a02-bf25-4e9e-a615-88c15095b637 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cefdf054643f4ec09e496867e642282d'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:29.945491 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0dd1f-1464-407c-be0c-3d4418bf3121 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:29.945789 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0dd1f-1464-407c-be0c-3d4418bf3121 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:29.946075 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0dd1f-1464-407c-be0c-3d4418bf3121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:29.957386 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 967/1949] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:26:29 2022] DELETE /identity/v3/users/cefdf054643f4ec09e496867e642282d => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:26:29.962326 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf735418-a845-478f-bd36-5adb5e120da7 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:29.962981 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf735418-a845-478f-bd36-5adb5e120da7 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:29.964014 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf735418-a845-478f-bd36-5adb5e120da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:29.975901 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-3bb0dd1f-1464-407c-be0c-3d4418bf3121 None None] MFA Rules not processed for user `95f29579dc8d40c2b916592913f01a00`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:29.977128 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-3bb0dd1f-1464-407c-be0c-3d4418bf3121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:29.985691 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-bf735418-a845-478f-bd36-5adb5e120da7 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:29.986903 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-bf735418-a845-478f-bd36-5adb5e120da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:30.044117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 983/1950] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:30.048487 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0dd1f-1464-407c-be0c-3d4418bf3121 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:30.049828 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-3bb0dd1f-1464-407c-be0c-3d4418bf3121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:30.060168 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 968/1951] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:30.064570 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0dd1f-1464-407c-be0c-3d4418bf3121 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:30.069958 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20659197-3182-4f9d-b29d-2339a06304f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:30.070661 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20659197-3182-4f9d-b29d-2339a06304f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:30.070942 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20659197-3182-4f9d-b29d-2339a06304f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:30.071390 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20659197-3182-4f9d-b29d-2339a06304f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:30.071892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20659197-3182-4f9d-b29d-2339a06304f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:30.072245 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf735418-a845-478f-bd36-5adb5e120da7 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:30.073805 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20659197-3182-4f9d-b29d-2339a06304f7 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:30.073995 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-bf735418-a845-478f-bd36-5adb5e120da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:30.131918 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf735418-a845-478f-bd36-5adb5e120da7 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:30.135727 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63233d2-9eb3-48d0-8acb-595989409d7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:30.136339 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63233d2-9eb3-48d0-8acb-595989409d7a service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:30.136620 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63233d2-9eb3-48d0-8acb-595989409d7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:30.136895 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63233d2-9eb3-48d0-8acb-595989409d7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:30.146334 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63233d2-9eb3-48d0-8acb-595989409d7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:30.147810 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63233d2-9eb3-48d0-8acb-595989409d7a service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:30.158410 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 969/1952] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:26:30.226221 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 984/1953] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:26:30 2022] POST /identity/v3/projects => generated 373 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:26:30.230276 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63233d2-9eb3-48d0-8acb-595989409d7a service neutron] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:30.239951 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63233d2-9eb3-48d0-8acb-595989409d7a service neutron] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:30.297226 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1caa4-7e7b-4939-ad30-38130f67d1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:30.298188 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1caa4-7e7b-4939-ad30-38130f67d1bf admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:30.298609 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1caa4-7e7b-4939-ad30-38130f67d1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:30.299192 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1caa4-7e7b-4939-ad30-38130f67d1bf admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:30.300173 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1caa4-7e7b-4939-ad30-38130f67d1bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:30.302650 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1caa4-7e7b-4939-ad30-38130f67d1bf admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:30.407880 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 970/1954] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:26:30 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:26:30.411931 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20659197-3182-4f9d-b29d-2339a06304f7 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:30.422560 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20659197-3182-4f9d-b29d-2339a06304f7 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:30.427474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf3571-06fd-4d8f-9ba0-512011bbbfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:30.428223 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf3571-06fd-4d8f-9ba0-512011bbbfb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:30.428505 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf3571-06fd-4d8f-9ba0-512011bbbfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:30.428779 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf3571-06fd-4d8f-9ba0-512011bbbfb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:30.429433 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf3571-06fd-4d8f-9ba0-512011bbbfb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:30.431063 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf3571-06fd-4d8f-9ba0-512011bbbfb7 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:30.443442 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 985/1955] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:26:30.447806 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1caa4-7e7b-4939-ad30-38130f67d1bf admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:30.455675 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:30.459382 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1caa4-7e7b-4939-ad30-38130f67d1bf admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:30.464398 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad24b44-aa3e-46f9-811d-1f23f11cec6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:30.465072 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad24b44-aa3e-46f9-811d-1f23f11cec6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:30.465460 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad24b44-aa3e-46f9-811d-1f23f11cec6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:30.465740 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad24b44-aa3e-46f9-811d-1f23f11cec6a admin admin] PATH_INFO: `/v3/projects/7dfd85d3ef3947c7abb17e668738a8a1/users/14ce6b68d0ba40efb348f34ffdbf5b12/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:30.482129 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad24b44-aa3e-46f9-811d-1f23f11cec6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dfd85d3ef3947c7abb17e668738a8a1, user_id=14ce6b68d0ba40efb348f34ffdbf5b12, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:30.484840 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad24b44-aa3e-46f9-811d-1f23f11cec6a admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:30.597172 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 971/1956] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:26:30 2022] PUT /identity/v3/projects/7dfd85d3ef3947c7abb17e668738a8a1/users/14ce6b68d0ba40efb348f34ffdbf5b12/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:30.601190 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf3571-06fd-4d8f-9ba0-512011bbbfb7 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:30.613653 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf3571-06fd-4d8f-9ba0-512011bbbfb7 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:30.681890 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3bfc3b-d69d-4c37-84df-545e9194f813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:30.682725 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bfc3b-d69d-4c37-84df-545e9194f813 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:30.683125 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bfc3b-d69d-4c37-84df-545e9194f813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:30.683430 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bfc3b-d69d-4c37-84df-545e9194f813 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:30.684276 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3bfc3b-d69d-4c37-84df-545e9194f813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:30.688400 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3bfc3b-d69d-4c37-84df-545e9194f813 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:30.702284 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad24b44-aa3e-46f9-811d-1f23f11cec6a admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:30.702815 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 986/1957] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:26:30.715737 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad24b44-aa3e-46f9-811d-1f23f11cec6a admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:30.722547 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e0339-beaa-44b9-a3f4-e3218b708718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:30.723215 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e0339-beaa-44b9-a3f4-e3218b708718 admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:30.723552 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e0339-beaa-44b9-a3f4-e3218b708718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:30.723843 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e0339-beaa-44b9-a3f4-e3218b708718 admin admin] PATH_INFO: `/v3/projects/7dfd85d3ef3947c7abb17e668738a8a1/users/14ce6b68d0ba40efb348f34ffdbf5b12/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:30.725981 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e0339-beaa-44b9-a3f4-e3218b708718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dfd85d3ef3947c7abb17e668738a8a1, user_id=14ce6b68d0ba40efb348f34ffdbf5b12, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:30.728829 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e0339-beaa-44b9-a3f4-e3218b708718 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:30.751905 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 972/1958] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:26:30 2022] PUT /identity/v3/projects/7dfd85d3ef3947c7abb17e668738a8a1/users/14ce6b68d0ba40efb348f34ffdbf5b12/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:30.755671 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21163842-e349-46c8-8c93-b9214833abfb None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:30.755965 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21163842-e349-46c8-8c93-b9214833abfb None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:30.756234 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21163842-e349-46c8-8c93-b9214833abfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:30.783665 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-21163842-e349-46c8-8c93-b9214833abfb None None] MFA Rules not processed for user `14ce6b68d0ba40efb348f34ffdbf5b12`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:30.784858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-21163842-e349-46c8-8c93-b9214833abfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:30.858728 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 987/1959] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:30 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:26:30.866876 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e0339-beaa-44b9-a3f4-e3218b708718 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:30.868955 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-db7e0339-beaa-44b9-a3f4-e3218b708718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:30.897503 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21163842-e349-46c8-8c93-b9214833abfb None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:30.898832 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-21163842-e349-46c8-8c93-b9214833abfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:30.983576 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e0339-beaa-44b9-a3f4-e3218b708718 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:30.989488 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e13737-c4a2-452c-9db4-aa472cdb5c8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:30.990735 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e13737-c4a2-452c-9db4-aa472cdb5c8b service cinder] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:30.991023 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e13737-c4a2-452c-9db4-aa472cdb5c8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:30.991381 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e13737-c4a2-452c-9db4-aa472cdb5c8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:30.996656 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21163842-e349-46c8-8c93-b9214833abfb None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:31.002994 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e7070-d717-4122-83ba-1d562e75cf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:31.004098 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e7070-d717-4122-83ba-1d562e75cf96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:31.004236 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e13737-c4a2-452c-9db4-aa472cdb5c8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:31.004394 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e7070-d717-4122-83ba-1d562e75cf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:31.004671 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e7070-d717-4122-83ba-1d562e75cf96 admin admin] PATH_INFO: `/v3/projects/64fb076e649d40c18b218e4dc6fdb8a1` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:31.005840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e7070-d717-4122-83ba-1d562e75cf96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64fb076e649d40c18b218e4dc6fdb8a1)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:31.006551 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e13737-c4a2-452c-9db4-aa472cdb5c8b service cinder] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:31.007770 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e7070-d717-4122-83ba-1d562e75cf96 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:31.018982 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 973/1960] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:26:31.200863 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-527e7070-d717-4122-83ba-1d562e75cf96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64fb076e649d40c18b218e4dc6fdb8a1', 'request_id': 'req-527e7070-d717-4122-83ba-1d562e75cf96'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:31.208955 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-527e7070-d717-4122-83ba-1d562e75cf96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64fb076e649d40c18b218e4dc6fdb8a1', 'request_id': 'req-527e7070-d717-4122-83ba-1d562e75cf96'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:31.218602 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-527e7070-d717-4122-83ba-1d562e75cf96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64fb076e649d40c18b218e4dc6fdb8a1', 'request_id': 'req-527e7070-d717-4122-83ba-1d562e75cf96'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:31.371553 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94a916-a273-403d-8fd5-def3f0c47fa0 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:31.372048 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94a916-a273-403d-8fd5-def3f0c47fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:31.372128 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94a916-a273-403d-8fd5-def3f0c47fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:31.376694 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-527e7070-d717-4122-83ba-1d562e75cf96 admin admin] The token cache is being invalidate because project 64fb076e649d40c18b218e4dc6fdb8a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:26:31.377245 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-527e7070-d717-4122-83ba-1d562e75cf96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:31.379270 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-527e7070-d717-4122-83ba-1d562e75cf96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:31.381264 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 988/1961] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:26:30 2022] DELETE /identity/v3/projects/64fb076e649d40c18b218e4dc6fdb8a1 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:26:31.385670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e7070-d717-4122-83ba-1d562e75cf96 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:31.388897 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-527e7070-d717-4122-83ba-1d562e75cf96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:31.426619 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-fa94a916-a273-403d-8fd5-def3f0c47fa0 None None] MFA Rules not processed for user `1cc1e75117a247718ee6976b92c52ef9`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:31.428415 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-fa94a916-a273-403d-8fd5-def3f0c47fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:31.474678 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e7070-d717-4122-83ba-1d562e75cf96 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:31.479691 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587918d8-3937-4519-bc0d-c9b63d264919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:31.480406 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587918d8-3937-4519-bc0d-c9b63d264919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:31.480765 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587918d8-3937-4519-bc0d-c9b63d264919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:31.481117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587918d8-3937-4519-bc0d-c9b63d264919 admin admin] PATH_INFO: `/v3/users/ad6b0d40be9241aaab5d95910b1f7a6a` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:31.482401 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587918d8-3937-4519-bc0d-c9b63d264919 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad6b0d40be9241aaab5d95910b1f7a6a)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:31.484659 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587918d8-3937-4519-bc0d-c9b63d264919 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:31.515396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 974/1962] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:26:31.532955 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94a916-a273-403d-8fd5-def3f0c47fa0 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:31.534444 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-fa94a916-a273-403d-8fd5-def3f0c47fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:31.595294 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94a916-a273-403d-8fd5-def3f0c47fa0 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:31.599116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a601c-1101-4658-81ef-5e8682b888d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:31.599780 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a601c-1101-4658-81ef-5e8682b888d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:31.600058 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a601c-1101-4658-81ef-5e8682b888d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:31.600329 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a601c-1101-4658-81ef-5e8682b888d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:31.608697 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a601c-1101-4658-81ef-5e8682b888d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:31.610638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a601c-1101-4658-81ef-5e8682b888d3 service cinder] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:31.620181 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 975/1963] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:26:31.620181 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a601c-1101-4658-81ef-5e8682b888d3 service cinder] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:31.621481 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-145a601c-1101-4658-81ef-5e8682b888d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:31.632637 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a601c-1101-4658-81ef-5e8682b888d3 service cinder] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:31.636353 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6fef41-ce68-451a-8e45-e1ab68120378 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:31.636935 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6fef41-ce68-451a-8e45-e1ab68120378 service cinder] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:31.637214 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6fef41-ce68-451a-8e45-e1ab68120378 service cinder] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:31.637980 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6fef41-ce68-451a-8e45-e1ab68120378 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:31.639777 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-df6fef41-ce68-451a-8e45-e1ab68120378 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:31.643139 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:31.707163 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6fef41-ce68-451a-8e45-e1ab68120378 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:31.708773 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6fef41-ce68-451a-8e45-e1ab68120378 service cinder] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:31.720169 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 976/1964] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:26:31.720435 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-587918d8-3937-4519-bc0d-c9b63d264919 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad6b0d40be9241aaab5d95910b1f7a6a'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:31.802564 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-587918d8-3937-4519-bc0d-c9b63d264919 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad6b0d40be9241aaab5d95910b1f7a6a'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:31.803182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-587918d8-3937-4519-bc0d-c9b63d264919 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad6b0d40be9241aaab5d95910b1f7a6a'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:31.815153 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-587918d8-3937-4519-bc0d-c9b63d264919 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad6b0d40be9241aaab5d95910b1f7a6a'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:31.821796 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-587918d8-3937-4519-bc0d-c9b63d264919 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad6b0d40be9241aaab5d95910b1f7a6a'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:31.827546 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 989/1965] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:26:31 2022] DELETE /identity/v3/users/ad6b0d40be9241aaab5d95910b1f7a6a => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:32.306230 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6fef41-ce68-451a-8e45-e1ab68120378 service cinder] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:32.317121 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6fef41-ce68-451a-8e45-e1ab68120378 service cinder] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:32.388875 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca55d4-a3c4-4a60-874c-46a4588fbad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:32.389517 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca55d4-a3c4-4a60-874c-46a4588fbad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:32.389779 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca55d4-a3c4-4a60-874c-46a4588fbad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:32.389971 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca55d4-a3c4-4a60-874c-46a4588fbad7 admin admin] PATH_INFO: `/v3/projects/1da806392c7c464787f76bb0cd08158e` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:32.391137 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca55d4-a3c4-4a60-874c-46a4588fbad7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1da806392c7c464787f76bb0cd08158e)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:32.393081 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca55d4-a3c4-4a60-874c-46a4588fbad7 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:32.510096 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:32.542773 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-3dca55d4-a3c4-4a60-874c-46a4588fbad7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1da806392c7c464787f76bb0cd08158e', 'request_id': 'req-3dca55d4-a3c4-4a60-874c-46a4588fbad7'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:32.550296 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-3dca55d4-a3c4-4a60-874c-46a4588fbad7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1da806392c7c464787f76bb0cd08158e', 'request_id': 'req-3dca55d4-a3c4-4a60-874c-46a4588fbad7'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:32.558607 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-3dca55d4-a3c4-4a60-874c-46a4588fbad7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1da806392c7c464787f76bb0cd08158e', 'request_id': 'req-3dca55d4-a3c4-4a60-874c-46a4588fbad7'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:32.696827 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-3dca55d4-a3c4-4a60-874c-46a4588fbad7 admin admin] The token cache is being invalidate because project 1da806392c7c464787f76bb0cd08158e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:26:32.697125 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-3dca55d4-a3c4-4a60-874c-46a4588fbad7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:32.697784 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-3dca55d4-a3c4-4a60-874c-46a4588fbad7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:32.699630 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 977/1966] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:26:32 2022] DELETE /identity/v3/projects/1da806392c7c464787f76bb0cd08158e => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:32.705367 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb0de9-6bdb-49ca-80d6-7da763ab6805 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:32.705710 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb0de9-6bdb-49ca-80d6-7da763ab6805 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:32.706033 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb0de9-6bdb-49ca-80d6-7da763ab6805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:32.728914 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-aafb0de9-6bdb-49ca-80d6-7da763ab6805 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:32.730106 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-aafb0de9-6bdb-49ca-80d6-7da763ab6805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:32.791470 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 990/1967] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:32.799067 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5a814-ddf1-4639-b804-373e70b02c9b None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:32.799366 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5a814-ddf1-4639-b804-373e70b02c9b None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:32.799651 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5a814-ddf1-4639-b804-373e70b02c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:32.821688 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-bdd5a814-ddf1-4639-b804-373e70b02c9b None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:32.822931 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-bdd5a814-ddf1-4639-b804-373e70b02c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:32.835522 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 978/1968] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:32.836669 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb0de9-6bdb-49ca-80d6-7da763ab6805 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:32.847313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb0de9-6bdb-49ca-80d6-7da763ab6805 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:32.852041 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663704f6-ce78-475d-a7ef-04ca689728bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:32.852667 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663704f6-ce78-475d-a7ef-04ca689728bd admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:32.852938 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663704f6-ce78-475d-a7ef-04ca689728bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:32.853213 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663704f6-ce78-475d-a7ef-04ca689728bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:32.853885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663704f6-ce78-475d-a7ef-04ca689728bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:26:32.854191 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663704f6-ce78-475d-a7ef-04ca689728bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:32.855829 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663704f6-ce78-475d-a7ef-04ca689728bd admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:32.868316 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 991/1969] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:26:32.872957 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5a814-ddf1-4639-b804-373e70b02c9b None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:32.885333 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5a814-ddf1-4639-b804-373e70b02c9b None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:32.892463 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4551b-2de3-4baf-b36a-4149fa55c8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:32.893068 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4551b-2de3-4baf-b36a-4149fa55c8d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:32.893353 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4551b-2de3-4baf-b36a-4149fa55c8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:32.893653 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4551b-2de3-4baf-b36a-4149fa55c8d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:32.894292 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f4551b-2de3-4baf-b36a-4149fa55c8d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:32.896255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f4551b-2de3-4baf-b36a-4149fa55c8d1 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:33.010715 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 979/1970] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:26:32 2022] POST /identity/v3/projects => generated 367 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:26:33.016771 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663704f6-ce78-475d-a7ef-04ca689728bd admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:33.029204 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663704f6-ce78-475d-a7ef-04ca689728bd admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:33.081942 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe2bf8-303a-4feb-b6d4-b5545e21b8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:33.082556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe2bf8-303a-4feb-b6d4-b5545e21b8eb admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:33.082843 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe2bf8-303a-4feb-b6d4-b5545e21b8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:33.083149 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe2bf8-303a-4feb-b6d4-b5545e21b8eb admin admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:33.083799 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe2bf8-303a-4feb-b6d4-b5545e21b8eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:33.085702 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe2bf8-303a-4feb-b6d4-b5545e21b8eb admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:33.197511 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4551b-2de3-4baf-b36a-4149fa55c8d1 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:33.199265 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-63f4551b-2de3-4baf-b36a-4149fa55c8d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:33.212774 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4551b-2de3-4baf-b36a-4149fa55c8d1 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:33.217345 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4618ce7f-9004-4f1c-924c-7f0c216bd876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:33.217984 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618ce7f-9004-4f1c-924c-7f0c216bd876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:33.218293 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618ce7f-9004-4f1c-924c-7f0c216bd876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:33.218545 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618ce7f-9004-4f1c-924c-7f0c216bd876 admin admin] PATH_INFO: `/v3/users/95f29579dc8d40c2b916592913f01a00` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:33.226243 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4618ce7f-9004-4f1c-924c-7f0c216bd876 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95f29579dc8d40c2b916592913f01a00)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:33.226375 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 992/1971] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:26:33 2022] POST /identity/v3/users => generated 284 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:26:33.226466 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4618ce7f-9004-4f1c-924c-7f0c216bd876 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:33.230800 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe2bf8-303a-4feb-b6d4-b5545e21b8eb admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:33.241656 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe2bf8-303a-4feb-b6d4-b5545e21b8eb admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:33.246604 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444df1a3-39e4-421e-80e5-f3712b2148a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:33.247207 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444df1a3-39e4-421e-80e5-f3712b2148a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:33.247550 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444df1a3-39e4-421e-80e5-f3712b2148a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:33.247807 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444df1a3-39e4-421e-80e5-f3712b2148a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:33.248434 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444df1a3-39e4-421e-80e5-f3712b2148a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:33.250213 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444df1a3-39e4-421e-80e5-f3712b2148a6 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:33.266460 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 993/1972] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:26:33.269093 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444df1a3-39e4-421e-80e5-f3712b2148a6 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:33.278658 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444df1a3-39e4-421e-80e5-f3712b2148a6 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:33.284224 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0052c1a-eb9b-43cf-af07-75d033657162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:33.284835 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0052c1a-eb9b-43cf-af07-75d033657162 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:33.285115 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0052c1a-eb9b-43cf-af07-75d033657162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:33.285392 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0052c1a-eb9b-43cf-af07-75d033657162 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:33.286031 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0052c1a-eb9b-43cf-af07-75d033657162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:33.287894 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0052c1a-eb9b-43cf-af07-75d033657162 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:33.298170 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 994/1973] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:26:33.302212 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0052c1a-eb9b-43cf-af07-75d033657162 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:33.312019 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0052c1a-eb9b-43cf-af07-75d033657162 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:33.316677 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b946cc-8ad0-4c1b-802e-0e51169d5c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:33.317381 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b946cc-8ad0-4c1b-802e-0e51169d5c51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:33.317663 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b946cc-8ad0-4c1b-802e-0e51169d5c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:33.317940 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b946cc-8ad0-4c1b-802e-0e51169d5c51 admin admin] PATH_INFO: `/v3/projects/3ee214d6ae2c4f998c6484ebcaca32eb/users/adffe4a1d6dd46dd8646cc54016e37ed/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:33.333196 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b946cc-8ad0-4c1b-802e-0e51169d5c51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ee214d6ae2c4f998c6484ebcaca32eb, user_id=adffe4a1d6dd46dd8646cc54016e37ed, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:33.335863 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b946cc-8ad0-4c1b-802e-0e51169d5c51 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:33.452445 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 995/1974] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:26:33 2022] PUT /identity/v3/projects/3ee214d6ae2c4f998c6484ebcaca32eb/users/adffe4a1d6dd46dd8646cc54016e37ed/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:33.463939 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a235680-3d6c-4a3d-aac1-02b66414b582 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:33.464230 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a235680-3d6c-4a3d-aac1-02b66414b582 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:33.464510 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a235680-3d6c-4a3d-aac1-02b66414b582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:33.489922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-4618ce7f-9004-4f1c-924c-7f0c216bd876 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95f29579dc8d40c2b916592913f01a00'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:33.496256 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-9a235680-3d6c-4a3d-aac1-02b66414b582 None None] MFA Rules not processed for user `adffe4a1d6dd46dd8646cc54016e37ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:33.497619 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-9a235680-3d6c-4a3d-aac1-02b66414b582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:33.572405 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-4618ce7f-9004-4f1c-924c-7f0c216bd876 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95f29579dc8d40c2b916592913f01a00'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:33.573164 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-4618ce7f-9004-4f1c-924c-7f0c216bd876 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95f29579dc8d40c2b916592913f01a00'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:33.573863 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-4618ce7f-9004-4f1c-924c-7f0c216bd876 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95f29579dc8d40c2b916592913f01a00'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:33.575458 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 996/1975] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:26:33.580563 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc66cd-1144-4845-a46b-103ddcbbf4fc None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:33.580950 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc66cd-1144-4845-a46b-103ddcbbf4fc None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:33.581154 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc66cd-1144-4845-a46b-103ddcbbf4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:33.587565 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-4618ce7f-9004-4f1c-924c-7f0c216bd876 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95f29579dc8d40c2b916592913f01a00'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:33.599782 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-5dcc66cd-1144-4845-a46b-103ddcbbf4fc None None] MFA Rules not processed for user `1cc1e75117a247718ee6976b92c52ef9`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:33.600188 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 980/1976] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:26:33 2022] DELETE /identity/v3/users/95f29579dc8d40c2b916592913f01a00 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:26:33.603395 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-5dcc66cd-1144-4845-a46b-103ddcbbf4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:33.603523 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4618ce7f-9004-4f1c-924c-7f0c216bd876 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:33.604442 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-4618ce7f-9004-4f1c-924c-7f0c216bd876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:33.654623 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 997/1977] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:33.660902 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af0362-8c1d-449f-b2b1-61dfe39b7e97 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:33.661245 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af0362-8c1d-449f-b2b1-61dfe39b7e97 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:33.661676 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af0362-8c1d-449f-b2b1-61dfe39b7e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:33.667490 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4618ce7f-9004-4f1c-924c-7f0c216bd876 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:33.673407 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365cba3-f16d-4cdf-b1b1-de395f82830f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:33.674012 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365cba3-f16d-4cdf-b1b1-de395f82830f admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:33.674294 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365cba3-f16d-4cdf-b1b1-de395f82830f admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:33.674572 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365cba3-f16d-4cdf-b1b1-de395f82830f admin admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:33.675212 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365cba3-f16d-4cdf-b1b1-de395f82830f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:33.677336 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365cba3-f16d-4cdf-b1b1-de395f82830f admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:33.682940 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-09af0362-8c1d-449f-b2b1-61dfe39b7e97 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:33.684163 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-09af0362-8c1d-449f-b2b1-61dfe39b7e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:33.692633 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 998/1978] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:33.702448 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af0362-8c1d-449f-b2b1-61dfe39b7e97 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:33.703968 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-09af0362-8c1d-449f-b2b1-61dfe39b7e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:33.760684 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af0362-8c1d-449f-b2b1-61dfe39b7e97 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:33.764290 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cedfd0-083c-4c55-9076-2185a158cf08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:33.764893 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cedfd0-083c-4c55-9076-2185a158cf08 service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:33.765170 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cedfd0-083c-4c55-9076-2185a158cf08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:33.765440 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cedfd0-083c-4c55-9076-2185a158cf08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:33.774818 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cedfd0-083c-4c55-9076-2185a158cf08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:33.776308 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cedfd0-083c-4c55-9076-2185a158cf08 service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:33.786474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 999/1979] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:26:33.808436 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 981/1980] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:26:33 2022] POST /identity/v3/projects => generated 367 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:26:33.812447 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cedfd0-083c-4c55-9076-2185a158cf08 service neutron] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:33.822343 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cedfd0-083c-4c55-9076-2185a158cf08 service neutron] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:33.877974 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478097dd-5662-489e-b374-7986f9ea5e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:33.878592 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478097dd-5662-489e-b374-7986f9ea5e1c admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:33.878872 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478097dd-5662-489e-b374-7986f9ea5e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:33.879144 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478097dd-5662-489e-b374-7986f9ea5e1c admin admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:33.879928 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478097dd-5662-489e-b374-7986f9ea5e1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:33.881904 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478097dd-5662-489e-b374-7986f9ea5e1c admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:33.894486 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:34.055443 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1000/1981] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:26:33 2022] POST /identity/v3/users => generated 290 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:26:34.056602 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365cba3-f16d-4cdf-b1b1-de395f82830f admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:34.067713 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365cba3-f16d-4cdf-b1b1-de395f82830f admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:34.072374 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d204b78-4bd6-43cc-9544-bd010d92ef00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:34.072975 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d204b78-4bd6-43cc-9544-bd010d92ef00 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:34.073268 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d204b78-4bd6-43cc-9544-bd010d92ef00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:34.073574 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d204b78-4bd6-43cc-9544-bd010d92ef00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:34.074230 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d204b78-4bd6-43cc-9544-bd010d92ef00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:34.075993 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d204b78-4bd6-43cc-9544-bd010d92ef00 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:34.087242 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 982/1982] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:26:34.091496 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478097dd-5662-489e-b374-7986f9ea5e1c admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:34.102134 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478097dd-5662-489e-b374-7986f9ea5e1c admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:34.106987 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c111e-56fa-4967-9c4d-a3d6b6bf93db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:34.107673 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c111e-56fa-4967-9c4d-a3d6b6bf93db admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:34.107954 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c111e-56fa-4967-9c4d-a3d6b6bf93db admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:34.108226 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c111e-56fa-4967-9c4d-a3d6b6bf93db admin admin] PATH_INFO: `/v3/projects/4f15003fc7c04e62bd266800b924d9a8/users/b58a77671dfe477ba3c2b08081a715d4/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:34.123699 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c111e-56fa-4967-9c4d-a3d6b6bf93db admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f15003fc7c04e62bd266800b924d9a8, user_id=b58a77671dfe477ba3c2b08081a715d4, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:34.126342 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c111e-56fa-4967-9c4d-a3d6b6bf93db admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:34.261611 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1001/1983] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:26:34 2022] PUT /identity/v3/projects/4f15003fc7c04e62bd266800b924d9a8/users/b58a77671dfe477ba3c2b08081a715d4/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:34.265518 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d204b78-4bd6-43cc-9544-bd010d92ef00 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:34.276645 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d204b78-4bd6-43cc-9544-bd010d92ef00 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:34.334513 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fecd75-1b8b-4dbb-95fc-76b103861ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:34.335118 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fecd75-1b8b-4dbb-95fc-76b103861ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:34.335429 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fecd75-1b8b-4dbb-95fc-76b103861ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:34.335710 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fecd75-1b8b-4dbb-95fc-76b103861ce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:34.337809 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fecd75-1b8b-4dbb-95fc-76b103861ce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:34.337932 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fecd75-1b8b-4dbb-95fc-76b103861ce1 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:34.347880 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 983/1984] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:26:34.352040 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c111e-56fa-4967-9c4d-a3d6b6bf93db admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:34.362571 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c111e-56fa-4967-9c4d-a3d6b6bf93db admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:34.368017 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ebb10-fea2-432c-a904-c1a3b2f47d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:34.368665 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ebb10-fea2-432c-a904-c1a3b2f47d89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:34.368947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ebb10-fea2-432c-a904-c1a3b2f47d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:34.369222 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ebb10-fea2-432c-a904-c1a3b2f47d89 admin admin] PATH_INFO: `/v3/projects/4f15003fc7c04e62bd266800b924d9a8/users/b58a77671dfe477ba3c2b08081a715d4/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:34.371093 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ebb10-fea2-432c-a904-c1a3b2f47d89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f15003fc7c04e62bd266800b924d9a8, user_id=b58a77671dfe477ba3c2b08081a715d4, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:34.374070 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ebb10-fea2-432c-a904-c1a3b2f47d89 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:34.397126 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fecd75-1b8b-4dbb-95fc-76b103861ce1 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:34.402426 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-a8fecd75-1b8b-4dbb-95fc-76b103861ce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:34.409533 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1002/1985] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:26:34 2022] PUT /identity/v3/projects/4f15003fc7c04e62bd266800b924d9a8/users/b58a77671dfe477ba3c2b08081a715d4/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:34.422516 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635900c-55b4-4732-8c87-9873f96fabfa None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:34.422516 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635900c-55b4-4732-8c87-9873f96fabfa None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:34.422516 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635900c-55b4-4732-8c87-9873f96fabfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:34.436938 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fecd75-1b8b-4dbb-95fc-76b103861ce1 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:34.486847 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-e635900c-55b4-4732-8c87-9873f96fabfa None None] MFA Rules not processed for user `b58a77671dfe477ba3c2b08081a715d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:34.489288 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-e635900c-55b4-4732-8c87-9873f96fabfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:34.518979 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d32f20-b8f3-42e6-98ca-33003a665f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:34.520649 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d32f20-b8f3-42e6-98ca-33003a665f3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:34.521363 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d32f20-b8f3-42e6-98ca-33003a665f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:34.521791 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d32f20-b8f3-42e6-98ca-33003a665f3b admin admin] PATH_INFO: `/v3/projects/fab4c11597ee4b33b5358f0160b6c5ff` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:34.523466 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d32f20-b8f3-42e6-98ca-33003a665f3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fab4c11597ee4b33b5358f0160b6c5ff)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:34.526046 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d32f20-b8f3-42e6-98ca-33003a665f3b admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:34.627409 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1003/1986] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:34.643270 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635900c-55b4-4732-8c87-9873f96fabfa None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:34.644790 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-e635900c-55b4-4732-8c87-9873f96fabfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:34.655475 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-92d32f20-b8f3-42e6-98ca-33003a665f3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fab4c11597ee4b33b5358f0160b6c5ff', 'request_id': 'req-92d32f20-b8f3-42e6-98ca-33003a665f3b'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:34.662868 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-92d32f20-b8f3-42e6-98ca-33003a665f3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fab4c11597ee4b33b5358f0160b6c5ff', 'request_id': 'req-92d32f20-b8f3-42e6-98ca-33003a665f3b'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:34.671729 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-92d32f20-b8f3-42e6-98ca-33003a665f3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fab4c11597ee4b33b5358f0160b6c5ff', 'request_id': 'req-92d32f20-b8f3-42e6-98ca-33003a665f3b'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:34.704792 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635900c-55b4-4732-8c87-9873f96fabfa None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:34.758146 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c12f6-7b61-41a8-8ee9-977d82f09b85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:34.758795 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c12f6-7b61-41a8-8ee9-977d82f09b85 service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:34.759084 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c12f6-7b61-41a8-8ee9-977d82f09b85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:34.759380 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c12f6-7b61-41a8-8ee9-977d82f09b85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:34.773684 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-92d32f20-b8f3-42e6-98ca-33003a665f3b admin admin] The token cache is being invalidate because project fab4c11597ee4b33b5358f0160b6c5ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:26:34.774043 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-92d32f20-b8f3-42e6-98ca-33003a665f3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:34.774737 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-92d32f20-b8f3-42e6-98ca-33003a665f3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:34.776679 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 984/1987] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:26:34 2022] DELETE /identity/v3/projects/fab4c11597ee4b33b5358f0160b6c5ff => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:34.780419 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d32f20-b8f3-42e6-98ca-33003a665f3b admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:34.782395 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-92d32f20-b8f3-42e6-98ca-33003a665f3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:34.820394 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c12f6-7b61-41a8-8ee9-977d82f09b85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:34.821750 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c12f6-7b61-41a8-8ee9-977d82f09b85 service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:34.832087 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1004/1988] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:34 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:26:34.845295 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d32f20-b8f3-42e6-98ca-33003a665f3b admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:34.850262 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de5e87-9280-48eb-8741-64bef495fb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:34.850895 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de5e87-9280-48eb-8741-64bef495fb83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:34.851181 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de5e87-9280-48eb-8741-64bef495fb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:34.851495 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de5e87-9280-48eb-8741-64bef495fb83 admin admin] PATH_INFO: `/v3/users/14ce6b68d0ba40efb348f34ffdbf5b12` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:34.852679 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de5e87-9280-48eb-8741-64bef495fb83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14ce6b68d0ba40efb348f34ffdbf5b12)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:34.854604 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de5e87-9280-48eb-8741-64bef495fb83 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:34.865669 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:35.093017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-d6de5e87-9280-48eb-8741-64bef495fb83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14ce6b68d0ba40efb348f34ffdbf5b12'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:35.230486 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-d6de5e87-9280-48eb-8741-64bef495fb83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14ce6b68d0ba40efb348f34ffdbf5b12'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:35.231237 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-d6de5e87-9280-48eb-8741-64bef495fb83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14ce6b68d0ba40efb348f34ffdbf5b12'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:35.233162 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-d6de5e87-9280-48eb-8741-64bef495fb83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14ce6b68d0ba40efb348f34ffdbf5b12'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:35.252160 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-d6de5e87-9280-48eb-8741-64bef495fb83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14ce6b68d0ba40efb348f34ffdbf5b12'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:35.265390 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 985/1989] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:26:34 2022] DELETE /identity/v3/users/14ce6b68d0ba40efb348f34ffdbf5b12 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:26:35.787481 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c12f6-7b61-41a8-8ee9-977d82f09b85 service cinder] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:35.800667 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c12f6-7b61-41a8-8ee9-977d82f09b85 service cinder] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:35.879563 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09bbcaa-a0dd-4b00-a70a-c98b54cafce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:35.880123 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bbcaa-a0dd-4b00-a70a-c98b54cafce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:35.880409 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bbcaa-a0dd-4b00-a70a-c98b54cafce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:35.880685 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bbcaa-a0dd-4b00-a70a-c98b54cafce8 admin admin] PATH_INFO: `/v3/projects/7dfd85d3ef3947c7abb17e668738a8a1` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:35.881831 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09bbcaa-a0dd-4b00-a70a-c98b54cafce8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dfd85d3ef3947c7abb17e668738a8a1)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:35.884018 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09bbcaa-a0dd-4b00-a70a-c98b54cafce8 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:36.072045 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-e09bbcaa-a0dd-4b00-a70a-c98b54cafce8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dfd85d3ef3947c7abb17e668738a8a1', 'request_id': 'req-e09bbcaa-a0dd-4b00-a70a-c98b54cafce8'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:36.077434 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-e09bbcaa-a0dd-4b00-a70a-c98b54cafce8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dfd85d3ef3947c7abb17e668738a8a1', 'request_id': 'req-e09bbcaa-a0dd-4b00-a70a-c98b54cafce8'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:36.084914 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-e09bbcaa-a0dd-4b00-a70a-c98b54cafce8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dfd85d3ef3947c7abb17e668738a8a1', 'request_id': 'req-e09bbcaa-a0dd-4b00-a70a-c98b54cafce8'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:36.195641 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:36.200508 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-e09bbcaa-a0dd-4b00-a70a-c98b54cafce8 admin admin] The token cache is being invalidate because project 7dfd85d3ef3947c7abb17e668738a8a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:26:36.200862 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-e09bbcaa-a0dd-4b00-a70a-c98b54cafce8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:36.201569 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-e09bbcaa-a0dd-4b00-a70a-c98b54cafce8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:36.204440 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1005/1990] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:26:35 2022] DELETE /identity/v3/projects/7dfd85d3ef3947c7abb17e668738a8a1 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:36.208819 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115699a5-a9ab-4cab-8abc-e9cc9855ef01 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:36.209104 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115699a5-a9ab-4cab-8abc-e9cc9855ef01 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:36.209378 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115699a5-a9ab-4cab-8abc-e9cc9855ef01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:36.229510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-115699a5-a9ab-4cab-8abc-e9cc9855ef01 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:36.230697 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-115699a5-a9ab-4cab-8abc-e9cc9855ef01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:36.289103 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 986/1991] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:26:36.298746 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d0452-23f6-40ec-96c4-5e4597ce589d None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:36.299117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d0452-23f6-40ec-96c4-5e4597ce589d None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:36.299500 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d0452-23f6-40ec-96c4-5e4597ce589d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:36.327707 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-e26d0452-23f6-40ec-96c4-5e4597ce589d None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:36.328984 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-e26d0452-23f6-40ec-96c4-5e4597ce589d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:36.337345 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1006/1992] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:26:36.341647 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115699a5-a9ab-4cab-8abc-e9cc9855ef01 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:36.351469 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115699a5-a9ab-4cab-8abc-e9cc9855ef01 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:36.356117 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631931c-26b0-488b-9dc2-f3817c2e737f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:36.356714 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631931c-26b0-488b-9dc2-f3817c2e737f admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:36.357023 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631931c-26b0-488b-9dc2-f3817c2e737f admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:36.357299 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631931c-26b0-488b-9dc2-f3817c2e737f admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:36.357946 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631931c-26b0-488b-9dc2-f3817c2e737f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:26:36.358244 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631931c-26b0-488b-9dc2-f3817c2e737f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:36.360372 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631931c-26b0-488b-9dc2-f3817c2e737f admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:36.371663 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 987/1993] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:26:36.376622 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d0452-23f6-40ec-96c4-5e4597ce589d None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:36.386509 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d0452-23f6-40ec-96c4-5e4597ce589d None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:36.391771 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d7efa-6aee-419e-a59e-991992d6dfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:36.392371 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d7efa-6aee-419e-a59e-991992d6dfe0 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:36.392648 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d7efa-6aee-419e-a59e-991992d6dfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:36.392919 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d7efa-6aee-419e-a59e-991992d6dfe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:36.393599 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d7efa-6aee-419e-a59e-991992d6dfe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:36.395579 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d7efa-6aee-419e-a59e-991992d6dfe0 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:36.419856 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:36.523418 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1007/1994] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:26:36 2022] POST /identity/v3/projects => generated 363 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:26:36.527636 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631931c-26b0-488b-9dc2-f3817c2e737f admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:36.549887 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631931c-26b0-488b-9dc2-f3817c2e737f admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:36.618406 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f632a0-9ab2-494b-8a05-b94e93c13d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:36.619474 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f632a0-9ab2-494b-8a05-b94e93c13d2e admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:36.619764 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f632a0-9ab2-494b-8a05-b94e93c13d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:36.620240 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f632a0-9ab2-494b-8a05-b94e93c13d2e admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:36.620700 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f632a0-9ab2-494b-8a05-b94e93c13d2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:36.622604 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f632a0-9ab2-494b-8a05-b94e93c13d2e admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:36.711104 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 988/1995] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:26:36 2022] POST /identity/v3/users => generated 282 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:26:36.717510 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d7efa-6aee-419e-a59e-991992d6dfe0 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:36.729405 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d7efa-6aee-419e-a59e-991992d6dfe0 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:36.734538 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a99bfc-04f2-4732-993d-2d733fbc1cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:36.735726 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a99bfc-04f2-4732-993d-2d733fbc1cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:36.736004 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a99bfc-04f2-4732-993d-2d733fbc1cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:36.736293 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a99bfc-04f2-4732-993d-2d733fbc1cd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:36.736910 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a99bfc-04f2-4732-993d-2d733fbc1cd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:36.738490 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a99bfc-04f2-4732-993d-2d733fbc1cd4 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:36.749037 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1008/1996] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:26:36.753332 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f632a0-9ab2-494b-8a05-b94e93c13d2e admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:36.763279 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f632a0-9ab2-494b-8a05-b94e93c13d2e admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:36.767910 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2856a669-5c34-4da5-ba3b-e6ab93fa3b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:36.768500 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856a669-5c34-4da5-ba3b-e6ab93fa3b87 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:36.768783 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856a669-5c34-4da5-ba3b-e6ab93fa3b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:36.769061 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856a669-5c34-4da5-ba3b-e6ab93fa3b87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:36.769703 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2856a669-5c34-4da5-ba3b-e6ab93fa3b87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:36.771282 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2856a669-5c34-4da5-ba3b-e6ab93fa3b87 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:36.782606 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 989/1997] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:26:36.786508 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a99bfc-04f2-4732-993d-2d733fbc1cd4 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:36.797688 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a99bfc-04f2-4732-993d-2d733fbc1cd4 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:36.802456 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf6799-f743-4902-8859-5d04bff41c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:36.803110 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf6799-f743-4902-8859-5d04bff41c87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:36.803416 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf6799-f743-4902-8859-5d04bff41c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:36.803696 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf6799-f743-4902-8859-5d04bff41c87 admin admin] PATH_INFO: `/v3/projects/a57e571b795242779f771e858b405f6b/users/ee6de1d9748b43c3b74e3554afceac94/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:36.819011 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf6799-f743-4902-8859-5d04bff41c87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a57e571b795242779f771e858b405f6b, user_id=ee6de1d9748b43c3b74e3554afceac94, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:36.822843 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf6799-f743-4902-8859-5d04bff41c87 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:36.944894 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1009/1998] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:26:36 2022] PUT /identity/v3/projects/a57e571b795242779f771e858b405f6b/users/ee6de1d9748b43c3b74e3554afceac94/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:36.955749 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24a9d5-5390-426d-a4c8-717511686459 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:36.956267 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24a9d5-5390-426d-a4c8-717511686459 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:36.956500 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24a9d5-5390-426d-a4c8-717511686459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:36.995831 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-ae24a9d5-5390-426d-a4c8-717511686459 None None] MFA Rules not processed for user `ee6de1d9748b43c3b74e3554afceac94`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:36.996868 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-ae24a9d5-5390-426d-a4c8-717511686459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:37.076198 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 990/1999] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:37.077812 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf6799-f743-4902-8859-5d04bff41c87 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:37.143314 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf6799-f743-4902-8859-5d04bff41c87 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:37.150720 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c8351-b957-4229-8ac1-634f22edf042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:37.151336 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c8351-b957-4229-8ac1-634f22edf042 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:37.151653 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c8351-b957-4229-8ac1-634f22edf042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:37.151927 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c8351-b957-4229-8ac1-634f22edf042 admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:37.152563 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c8351-b957-4229-8ac1-634f22edf042 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:37.154480 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c8351-b957-4229-8ac1-634f22edf042 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:37.252229 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1010/2000] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:26:37 2022] POST /identity/v3/projects => generated 363 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:26:37.256508 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24a9d5-5390-426d-a4c8-717511686459 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:37.273855 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24a9d5-5390-426d-a4c8-717511686459 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:37.337020 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4256792-e8a6-4280-bd47-08039a7f26a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:37.337632 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4256792-e8a6-4280-bd47-08039a7f26a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:37.337912 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4256792-e8a6-4280-bd47-08039a7f26a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:37.338185 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4256792-e8a6-4280-bd47-08039a7f26a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:37.338801 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4256792-e8a6-4280-bd47-08039a7f26a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:37.340778 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4256792-e8a6-4280-bd47-08039a7f26a7 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:37.471080 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 991/2001] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:26:37 2022] POST /identity/v3/users => generated 288 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:26:37.474930 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c8351-b957-4229-8ac1-634f22edf042 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:37.487035 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c8351-b957-4229-8ac1-634f22edf042 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:37.491984 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f1f90-4597-49e2-9515-de45e8f2b55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:37.492665 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f1f90-4597-49e2-9515-de45e8f2b55d admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:37.492980 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f1f90-4597-49e2-9515-de45e8f2b55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:37.495558 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f1f90-4597-49e2-9515-de45e8f2b55d admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:37.495558 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f1f90-4597-49e2-9515-de45e8f2b55d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:37.495807 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f1f90-4597-49e2-9515-de45e8f2b55d admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:37.508239 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1011/2002] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:26:37.512134 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4256792-e8a6-4280-bd47-08039a7f26a7 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:37.522949 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4256792-e8a6-4280-bd47-08039a7f26a7 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:37.527719 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e0b44-8423-4bab-9841-4534c7db639a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:37.528826 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e0b44-8423-4bab-9841-4534c7db639a admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:37.528826 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e0b44-8423-4bab-9841-4534c7db639a admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:37.528991 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e0b44-8423-4bab-9841-4534c7db639a admin admin] PATH_INFO: `/v3/projects/90d303456d8843d2acca7491b37dc5c1/users/ad1c0b2018f34e4ab62ec9b6ac839862/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:37.545765 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e0b44-8423-4bab-9841-4534c7db639a admin admin] RBAC: Authorizing `identity:create_grant(project_id=90d303456d8843d2acca7491b37dc5c1, user_id=ad1c0b2018f34e4ab62ec9b6ac839862, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:37.549207 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e0b44-8423-4bab-9841-4534c7db639a admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:37.682811 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 992/2003] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:26:37 2022] PUT /identity/v3/projects/90d303456d8843d2acca7491b37dc5c1/users/ad1c0b2018f34e4ab62ec9b6ac839862/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:26:37.690310 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f1f90-4597-49e2-9515-de45e8f2b55d admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:37.704368 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f1f90-4597-49e2-9515-de45e8f2b55d admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:37.757589 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:37.779852 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c2d22-ce90-40c4-9d55-19fa835a0d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:37.780624 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c2d22-ce90-40c4-9d55-19fa835a0d6f admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:37.780914 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c2d22-ce90-40c4-9d55-19fa835a0d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:37.781191 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c2d22-ce90-40c4-9d55-19fa835a0d6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:37.782404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c2d22-ce90-40c4-9d55-19fa835a0d6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:37.784090 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c2d22-ce90-40c4-9d55-19fa835a0d6f admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:37.816303 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1012/2004] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:26:37.817510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e0b44-8423-4bab-9841-4534c7db639a admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:37.828734 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e0b44-8423-4bab-9841-4534c7db639a admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:37.834894 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953e010-1852-4b1a-a6f3-6f0b24dbb2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:37.835599 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953e010-1852-4b1a-a6f3-6f0b24dbb2f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:37.835865 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953e010-1852-4b1a-a6f3-6f0b24dbb2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:37.836147 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953e010-1852-4b1a-a6f3-6f0b24dbb2f2 admin admin] PATH_INFO: `/v3/projects/90d303456d8843d2acca7491b37dc5c1/users/ad1c0b2018f34e4ab62ec9b6ac839862/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:37.838314 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3953e010-1852-4b1a-a6f3-6f0b24dbb2f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90d303456d8843d2acca7491b37dc5c1, user_id=ad1c0b2018f34e4ab62ec9b6ac839862, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:37.842837 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3953e010-1852-4b1a-a6f3-6f0b24dbb2f2 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:37.866712 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 993/2005] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:26:37 2022] PUT /identity/v3/projects/90d303456d8843d2acca7491b37dc5c1/users/ad1c0b2018f34e4ab62ec9b6ac839862/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:37.875692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:37.877979 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051faca-2c0d-4698-a71c-eb1e8c1d2334 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:37.878444 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051faca-2c0d-4698-a71c-eb1e8c1d2334 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:37.878731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051faca-2c0d-4698-a71c-eb1e8c1d2334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:37.907153 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-b051faca-2c0d-4698-a71c-eb1e8c1d2334 None None] MFA Rules not processed for user `ad1c0b2018f34e4ab62ec9b6ac839862`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:37.908511 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-b051faca-2c0d-4698-a71c-eb1e8c1d2334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:38.021624 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1013/2006] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:37 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:38.033684 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953e010-1852-4b1a-a6f3-6f0b24dbb2f2 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:38.041566 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-3953e010-1852-4b1a-a6f3-6f0b24dbb2f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:38.102405 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953e010-1852-4b1a-a6f3-6f0b24dbb2f2 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:38.106182 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2dd69-f310-46ba-8bbb-696225eb1228 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:38.106788 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2dd69-f310-46ba-8bbb-696225eb1228 service cinder] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:38.107069 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2dd69-f310-46ba-8bbb-696225eb1228 service cinder] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:38.107339 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2dd69-f310-46ba-8bbb-696225eb1228 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:38.116701 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe2dd69-f310-46ba-8bbb-696225eb1228 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:38.118132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe2dd69-f310-46ba-8bbb-696225eb1228 service cinder] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:38.128335 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 994/2007] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:38 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:26:38.532347 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051faca-2c0d-4698-a71c-eb1e8c1d2334 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:38.541645 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051faca-2c0d-4698-a71c-eb1e8c1d2334 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:38.545195 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e11315-51f1-4708-a969-f7749056d2f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:38.545819 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e11315-51f1-4708-a969-f7749056d2f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:38.546105 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e11315-51f1-4708-a969-f7749056d2f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:38.546380 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e11315-51f1-4708-a969-f7749056d2f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:38.603409 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e11315-51f1-4708-a969-f7749056d2f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:38.604895 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e11315-51f1-4708-a969-f7749056d2f4 service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:38.614850 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1014/2008] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:26:38.938782 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2dd69-f310-46ba-8bbb-696225eb1228 service cinder] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:38.940247 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-abe2dd69-f310-46ba-8bbb-696225eb1228 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:39.008370 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2dd69-f310-46ba-8bbb-696225eb1228 service cinder] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:39.013864 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37fd9c-108c-4d92-bd32-79278857dcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:39.014726 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37fd9c-108c-4d92-bd32-79278857dcf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:39.014928 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37fd9c-108c-4d92-bd32-79278857dcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:39.015554 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37fd9c-108c-4d92-bd32-79278857dcf6 admin admin] PATH_INFO: `/v3/users/adffe4a1d6dd46dd8646cc54016e37ed` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:39.017156 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37fd9c-108c-4d92-bd32-79278857dcf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adffe4a1d6dd46dd8646cc54016e37ed)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:39.019100 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37fd9c-108c-4d92-bd32-79278857dcf6 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:39.294496 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-3e37fd9c-108c-4d92-bd32-79278857dcf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adffe4a1d6dd46dd8646cc54016e37ed'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:39.539998 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-3e37fd9c-108c-4d92-bd32-79278857dcf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adffe4a1d6dd46dd8646cc54016e37ed'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:39.540651 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-3e37fd9c-108c-4d92-bd32-79278857dcf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adffe4a1d6dd46dd8646cc54016e37ed'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:39.541801 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-3e37fd9c-108c-4d92-bd32-79278857dcf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adffe4a1d6dd46dd8646cc54016e37ed'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:39.556175 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-3e37fd9c-108c-4d92-bd32-79278857dcf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adffe4a1d6dd46dd8646cc54016e37ed'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:39.569490 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 995/2009] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:26:38 2022] DELETE /identity/v3/users/adffe4a1d6dd46dd8646cc54016e37ed => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:39.574575 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7707f9-f89a-451c-9dac-e9ccfc8cab05 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:39.575083 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7707f9-f89a-451c-9dac-e9ccfc8cab05 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:39.575176 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7707f9-f89a-451c-9dac-e9ccfc8cab05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:39.595838 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-5d7707f9-f89a-451c-9dac-e9ccfc8cab05 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:39.597198 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-5d7707f9-f89a-451c-9dac-e9ccfc8cab05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:39.658966 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1015/2010] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:39.668796 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37fd9c-108c-4d92-bd32-79278857dcf6 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:39.670425 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-3e37fd9c-108c-4d92-bd32-79278857dcf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:39.730826 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37fd9c-108c-4d92-bd32-79278857dcf6 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:39.734646 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95980b1a-929f-4d0d-bd3d-931098ee45e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:39.735255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95980b1a-929f-4d0d-bd3d-931098ee45e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:39.735570 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95980b1a-929f-4d0d-bd3d-931098ee45e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:39.735850 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95980b1a-929f-4d0d-bd3d-931098ee45e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:39.745347 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95980b1a-929f-4d0d-bd3d-931098ee45e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:39.746708 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95980b1a-929f-4d0d-bd3d-931098ee45e5 service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:39.757035 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 996/2011] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:26:39.833997 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:39.992306 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:40.331535 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7707f9-f89a-451c-9dac-e9ccfc8cab05 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:40.334218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-5d7707f9-f89a-451c-9dac-e9ccfc8cab05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:40.356122 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7707f9-f89a-451c-9dac-e9ccfc8cab05 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:40.370566 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0006563-850d-4877-9c7c-91f7ef283124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:40.371625 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0006563-850d-4877-9c7c-91f7ef283124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:40.371911 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0006563-850d-4877-9c7c-91f7ef283124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:40.372237 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0006563-850d-4877-9c7c-91f7ef283124 admin admin] PATH_INFO: `/v3/projects/3ee214d6ae2c4f998c6484ebcaca32eb` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:40.373339 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0006563-850d-4877-9c7c-91f7ef283124 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ee214d6ae2c4f998c6484ebcaca32eb)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:40.375789 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0006563-850d-4877-9c7c-91f7ef283124 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:40.501697 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-e0006563-850d-4877-9c7c-91f7ef283124 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ee214d6ae2c4f998c6484ebcaca32eb', 'request_id': 'req-e0006563-850d-4877-9c7c-91f7ef283124'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:40.507380 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-e0006563-850d-4877-9c7c-91f7ef283124 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ee214d6ae2c4f998c6484ebcaca32eb', 'request_id': 'req-e0006563-850d-4877-9c7c-91f7ef283124'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:40.514003 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-e0006563-850d-4877-9c7c-91f7ef283124 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ee214d6ae2c4f998c6484ebcaca32eb', 'request_id': 'req-e0006563-850d-4877-9c7c-91f7ef283124'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:40.628006 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-e0006563-850d-4877-9c7c-91f7ef283124 admin admin] The token cache is being invalidate because project 3ee214d6ae2c4f998c6484ebcaca32eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:26:40.628006 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-e0006563-850d-4877-9c7c-91f7ef283124 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:40.628006 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-e0006563-850d-4877-9c7c-91f7ef283124 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:40.628006 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1016/2012] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:26:40 2022] DELETE /identity/v3/projects/3ee214d6ae2c4f998c6484ebcaca32eb => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:40.631849 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95980b1a-929f-4d0d-bd3d-931098ee45e5 service neutron] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:40.642415 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95980b1a-929f-4d0d-bd3d-931098ee45e5 service neutron] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:40.702955 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e25337-a00f-4002-992d-2e324dd57404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:40.704257 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e25337-a00f-4002-992d-2e324dd57404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:40.704539 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e25337-a00f-4002-992d-2e324dd57404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:40.704818 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e25337-a00f-4002-992d-2e324dd57404 admin admin] PATH_INFO: `/v3/users/b58a77671dfe477ba3c2b08081a715d4` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:40.706196 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e25337-a00f-4002-992d-2e324dd57404 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b58a77671dfe477ba3c2b08081a715d4)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:40.708209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e25337-a00f-4002-992d-2e324dd57404 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:40.877088 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:40.929541 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-80e25337-a00f-4002-992d-2e324dd57404 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b58a77671dfe477ba3c2b08081a715d4'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:41.024040 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-80e25337-a00f-4002-992d-2e324dd57404 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b58a77671dfe477ba3c2b08081a715d4'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:41.024734 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-80e25337-a00f-4002-992d-2e324dd57404 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b58a77671dfe477ba3c2b08081a715d4'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:41.025421 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-80e25337-a00f-4002-992d-2e324dd57404 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b58a77671dfe477ba3c2b08081a715d4'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:41.038866 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-80e25337-a00f-4002-992d-2e324dd57404 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b58a77671dfe477ba3c2b08081a715d4'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:41.052164 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 997/2013] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:26:40 2022] DELETE /identity/v3/users/b58a77671dfe477ba3c2b08081a715d4 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:41.373069 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:41.713037 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0006563-850d-4877-9c7c-91f7ef283124 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:41.714568 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-e0006563-850d-4877-9c7c-91f7ef283124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:41.728491 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0006563-850d-4877-9c7c-91f7ef283124 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:41.783940 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4780a-3034-4ce3-80e1-bc6e6354f28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:41.784568 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4780a-3034-4ce3-80e1-bc6e6354f28f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:41.784851 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4780a-3034-4ce3-80e1-bc6e6354f28f admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:41.785129 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4780a-3034-4ce3-80e1-bc6e6354f28f admin admin] PATH_INFO: `/v3/projects/4f15003fc7c04e62bd266800b924d9a8` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:41.786239 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e4780a-3034-4ce3-80e1-bc6e6354f28f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f15003fc7c04e62bd266800b924d9a8)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:41.788176 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e4780a-3034-4ce3-80e1-bc6e6354f28f admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:41.952100 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-f8e4780a-3034-4ce3-80e1-bc6e6354f28f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f15003fc7c04e62bd266800b924d9a8', 'request_id': 'req-f8e4780a-3034-4ce3-80e1-bc6e6354f28f'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:41.958998 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-f8e4780a-3034-4ce3-80e1-bc6e6354f28f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f15003fc7c04e62bd266800b924d9a8', 'request_id': 'req-f8e4780a-3034-4ce3-80e1-bc6e6354f28f'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:41.965349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-f8e4780a-3034-4ce3-80e1-bc6e6354f28f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f15003fc7c04e62bd266800b924d9a8', 'request_id': 'req-f8e4780a-3034-4ce3-80e1-bc6e6354f28f'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:42.076077 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-f8e4780a-3034-4ce3-80e1-bc6e6354f28f admin admin] The token cache is being invalidate because project 4f15003fc7c04e62bd266800b924d9a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:26:42.076423 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-f8e4780a-3034-4ce3-80e1-bc6e6354f28f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:42.077033 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-f8e4780a-3034-4ce3-80e1-bc6e6354f28f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:42.079224 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1017/2014] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:26:41 2022] DELETE /identity/v3/projects/4f15003fc7c04e62bd266800b924d9a8 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:42.084601 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace382f8-18cf-4400-97ca-323f6ef2b49c None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:42.085066 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace382f8-18cf-4400-97ca-323f6ef2b49c None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:42.085156 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace382f8-18cf-4400-97ca-323f6ef2b49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:42.104688 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-ace382f8-18cf-4400-97ca-323f6ef2b49c None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:42.107483 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-ace382f8-18cf-4400-97ca-323f6ef2b49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:42.179770 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 998/2015] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:42.179878 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199c54d-3971-4c3e-9bac-e1632f920594 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:42.179878 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199c54d-3971-4c3e-9bac-e1632f920594 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:42.179878 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199c54d-3971-4c3e-9bac-e1632f920594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:42.201711 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-c199c54d-3971-4c3e-9bac-e1632f920594 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:42.203056 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-c199c54d-3971-4c3e-9bac-e1632f920594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:42.212104 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1018/2016] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:42.216277 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace382f8-18cf-4400-97ca-323f6ef2b49c None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:42.226366 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace382f8-18cf-4400-97ca-323f6ef2b49c None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:42.231090 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2aa546-c631-4f94-96d2-617a2461a780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:42.231730 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2aa546-c631-4f94-96d2-617a2461a780 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:42.232015 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2aa546-c631-4f94-96d2-617a2461a780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:42.232291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2aa546-c631-4f94-96d2-617a2461a780 admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:42.233071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2aa546-c631-4f94-96d2-617a2461a780 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:26:42.233391 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2aa546-c631-4f94-96d2-617a2461a780 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:42.234999 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2aa546-c631-4f94-96d2-617a2461a780 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:42.247944 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 999/2017] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:26:42.252004 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199c54d-3971-4c3e-9bac-e1632f920594 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:42.261466 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199c54d-3971-4c3e-9bac-e1632f920594 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:42.266960 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e87fdb-86eb-4983-8c3b-940fd976e8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:42.267593 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e87fdb-86eb-4983-8c3b-940fd976e8d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:42.268081 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e87fdb-86eb-4983-8c3b-940fd976e8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:42.268536 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e87fdb-86eb-4983-8c3b-940fd976e8d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:42.269261 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e87fdb-86eb-4983-8c3b-940fd976e8d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:42.271197 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e87fdb-86eb-4983-8c3b-940fd976e8d3 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:42.373367 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1019/2018] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:26:42 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:26:42.377545 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2aa546-c631-4f94-96d2-617a2461a780 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:42.389792 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2aa546-c631-4f94-96d2-617a2461a780 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:42.446809 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa1ecb-f5a1-4625-831d-06ffff378a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:42.447438 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa1ecb-f5a1-4625-831d-06ffff378a68 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:42.447720 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa1ecb-f5a1-4625-831d-06ffff378a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:42.447992 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa1ecb-f5a1-4625-831d-06ffff378a68 admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:42.448603 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa1ecb-f5a1-4625-831d-06ffff378a68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:42.450493 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa1ecb-f5a1-4625-831d-06ffff378a68 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:42.537460 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1000/2019] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:26:42 2022] POST /identity/v3/users => generated 288 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:26:42.538632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e87fdb-86eb-4983-8c3b-940fd976e8d3 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:42.549427 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e87fdb-86eb-4983-8c3b-940fd976e8d3 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:42.554381 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a3a9b-7197-41e2-aeed-382d39f9ad21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:42.554989 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a3a9b-7197-41e2-aeed-382d39f9ad21 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:42.555303 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a3a9b-7197-41e2-aeed-382d39f9ad21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:42.555678 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a3a9b-7197-41e2-aeed-382d39f9ad21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:42.556325 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a3a9b-7197-41e2-aeed-382d39f9ad21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:42.557922 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a3a9b-7197-41e2-aeed-382d39f9ad21 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:42.569423 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1020/2020] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:26:42.573575 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa1ecb-f5a1-4625-831d-06ffff378a68 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:42.584452 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa1ecb-f5a1-4625-831d-06ffff378a68 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:42.589248 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faeee3f-e06f-48bf-bd36-99d550d07efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:42.589960 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faeee3f-e06f-48bf-bd36-99d550d07efb admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:42.590301 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faeee3f-e06f-48bf-bd36-99d550d07efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:42.590643 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faeee3f-e06f-48bf-bd36-99d550d07efb admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:42.591348 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faeee3f-e06f-48bf-bd36-99d550d07efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:42.593064 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faeee3f-e06f-48bf-bd36-99d550d07efb admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:42.605416 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1001/2021] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:26:42.610015 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a3a9b-7197-41e2-aeed-382d39f9ad21 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:42.622994 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a3a9b-7197-41e2-aeed-382d39f9ad21 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:42.630529 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c750cd8-6ab8-4687-94e5-e2116c39960c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:42.631298 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c750cd8-6ab8-4687-94e5-e2116c39960c admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:42.631679 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c750cd8-6ab8-4687-94e5-e2116c39960c admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:42.632029 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c750cd8-6ab8-4687-94e5-e2116c39960c admin admin] PATH_INFO: `/v3/projects/ccbed3e837dc46e89487c649cdeb5665/users/892e86888673421b875ca74eb2d54530/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:42.651214 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c750cd8-6ab8-4687-94e5-e2116c39960c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccbed3e837dc46e89487c649cdeb5665, user_id=892e86888673421b875ca74eb2d54530, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:42.654383 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c750cd8-6ab8-4687-94e5-e2116c39960c admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:42.767507 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1021/2022] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:26:42 2022] PUT /identity/v3/projects/ccbed3e837dc46e89487c649cdeb5665/users/892e86888673421b875ca74eb2d54530/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:26:42.778622 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3047435-b821-4957-80ba-088b42bb70ed None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:42.778909 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3047435-b821-4957-80ba-088b42bb70ed None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:42.779214 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3047435-b821-4957-80ba-088b42bb70ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:42.806876 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-a3047435-b821-4957-80ba-088b42bb70ed None None] MFA Rules not processed for user `892e86888673421b875ca74eb2d54530`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:42.808119 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-a3047435-b821-4957-80ba-088b42bb70ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:42.872166 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1002/2023] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:42.877372 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c750cd8-6ab8-4687-94e5-e2116c39960c admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:42.936944 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c750cd8-6ab8-4687-94e5-e2116c39960c admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:42.942324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71386ca-1442-49c2-bf6e-e0c99ec57ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:42.942924 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71386ca-1442-49c2-bf6e-e0c99ec57ecb admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:42.943204 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71386ca-1442-49c2-bf6e-e0c99ec57ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:42.943513 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71386ca-1442-49c2-bf6e-e0c99ec57ecb admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:42.944127 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71386ca-1442-49c2-bf6e-e0c99ec57ecb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:42.945999 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71386ca-1442-49c2-bf6e-e0c99ec57ecb admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:43.056838 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1022/2024] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:26:42 2022] POST /identity/v3/projects => generated 377 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:26:43.060714 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3047435-b821-4957-80ba-088b42bb70ed None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:43.072218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3047435-b821-4957-80ba-088b42bb70ed None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:43.129613 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af84729-6510-4db6-bc32-b7cc29ce967a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:43.130346 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af84729-6510-4db6-bc32-b7cc29ce967a admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:43.130496 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af84729-6510-4db6-bc32-b7cc29ce967a admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:43.130773 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af84729-6510-4db6-bc32-b7cc29ce967a admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:43.131436 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af84729-6510-4db6-bc32-b7cc29ce967a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:43.133509 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af84729-6510-4db6-bc32-b7cc29ce967a admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:43.248472 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1003/2025] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:26:43 2022] POST /identity/v3/users => generated 295 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:26:43.255465 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71386ca-1442-49c2-bf6e-e0c99ec57ecb admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:43.267054 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71386ca-1442-49c2-bf6e-e0c99ec57ecb admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:43.272151 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f34f32-44d5-4e05-995c-7406d61c2d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:43.272773 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f34f32-44d5-4e05-995c-7406d61c2d3b admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:43.273060 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f34f32-44d5-4e05-995c-7406d61c2d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:43.273337 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f34f32-44d5-4e05-995c-7406d61c2d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:43.274148 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f34f32-44d5-4e05-995c-7406d61c2d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:43.275772 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f34f32-44d5-4e05-995c-7406d61c2d3b admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:43.292393 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1023/2026] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:26:43.295447 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af84729-6510-4db6-bc32-b7cc29ce967a admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:43.306205 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af84729-6510-4db6-bc32-b7cc29ce967a admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:43.311055 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45793daa-5854-4830-a905-69c96d4134a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:43.311755 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45793daa-5854-4830-a905-69c96d4134a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:43.312236 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45793daa-5854-4830-a905-69c96d4134a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:43.313028 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45793daa-5854-4830-a905-69c96d4134a1 admin admin] PATH_INFO: `/v3/projects/559102899a1c422eac27b368b32560b0/users/b595903b304a464aa5d8244d9e960d0b/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:43.327992 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45793daa-5854-4830-a905-69c96d4134a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=559102899a1c422eac27b368b32560b0, user_id=b595903b304a464aa5d8244d9e960d0b, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:43.331596 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45793daa-5854-4830-a905-69c96d4134a1 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:43.335505 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:43.423696 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1004/2027] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:26:43 2022] PUT /identity/v3/projects/559102899a1c422eac27b368b32560b0/users/b595903b304a464aa5d8244d9e960d0b/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:26:43.428251 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f34f32-44d5-4e05-995c-7406d61c2d3b admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:43.439326 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f34f32-44d5-4e05-995c-7406d61c2d3b admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:43.497745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a124783-cb7f-4d0d-ad07-bb0310ca4310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:43.498362 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a124783-cb7f-4d0d-ad07-bb0310ca4310 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:43.498650 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a124783-cb7f-4d0d-ad07-bb0310ca4310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:43.498927 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a124783-cb7f-4d0d-ad07-bb0310ca4310 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:43.499603 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a124783-cb7f-4d0d-ad07-bb0310ca4310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:43.501720 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a124783-cb7f-4d0d-ad07-bb0310ca4310 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:43.511367 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1024/2028] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:26:43.516316 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45793daa-5854-4830-a905-69c96d4134a1 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:43.527207 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45793daa-5854-4830-a905-69c96d4134a1 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:43.532035 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237afd79-9b1b-4bbd-a462-2a30f80e8905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:43.532693 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237afd79-9b1b-4bbd-a462-2a30f80e8905 admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:43.532979 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237afd79-9b1b-4bbd-a462-2a30f80e8905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:43.533259 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237afd79-9b1b-4bbd-a462-2a30f80e8905 admin admin] PATH_INFO: `/v3/projects/559102899a1c422eac27b368b32560b0/users/b595903b304a464aa5d8244d9e960d0b/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:43.535182 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237afd79-9b1b-4bbd-a462-2a30f80e8905 admin admin] RBAC: Authorizing `identity:create_grant(project_id=559102899a1c422eac27b368b32560b0, user_id=b595903b304a464aa5d8244d9e960d0b, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:43.537887 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237afd79-9b1b-4bbd-a462-2a30f80e8905 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:43.547969 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1005/2029] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:26:43 2022] PUT /identity/v3/projects/559102899a1c422eac27b368b32560b0/users/b595903b304a464aa5d8244d9e960d0b/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:43.558023 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca659bfd-2fbc-490e-928c-b962e230537e None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:43.558258 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca659bfd-2fbc-490e-928c-b962e230537e None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:43.558544 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca659bfd-2fbc-490e-928c-b962e230537e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:43.586676 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-ca659bfd-2fbc-490e-928c-b962e230537e None None] MFA Rules not processed for user `b595903b304a464aa5d8244d9e960d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:43.587924 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-ca659bfd-2fbc-490e-928c-b962e230537e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:43.655825 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1025/2030] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:43.670916 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237afd79-9b1b-4bbd-a462-2a30f80e8905 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:43.673388 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-237afd79-9b1b-4bbd-a462-2a30f80e8905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:43.741672 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237afd79-9b1b-4bbd-a462-2a30f80e8905 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:43.745895 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909166f-6d1a-40f1-8642-f419ea8e5315 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:43.746588 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909166f-6d1a-40f1-8642-f419ea8e5315 service cinder] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:43.746947 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909166f-6d1a-40f1-8642-f419ea8e5315 service cinder] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:43.747300 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909166f-6d1a-40f1-8642-f419ea8e5315 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:43.804905 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2909166f-6d1a-40f1-8642-f419ea8e5315 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:43.806378 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2909166f-6d1a-40f1-8642-f419ea8e5315 service cinder] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:43.816213 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1006/2031] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:26:44.035821 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:47.665466 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:47.790004 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca659bfd-2fbc-490e-928c-b962e230537e None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:47.791427 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-ca659bfd-2fbc-490e-928c-b962e230537e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:47.803775 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca659bfd-2fbc-490e-928c-b962e230537e None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:47.807248 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e0b95-a073-45fc-9edd-d14cff27d075 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:47.807873 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e0b95-a073-45fc-9edd-d14cff27d075 service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:47.808153 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e0b95-a073-45fc-9edd-d14cff27d075 service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:47.808425 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e0b95-a073-45fc-9edd-d14cff27d075 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:47.817119 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e0b95-a073-45fc-9edd-d14cff27d075 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:47.826387 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e0b95-a073-45fc-9edd-d14cff27d075 service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:47.827994 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1026/2032] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:47 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:26:48.711062 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:49.431099 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909166f-6d1a-40f1-8642-f419ea8e5315 service cinder] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:49.432873 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-2909166f-6d1a-40f1-8642-f419ea8e5315 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:49.509678 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909166f-6d1a-40f1-8642-f419ea8e5315 service cinder] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:49.514235 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32a8fe-61dc-4372-804a-65e4762ce463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:49.514849 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32a8fe-61dc-4372-804a-65e4762ce463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:49.515137 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32a8fe-61dc-4372-804a-65e4762ce463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:49.515698 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32a8fe-61dc-4372-804a-65e4762ce463 admin admin] PATH_INFO: `/v3/users/ee6de1d9748b43c3b74e3554afceac94` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:49.516582 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32a8fe-61dc-4372-804a-65e4762ce463 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee6de1d9748b43c3b74e3554afceac94)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:49.518505 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32a8fe-61dc-4372-804a-65e4762ce463 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:49.770895 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-dd32a8fe-61dc-4372-804a-65e4762ce463 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee6de1d9748b43c3b74e3554afceac94'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:49.853915 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-dd32a8fe-61dc-4372-804a-65e4762ce463 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee6de1d9748b43c3b74e3554afceac94'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:49.854642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-dd32a8fe-61dc-4372-804a-65e4762ce463 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee6de1d9748b43c3b74e3554afceac94'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:49.855336 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-dd32a8fe-61dc-4372-804a-65e4762ce463 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee6de1d9748b43c3b74e3554afceac94'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:49.868515 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-dd32a8fe-61dc-4372-804a-65e4762ce463 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee6de1d9748b43c3b74e3554afceac94'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:49.880581 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1007/2033] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:26:49 2022] DELETE /identity/v3/users/ee6de1d9748b43c3b74e3554afceac94 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:49.885379 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d1285-ddbb-458a-8d92-f584dcc8b82d None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:49.885911 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d1285-ddbb-458a-8d92-f584dcc8b82d None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:49.886022 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d1285-ddbb-458a-8d92-f584dcc8b82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:49.907545 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-939d1285-ddbb-458a-8d92-f584dcc8b82d None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:49.909290 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-939d1285-ddbb-458a-8d92-f584dcc8b82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:49.980924 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1027/2034] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:49.992896 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32a8fe-61dc-4372-804a-65e4762ce463 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:49.994404 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-dd32a8fe-61dc-4372-804a-65e4762ce463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:50.051947 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32a8fe-61dc-4372-804a-65e4762ce463 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:50.055509 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8052f94-c0ed-4d5f-87f2-433c722bab31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:50.056110 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8052f94-c0ed-4d5f-87f2-433c722bab31 service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:50.056392 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8052f94-c0ed-4d5f-87f2-433c722bab31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:50.056667 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8052f94-c0ed-4d5f-87f2-433c722bab31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:50.066779 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8052f94-c0ed-4d5f-87f2-433c722bab31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:50.068284 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8052f94-c0ed-4d5f-87f2-433c722bab31 service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:50.077896 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1008/2035] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:26:50.164125 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:50.568448 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d1285-ddbb-458a-8d92-f584dcc8b82d None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:50.569944 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-939d1285-ddbb-458a-8d92-f584dcc8b82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:50.588723 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d1285-ddbb-458a-8d92-f584dcc8b82d None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:50.596058 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549011c-a600-436d-9280-9e381e36c77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:50.597325 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549011c-a600-436d-9280-9e381e36c77d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:50.597602 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549011c-a600-436d-9280-9e381e36c77d admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:50.597886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549011c-a600-436d-9280-9e381e36c77d admin admin] PATH_INFO: `/v3/projects/a57e571b795242779f771e858b405f6b` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:50.600115 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8549011c-a600-436d-9280-9e381e36c77d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a57e571b795242779f771e858b405f6b)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:50.602505 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8549011c-a600-436d-9280-9e381e36c77d admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:50.725225 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-8549011c-a600-436d-9280-9e381e36c77d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a57e571b795242779f771e858b405f6b', 'request_id': 'req-8549011c-a600-436d-9280-9e381e36c77d'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:50.731214 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-8549011c-a600-436d-9280-9e381e36c77d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a57e571b795242779f771e858b405f6b', 'request_id': 'req-8549011c-a600-436d-9280-9e381e36c77d'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:50.739274 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-8549011c-a600-436d-9280-9e381e36c77d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a57e571b795242779f771e858b405f6b', 'request_id': 'req-8549011c-a600-436d-9280-9e381e36c77d'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:50.848348 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-8549011c-a600-436d-9280-9e381e36c77d admin admin] The token cache is being invalidate because project a57e571b795242779f771e858b405f6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:26:50.848571 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-8549011c-a600-436d-9280-9e381e36c77d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:50.849192 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-8549011c-a600-436d-9280-9e381e36c77d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:50.850744 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1028/2036] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:26:50 2022] DELETE /identity/v3/projects/a57e571b795242779f771e858b405f6b => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:50.854795 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8052f94-c0ed-4d5f-87f2-433c722bab31 service neutron] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:50.865425 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8052f94-c0ed-4d5f-87f2-433c722bab31 service neutron] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:50.878979 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:50.925419 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f668eaf-b094-4b11-a2f0-62d16f56b66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:50.926063 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f668eaf-b094-4b11-a2f0-62d16f56b66b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:50.926350 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f668eaf-b094-4b11-a2f0-62d16f56b66b admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:50.926630 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f668eaf-b094-4b11-a2f0-62d16f56b66b admin admin] PATH_INFO: `/v3/users/ad1c0b2018f34e4ab62ec9b6ac839862` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:50.927816 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f668eaf-b094-4b11-a2f0-62d16f56b66b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad1c0b2018f34e4ab62ec9b6ac839862)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:50.929734 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f668eaf-b094-4b11-a2f0-62d16f56b66b admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:51.198832 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-3f668eaf-b094-4b11-a2f0-62d16f56b66b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad1c0b2018f34e4ab62ec9b6ac839862'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:51.350779 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-3f668eaf-b094-4b11-a2f0-62d16f56b66b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad1c0b2018f34e4ab62ec9b6ac839862'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:51.351431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-3f668eaf-b094-4b11-a2f0-62d16f56b66b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad1c0b2018f34e4ab62ec9b6ac839862'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:51.352057 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-3f668eaf-b094-4b11-a2f0-62d16f56b66b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad1c0b2018f34e4ab62ec9b6ac839862'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:51.364728 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-3f668eaf-b094-4b11-a2f0-62d16f56b66b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad1c0b2018f34e4ab62ec9b6ac839862'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:51.376863 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1009/2037] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:26:50 2022] DELETE /identity/v3/users/ad1c0b2018f34e4ab62ec9b6ac839862 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:51.837825 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549011c-a600-436d-9280-9e381e36c77d admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:51.839685 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-8549011c-a600-436d-9280-9e381e36c77d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:51.853175 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549011c-a600-436d-9280-9e381e36c77d admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:51.914222 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541c060-ae8c-4f42-ba02-98bd57196aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:51.914908 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541c060-ae8c-4f42-ba02-98bd57196aca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:51.915194 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541c060-ae8c-4f42-ba02-98bd57196aca admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:51.915574 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541c060-ae8c-4f42-ba02-98bd57196aca admin admin] PATH_INFO: `/v3/projects/90d303456d8843d2acca7491b37dc5c1` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:51.916754 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541c060-ae8c-4f42-ba02-98bd57196aca admin admin] RBAC: Authorizing `identity:delete_project(project_id=90d303456d8843d2acca7491b37dc5c1)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:51.919338 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541c060-ae8c-4f42-ba02-98bd57196aca admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:52.059881 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-d541c060-ae8c-4f42-ba02-98bd57196aca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90d303456d8843d2acca7491b37dc5c1', 'request_id': 'req-d541c060-ae8c-4f42-ba02-98bd57196aca'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:52.065726 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-d541c060-ae8c-4f42-ba02-98bd57196aca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90d303456d8843d2acca7491b37dc5c1', 'request_id': 'req-d541c060-ae8c-4f42-ba02-98bd57196aca'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:52.072071 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-d541c060-ae8c-4f42-ba02-98bd57196aca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90d303456d8843d2acca7491b37dc5c1', 'request_id': 'req-d541c060-ae8c-4f42-ba02-98bd57196aca'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:52.183196 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-d541c060-ae8c-4f42-ba02-98bd57196aca admin admin] The token cache is being invalidate because project 90d303456d8843d2acca7491b37dc5c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:26:52.183535 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-d541c060-ae8c-4f42-ba02-98bd57196aca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:52.184199 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-d541c060-ae8c-4f42-ba02-98bd57196aca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:52.185741 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1029/2038] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:26:51 2022] DELETE /identity/v3/projects/90d303456d8843d2acca7491b37dc5c1 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:52.190824 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334c6e3-9501-4e60-bf01-ede64e9017d8 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:52.191313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:52.191442 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334c6e3-9501-4e60-bf01-ede64e9017d8 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:52.191706 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334c6e3-9501-4e60-bf01-ede64e9017d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:52.211442 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-e334c6e3-9501-4e60-bf01-ede64e9017d8 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:52.212653 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-e334c6e3-9501-4e60-bf01-ede64e9017d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:52.270603 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1010/2039] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:52.278476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3629137-7321-434a-994e-c9b26d5d4f6b None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:52.278763 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3629137-7321-434a-994e-c9b26d5d4f6b None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:52.279041 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3629137-7321-434a-994e-c9b26d5d4f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:52.299255 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-a3629137-7321-434a-994e-c9b26d5d4f6b None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:52.300488 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-a3629137-7321-434a-994e-c9b26d5d4f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:52.308497 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1030/2040] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:52.314120 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334c6e3-9501-4e60-bf01-ede64e9017d8 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:52.324389 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334c6e3-9501-4e60-bf01-ede64e9017d8 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:52.328987 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d8210-d388-4167-92fc-bea8fcba6c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:52.329605 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d8210-d388-4167-92fc-bea8fcba6c93 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:52.329900 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d8210-d388-4167-92fc-bea8fcba6c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:52.330181 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d8210-d388-4167-92fc-bea8fcba6c93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:52.331085 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8d8210-d388-4167-92fc-bea8fcba6c93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:26:52.331425 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8d8210-d388-4167-92fc-bea8fcba6c93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:52.333065 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8d8210-d388-4167-92fc-bea8fcba6c93 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:52.344575 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1011/2041] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:26:52.349380 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3629137-7321-434a-994e-c9b26d5d4f6b None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:52.358790 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3629137-7321-434a-994e-c9b26d5d4f6b None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:52.364087 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b44421b-1825-4cc2-bec4-eb1ca5be63cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:52.364681 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44421b-1825-4cc2-bec4-eb1ca5be63cc admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:52.364965 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44421b-1825-4cc2-bec4-eb1ca5be63cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:52.365240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44421b-1825-4cc2-bec4-eb1ca5be63cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:52.365857 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b44421b-1825-4cc2-bec4-eb1ca5be63cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:52.367975 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b44421b-1825-4cc2-bec4-eb1ca5be63cc admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:52.489230 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1031/2042] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:26:52 2022] POST /identity/v3/projects => generated 363 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:26:52.490939 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d8210-d388-4167-92fc-bea8fcba6c93 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:52.501584 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d8210-d388-4167-92fc-bea8fcba6c93 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:52.557123 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b8ce5-f030-423a-9196-29d708aebf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:52.557730 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b8ce5-f030-423a-9196-29d708aebf31 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:52.558016 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b8ce5-f030-423a-9196-29d708aebf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:52.558293 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b8ce5-f030-423a-9196-29d708aebf31 admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:52.558916 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b8ce5-f030-423a-9196-29d708aebf31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:52.562159 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b8ce5-f030-423a-9196-29d708aebf31 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:52.702957 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1012/2043] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:26:52 2022] POST /identity/v3/users => generated 282 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:26:52.704196 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b44421b-1825-4cc2-bec4-eb1ca5be63cc admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:52.715562 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b44421b-1825-4cc2-bec4-eb1ca5be63cc admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:52.720170 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780450d2-a616-4ca8-9679-823798722777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:52.721350 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780450d2-a616-4ca8-9679-823798722777 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:52.724471 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780450d2-a616-4ca8-9679-823798722777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:52.724471 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780450d2-a616-4ca8-9679-823798722777 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:52.724471 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780450d2-a616-4ca8-9679-823798722777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:52.724471 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780450d2-a616-4ca8-9679-823798722777 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:52.734030 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1032/2044] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:26:52.738057 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b8ce5-f030-423a-9196-29d708aebf31 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:52.747945 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b8ce5-f030-423a-9196-29d708aebf31 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:52.752685 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a639569-d6dd-45bf-8ea7-aa51c73d9dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:52.753279 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a639569-d6dd-45bf-8ea7-aa51c73d9dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:52.753556 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a639569-d6dd-45bf-8ea7-aa51c73d9dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:52.753830 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a639569-d6dd-45bf-8ea7-aa51c73d9dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:52.754464 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a639569-d6dd-45bf-8ea7-aa51c73d9dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:52.756084 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a639569-d6dd-45bf-8ea7-aa51c73d9dc0 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:52.766335 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1013/2045] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:26:52.770906 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780450d2-a616-4ca8-9679-823798722777 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:52.781619 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780450d2-a616-4ca8-9679-823798722777 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:52.786673 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc7d85-f04c-4983-895a-0d9c50cb7189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:52.787560 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc7d85-f04c-4983-895a-0d9c50cb7189 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:52.787676 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc7d85-f04c-4983-895a-0d9c50cb7189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:52.787960 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc7d85-f04c-4983-895a-0d9c50cb7189 admin admin] PATH_INFO: `/v3/projects/feb6bda87ccd44f89eed9394c0c170d4/users/7a88826663524e90926ca0064b9cd025/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:52.802532 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc7d85-f04c-4983-895a-0d9c50cb7189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=feb6bda87ccd44f89eed9394c0c170d4, user_id=7a88826663524e90926ca0064b9cd025, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:52.805334 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc7d85-f04c-4983-895a-0d9c50cb7189 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:52.896757 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1033/2046] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:26:52 2022] PUT /identity/v3/projects/feb6bda87ccd44f89eed9394c0c170d4/users/7a88826663524e90926ca0064b9cd025/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:52.906490 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635dd9c4-2294-4353-ba57-6b066bb12bcc None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:52.906780 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635dd9c4-2294-4353-ba57-6b066bb12bcc None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:52.907060 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635dd9c4-2294-4353-ba57-6b066bb12bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:52.936439 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-635dd9c4-2294-4353-ba57-6b066bb12bcc None None] MFA Rules not processed for user `7a88826663524e90926ca0064b9cd025`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:52.937683 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-635dd9c4-2294-4353-ba57-6b066bb12bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:53.011145 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1014/2047] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:53.012633 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc7d85-f04c-4983-895a-0d9c50cb7189 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:53.097981 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc7d85-f04c-4983-895a-0d9c50cb7189 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:53.103281 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbd07d-ee21-4f6b-aa58-d3ac2061f386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:53.105890 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbd07d-ee21-4f6b-aa58-d3ac2061f386 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:53.105890 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbd07d-ee21-4f6b-aa58-d3ac2061f386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:53.105890 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbd07d-ee21-4f6b-aa58-d3ac2061f386 admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:53.105890 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efbd07d-ee21-4f6b-aa58-d3ac2061f386 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:53.107134 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efbd07d-ee21-4f6b-aa58-d3ac2061f386 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:53.225908 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:53.237046 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1034/2048] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:26:53 2022] POST /identity/v3/projects => generated 365 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:26:53.238121 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635dd9c4-2294-4353-ba57-6b066bb12bcc None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:53.248939 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635dd9c4-2294-4353-ba57-6b066bb12bcc None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:53.313076 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce62cb-3d4b-4765-8589-4735085e8b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:53.313408 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce62cb-3d4b-4765-8589-4735085e8b42 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:53.313683 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce62cb-3d4b-4765-8589-4735085e8b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:53.313981 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce62cb-3d4b-4765-8589-4735085e8b42 admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:53.314623 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce62cb-3d4b-4765-8589-4735085e8b42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:53.316642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce62cb-3d4b-4765-8589-4735085e8b42 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:53.443425 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1015/2049] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:26:53 2022] POST /identity/v3/users => generated 289 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:26:53.447424 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbd07d-ee21-4f6b-aa58-d3ac2061f386 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:53.460155 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbd07d-ee21-4f6b-aa58-d3ac2061f386 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:53.465205 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319d43d-d0f3-4e53-b314-96b8292533cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:53.465896 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319d43d-d0f3-4e53-b314-96b8292533cc admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:53.466182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319d43d-d0f3-4e53-b314-96b8292533cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:53.466457 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319d43d-d0f3-4e53-b314-96b8292533cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:53.467121 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319d43d-d0f3-4e53-b314-96b8292533cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:53.468750 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319d43d-d0f3-4e53-b314-96b8292533cc admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:53.480159 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1035/2050] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:26:53.484484 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce62cb-3d4b-4765-8589-4735085e8b42 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:53.494964 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce62cb-3d4b-4765-8589-4735085e8b42 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:53.500074 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21523978-4ee7-4cfa-8589-5a85c06a4963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:53.500734 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21523978-4ee7-4cfa-8589-5a85c06a4963 admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:53.501023 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21523978-4ee7-4cfa-8589-5a85c06a4963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:53.501304 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21523978-4ee7-4cfa-8589-5a85c06a4963 admin admin] PATH_INFO: `/v3/projects/29cf75ff6e1045f0b32fcc03f6e91677/users/857992992a20459bb24251bc90591726/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:53.518440 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21523978-4ee7-4cfa-8589-5a85c06a4963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29cf75ff6e1045f0b32fcc03f6e91677, user_id=857992992a20459bb24251bc90591726, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:53.521140 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21523978-4ee7-4cfa-8589-5a85c06a4963 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:53.681255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1016/2051] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:26:53 2022] PUT /identity/v3/projects/29cf75ff6e1045f0b32fcc03f6e91677/users/857992992a20459bb24251bc90591726/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:26:53.685116 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319d43d-d0f3-4e53-b314-96b8292533cc admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:53.695274 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319d43d-d0f3-4e53-b314-96b8292533cc admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:53.753901 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a8d354-7577-4334-86ef-23bd569e07d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:53.754543 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8d354-7577-4334-86ef-23bd569e07d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:53.754937 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8d354-7577-4334-86ef-23bd569e07d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:53.755203 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8d354-7577-4334-86ef-23bd569e07d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:53.755991 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a8d354-7577-4334-86ef-23bd569e07d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:53.757578 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a8d354-7577-4334-86ef-23bd569e07d6 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:53.768505 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1036/2052] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:26:53.772593 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21523978-4ee7-4cfa-8589-5a85c06a4963 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:53.787433 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21523978-4ee7-4cfa-8589-5a85c06a4963 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:53.792697 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494e60c-fe46-4a3d-9926-693b17679bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:53.793626 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494e60c-fe46-4a3d-9926-693b17679bd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:53.794114 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494e60c-fe46-4a3d-9926-693b17679bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:53.794799 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494e60c-fe46-4a3d-9926-693b17679bd4 admin admin] PATH_INFO: `/v3/projects/29cf75ff6e1045f0b32fcc03f6e91677/users/857992992a20459bb24251bc90591726/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:53.809996 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d494e60c-fe46-4a3d-9926-693b17679bd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29cf75ff6e1045f0b32fcc03f6e91677, user_id=857992992a20459bb24251bc90591726, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:53.812891 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d494e60c-fe46-4a3d-9926-693b17679bd4 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:53.826355 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1017/2053] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:26:53 2022] PUT /identity/v3/projects/29cf75ff6e1045f0b32fcc03f6e91677/users/857992992a20459bb24251bc90591726/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:26:53.840799 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e261bd-9764-4321-8b48-5f46d9789311 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:53.841321 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e261bd-9764-4321-8b48-5f46d9789311 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:53.841702 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e261bd-9764-4321-8b48-5f46d9789311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:53.870218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-b9e261bd-9764-4321-8b48-5f46d9789311 None None] MFA Rules not processed for user `857992992a20459bb24251bc90591726`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:53.871614 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-b9e261bd-9764-4321-8b48-5f46d9789311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:53.946904 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1037/2054] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:53 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:53.965025 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494e60c-fe46-4a3d-9926-693b17679bd4 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:53.966928 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-d494e60c-fe46-4a3d-9926-693b17679bd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:54.029788 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494e60c-fe46-4a3d-9926-693b17679bd4 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:54.034007 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fec60-dd74-4c23-9a83-68366450c50a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:54.034621 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fec60-dd74-4c23-9a83-68366450c50a service cinder] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:54.034954 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fec60-dd74-4c23-9a83-68366450c50a service cinder] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:54.035237 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fec60-dd74-4c23-9a83-68366450c50a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:54.046667 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fec60-dd74-4c23-9a83-68366450c50a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:54.048969 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fec60-dd74-4c23-9a83-68366450c50a service cinder] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:54.059221 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1018/2055] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:53 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:26:54.333601 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e261bd-9764-4321-8b48-5f46d9789311 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:54.335019 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-b9e261bd-9764-4321-8b48-5f46d9789311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:54.347378 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e261bd-9764-4321-8b48-5f46d9789311 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:54.351064 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e5eda-bda1-410f-a1b5-659c5cf02830 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:54.351697 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e5eda-bda1-410f-a1b5-659c5cf02830 service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:54.351983 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e5eda-bda1-410f-a1b5-659c5cf02830 service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:54.352260 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e5eda-bda1-410f-a1b5-659c5cf02830 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:54.411420 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e5eda-bda1-410f-a1b5-659c5cf02830 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:54.412862 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e5eda-bda1-410f-a1b5-659c5cf02830 service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:54.421800 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1038/2056] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:26:54.448167 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:55.263207 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24236f0-6191-4293-988f-cbbd86935f94 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:55.263748 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24236f0-6191-4293-988f-cbbd86935f94 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:55.263853 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24236f0-6191-4293-988f-cbbd86935f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:55.283307 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-d24236f0-6191-4293-988f-cbbd86935f94 None None] MFA Rules not processed for user `1cc1e75117a247718ee6976b92c52ef9`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:55.284546 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-d24236f0-6191-4293-988f-cbbd86935f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:55.350024 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1019/2057] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:26:56.465626 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:56.620185 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:58.346536 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:58.933026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e5eda-bda1-410f-a1b5-659c5cf02830 service cinder] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:59.004555 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e5eda-bda1-410f-a1b5-659c5cf02830 service cinder] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:59.010455 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0eaf98-0872-4217-af8a-f607ac5330be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:59.011193 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0eaf98-0872-4217-af8a-f607ac5330be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:59.011641 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0eaf98-0872-4217-af8a-f607ac5330be admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:59.012133 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0eaf98-0872-4217-af8a-f607ac5330be admin admin] PATH_INFO: `/v3/users/7a88826663524e90926ca0064b9cd025` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:59.013479 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0eaf98-0872-4217-af8a-f607ac5330be admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a88826663524e90926ca0064b9cd025)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:59.015907 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0eaf98-0872-4217-af8a-f607ac5330be admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:59.287608 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-4a0eaf98-0872-4217-af8a-f607ac5330be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a88826663524e90926ca0064b9cd025'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:59.362407 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=78,keystone:INSERT=5,keystone:DELETE=17 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:59.414149 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-4a0eaf98-0872-4217-af8a-f607ac5330be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a88826663524e90926ca0064b9cd025'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:59.415146 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-4a0eaf98-0872-4217-af8a-f607ac5330be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a88826663524e90926ca0064b9cd025'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:59.436823 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-4a0eaf98-0872-4217-af8a-f607ac5330be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a88826663524e90926ca0064b9cd025'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:59.446064 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-4a0eaf98-0872-4217-af8a-f607ac5330be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a88826663524e90926ca0064b9cd025'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:26:59.453106 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1039/2058] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:26:58 2022] DELETE /identity/v3/users/7a88826663524e90926ca0064b9cd025 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:26:59.459990 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471c265-421d-496c-9348-76f5351bb688 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:59.460288 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471c265-421d-496c-9348-76f5351bb688 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:59.461004 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471c265-421d-496c-9348-76f5351bb688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:59.480996 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-f471c265-421d-496c-9348-76f5351bb688 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:26:59.483738 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-f471c265-421d-496c-9348-76f5351bb688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:59.596082 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1020/2059] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:26:59.609563 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0eaf98-0872-4217-af8a-f607ac5330be admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:26:59.612650 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-4a0eaf98-0872-4217-af8a-f607ac5330be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:26:59.672943 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0eaf98-0872-4217-af8a-f607ac5330be admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:26:59.676799 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebca546-4f31-4291-aa93-d6a607528142 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:26:59.677402 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebca546-4f31-4291-aa93-d6a607528142 service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:26:59.677679 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebca546-4f31-4291-aa93-d6a607528142 service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:26:59.677950 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebca546-4f31-4291-aa93-d6a607528142 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:26:59.687294 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebca546-4f31-4291-aa93-d6a607528142 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:26:59.688766 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebca546-4f31-4291-aa93-d6a607528142 service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:26:59.708454 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1040/2060] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:26:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:27:00.223087 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471c265-421d-496c-9348-76f5351bb688 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:00.224616 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-f471c265-421d-496c-9348-76f5351bb688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:00.258179 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471c265-421d-496c-9348-76f5351bb688 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:00.272401 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d4c79-2bbb-4dcd-ad0b-6cb5e93aa1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:00.272854 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebca546-4f31-4291-aa93-d6a607528142 service neutron] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:00.273373 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d4c79-2bbb-4dcd-ad0b-6cb5e93aa1b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:00.273809 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d4c79-2bbb-4dcd-ad0b-6cb5e93aa1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:00.274249 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d4c79-2bbb-4dcd-ad0b-6cb5e93aa1b3 admin admin] PATH_INFO: `/v3/users/c94045a5bb0848b3a168917d81ee56b2` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:00.274406 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-eebca546-4f31-4291-aa93-d6a607528142 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:00.280092 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d4c79-2bbb-4dcd-ad0b-6cb5e93aa1b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c94045a5bb0848b3a168917d81ee56b2)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:00.282018 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d4c79-2bbb-4dcd-ad0b-6cb5e93aa1b3 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:00.292318 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebca546-4f31-4291-aa93-d6a607528142 service neutron] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:00.307882 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201fe15e-82f0-4092-9000-b8fe6830c7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:00.308535 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fe15e-82f0-4092-9000-b8fe6830c7f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:00.308822 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fe15e-82f0-4092-9000-b8fe6830c7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:00.309370 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fe15e-82f0-4092-9000-b8fe6830c7f5 admin admin] PATH_INFO: `/v3/projects/feb6bda87ccd44f89eed9394c0c170d4` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:00.310682 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201fe15e-82f0-4092-9000-b8fe6830c7f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=feb6bda87ccd44f89eed9394c0c170d4)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:00.312800 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201fe15e-82f0-4092-9000-b8fe6830c7f5 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:00.602407 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-201fe15e-82f0-4092-9000-b8fe6830c7f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feb6bda87ccd44f89eed9394c0c170d4', 'request_id': 'req-201fe15e-82f0-4092-9000-b8fe6830c7f5'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:00.609414 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-201fe15e-82f0-4092-9000-b8fe6830c7f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feb6bda87ccd44f89eed9394c0c170d4', 'request_id': 'req-201fe15e-82f0-4092-9000-b8fe6830c7f5'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:00.609999 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-8e8d4c79-2bbb-4dcd-ad0b-6cb5e93aa1b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c94045a5bb0848b3a168917d81ee56b2'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:00.617228 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-201fe15e-82f0-4092-9000-b8fe6830c7f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feb6bda87ccd44f89eed9394c0c170d4', 'request_id': 'req-201fe15e-82f0-4092-9000-b8fe6830c7f5'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:00.735895 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-201fe15e-82f0-4092-9000-b8fe6830c7f5 admin admin] The token cache is being invalidate because project feb6bda87ccd44f89eed9394c0c170d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:27:00.736377 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-201fe15e-82f0-4092-9000-b8fe6830c7f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:00.738352 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-201fe15e-82f0-4092-9000-b8fe6830c7f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:00.742093 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1041/2061] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:27:00 2022] DELETE /identity/v3/projects/feb6bda87ccd44f89eed9394c0c170d4 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:27:00.746171 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201fe15e-82f0-4092-9000-b8fe6830c7f5 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:00.748742 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-201fe15e-82f0-4092-9000-b8fe6830c7f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:00.779314 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-8e8d4c79-2bbb-4dcd-ad0b-6cb5e93aa1b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c94045a5bb0848b3a168917d81ee56b2'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:00.781228 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-8e8d4c79-2bbb-4dcd-ad0b-6cb5e93aa1b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c94045a5bb0848b3a168917d81ee56b2'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:00.781951 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-8e8d4c79-2bbb-4dcd-ad0b-6cb5e93aa1b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c94045a5bb0848b3a168917d81ee56b2'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:00.797786 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-8e8d4c79-2bbb-4dcd-ad0b-6cb5e93aa1b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c94045a5bb0848b3a168917d81ee56b2'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:00.815732 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1021/2062] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:27:00 2022] DELETE /identity/v3/users/c94045a5bb0848b3a168917d81ee56b2 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:27:00.834715 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201fe15e-82f0-4092-9000-b8fe6830c7f5 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:00.897036 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259fcaa-41e3-4320-913d-fd137d9ea63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:00.897775 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259fcaa-41e3-4320-913d-fd137d9ea63e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:00.898150 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259fcaa-41e3-4320-913d-fd137d9ea63e admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:00.898469 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259fcaa-41e3-4320-913d-fd137d9ea63e admin admin] PATH_INFO: `/v3/users/857992992a20459bb24251bc90591726` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:00.899802 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8259fcaa-41e3-4320-913d-fd137d9ea63e admin admin] RBAC: Authorizing `identity:delete_user(user_id=857992992a20459bb24251bc90591726)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:00.901798 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8259fcaa-41e3-4320-913d-fd137d9ea63e admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:01.163898 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-8259fcaa-41e3-4320-913d-fd137d9ea63e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '857992992a20459bb24251bc90591726'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:01.294779 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-8259fcaa-41e3-4320-913d-fd137d9ea63e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '857992992a20459bb24251bc90591726'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:01.295753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-8259fcaa-41e3-4320-913d-fd137d9ea63e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '857992992a20459bb24251bc90591726'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:01.310998 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-8259fcaa-41e3-4320-913d-fd137d9ea63e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '857992992a20459bb24251bc90591726'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:01.318421 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-8259fcaa-41e3-4320-913d-fd137d9ea63e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '857992992a20459bb24251bc90591726'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:01.326881 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1042/2063] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:27:00 2022] DELETE /identity/v3/users/857992992a20459bb24251bc90591726 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:27:01.430520 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d4c79-2bbb-4dcd-ad0b-6cb5e93aa1b3 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:01.432971 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-8e8d4c79-2bbb-4dcd-ad0b-6cb5e93aa1b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:01.456235 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d4c79-2bbb-4dcd-ad0b-6cb5e93aa1b3 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:01.545454 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96d4e7-057d-4c54-81f4-52a8a97c10d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:01.547431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96d4e7-057d-4c54-81f4-52a8a97c10d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:01.547727 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96d4e7-057d-4c54-81f4-52a8a97c10d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:01.548042 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96d4e7-057d-4c54-81f4-52a8a97c10d3 admin admin] PATH_INFO: `/v3/projects/f5849ce2aca04f15bcd9a99f517dcb6f` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:01.550140 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d96d4e7-057d-4c54-81f4-52a8a97c10d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5849ce2aca04f15bcd9a99f517dcb6f)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:01.552203 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d96d4e7-057d-4c54-81f4-52a8a97c10d3 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:01.773412 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:01.783640 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-2d96d4e7-057d-4c54-81f4-52a8a97c10d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5849ce2aca04f15bcd9a99f517dcb6f', 'request_id': 'req-2d96d4e7-057d-4c54-81f4-52a8a97c10d3'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:01.807222 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-2d96d4e7-057d-4c54-81f4-52a8a97c10d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5849ce2aca04f15bcd9a99f517dcb6f', 'request_id': 'req-2d96d4e7-057d-4c54-81f4-52a8a97c10d3'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:01.816351 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-2d96d4e7-057d-4c54-81f4-52a8a97c10d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5849ce2aca04f15bcd9a99f517dcb6f', 'request_id': 'req-2d96d4e7-057d-4c54-81f4-52a8a97c10d3'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:01.960348 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-2d96d4e7-057d-4c54-81f4-52a8a97c10d3 admin admin] The token cache is being invalidate because project f5849ce2aca04f15bcd9a99f517dcb6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:27:01.960839 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-2d96d4e7-057d-4c54-81f4-52a8a97c10d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:01.961948 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-2d96d4e7-057d-4c54-81f4-52a8a97c10d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:01.964906 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1022/2064] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:27:01 2022] DELETE /identity/v3/projects/f5849ce2aca04f15bcd9a99f517dcb6f => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:27:01.968783 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259fcaa-41e3-4320-913d-fd137d9ea63e admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:01.970973 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-8259fcaa-41e3-4320-913d-fd137d9ea63e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:01.990698 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259fcaa-41e3-4320-913d-fd137d9ea63e admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:02.056732 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea6998-5c3a-461b-91ba-586de4672aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:02.056732 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea6998-5c3a-461b-91ba-586de4672aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:02.056732 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea6998-5c3a-461b-91ba-586de4672aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:02.056732 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea6998-5c3a-461b-91ba-586de4672aa0 admin admin] PATH_INFO: `/v3/users/a9ba1e53f33741f6b24775e994f0507f` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:02.058105 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea6998-5c3a-461b-91ba-586de4672aa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9ba1e53f33741f6b24775e994f0507f)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:02.060327 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea6998-5c3a-461b-91ba-586de4672aa0 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:02.295424 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-84ea6998-5c3a-461b-91ba-586de4672aa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9ba1e53f33741f6b24775e994f0507f'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:02.316669 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96d4e7-057d-4c54-81f4-52a8a97c10d3 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:02.319542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-2d96d4e7-057d-4c54-81f4-52a8a97c10d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:02.339445 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96d4e7-057d-4c54-81f4-52a8a97c10d3 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:02.352832 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb651506-03ab-42c1-8533-19212d710de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:02.353484 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb651506-03ab-42c1-8533-19212d710de4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:02.353946 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb651506-03ab-42c1-8533-19212d710de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:02.354228 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb651506-03ab-42c1-8533-19212d710de4 admin admin] PATH_INFO: `/v3/projects/29cf75ff6e1045f0b32fcc03f6e91677` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:02.355399 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb651506-03ab-42c1-8533-19212d710de4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29cf75ff6e1045f0b32fcc03f6e91677)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:02.357492 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb651506-03ab-42c1-8533-19212d710de4 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:02.396470 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-84ea6998-5c3a-461b-91ba-586de4672aa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9ba1e53f33741f6b24775e994f0507f'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:02.397485 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-84ea6998-5c3a-461b-91ba-586de4672aa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9ba1e53f33741f6b24775e994f0507f'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:02.411524 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-84ea6998-5c3a-461b-91ba-586de4672aa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9ba1e53f33741f6b24775e994f0507f'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:02.419475 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-84ea6998-5c3a-461b-91ba-586de4672aa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9ba1e53f33741f6b24775e994f0507f'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:02.427154 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1043/2065] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:27:01 2022] DELETE /identity/v3/users/a9ba1e53f33741f6b24775e994f0507f => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:27:02.482518 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-fb651506-03ab-42c1-8533-19212d710de4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29cf75ff6e1045f0b32fcc03f6e91677', 'request_id': 'req-fb651506-03ab-42c1-8533-19212d710de4'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:02.488575 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-fb651506-03ab-42c1-8533-19212d710de4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29cf75ff6e1045f0b32fcc03f6e91677', 'request_id': 'req-fb651506-03ab-42c1-8533-19212d710de4'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:02.492831 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:02.502997 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-fb651506-03ab-42c1-8533-19212d710de4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29cf75ff6e1045f0b32fcc03f6e91677', 'request_id': 'req-fb651506-03ab-42c1-8533-19212d710de4'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:02.607764 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f64de5-a5e2-40a8-a6cc-6ebe28519529 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:02.608271 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f64de5-a5e2-40a8-a6cc-6ebe28519529 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:02.608705 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f64de5-a5e2-40a8-a6cc-6ebe28519529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:02.614985 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-fb651506-03ab-42c1-8533-19212d710de4 admin admin] The token cache is being invalidate because project 29cf75ff6e1045f0b32fcc03f6e91677 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:27:02.615448 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-fb651506-03ab-42c1-8533-19212d710de4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:02.619555 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-fb651506-03ab-42c1-8533-19212d710de4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:02.621333 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1023/2066] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:27:02 2022] DELETE /identity/v3/projects/29cf75ff6e1045f0b32fcc03f6e91677 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:27:02.626146 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597d829-2bfc-4ed2-9744-d6a7ba60dfdd None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:02.626484 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597d829-2bfc-4ed2-9744-d6a7ba60dfdd None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:02.627295 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597d829-2bfc-4ed2-9744-d6a7ba60dfdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:02.636383 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-10f64de5-a5e2-40a8-a6cc-6ebe28519529 None None] MFA Rules not processed for user `bf2422e88cc94ef9b19f24f5d8e7d56c`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:27:02.637631 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-10f64de5-a5e2-40a8-a6cc-6ebe28519529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:02.651572 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-c597d829-2bfc-4ed2-9744-d6a7ba60dfdd None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:27:02.662048 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-c597d829-2bfc-4ed2-9744-d6a7ba60dfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:02.696317 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1044/2067] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:27:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:27:02.731858 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1024/2068] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:27:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:27:02.740148 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0118c-5fae-42df-b0ba-50a9601bbcff None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:02.740632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0118c-5fae-42df-b0ba-50a9601bbcff None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:02.740918 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0118c-5fae-42df-b0ba-50a9601bbcff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:02.763166 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-d1c0118c-5fae-42df-b0ba-50a9601bbcff None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:27:02.764571 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-d1c0118c-5fae-42df-b0ba-50a9601bbcff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:02.775602 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597d829-2bfc-4ed2-9744-d6a7ba60dfdd None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:02.777019 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-c597d829-2bfc-4ed2-9744-d6a7ba60dfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:02.784415 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1045/2069] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:27:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:27:02.788526 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0118c-5fae-42df-b0ba-50a9601bbcff None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:02.796111 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597d829-2bfc-4ed2-9744-d6a7ba60dfdd None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:02.800903 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0118c-5fae-42df-b0ba-50a9601bbcff None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:02.802721 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db1426-0361-40a1-b045-9d57944ea967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:02.803663 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db1426-0361-40a1-b045-9d57944ea967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:02.804092 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db1426-0361-40a1-b045-9d57944ea967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:02.804574 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db1426-0361-40a1-b045-9d57944ea967 admin admin] PATH_INFO: `/v3/projects/b7f0847b1bc44400a01f21fa059a50bf` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:02.805852 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db1426-0361-40a1-b045-9d57944ea967 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7f0847b1bc44400a01f21fa059a50bf)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:02.808062 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db1426-0361-40a1-b045-9d57944ea967 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:02.812558 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b2d72-6514-46ce-bfc8-50f43494a3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:02.815955 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b2d72-6514-46ce-bfc8-50f43494a3c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:02.816250 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b2d72-6514-46ce-bfc8-50f43494a3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:02.816683 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b2d72-6514-46ce-bfc8-50f43494a3c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:02.817375 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b2d72-6514-46ce-bfc8-50f43494a3c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:27:02.817716 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b2d72-6514-46ce-bfc8-50f43494a3c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:02.819420 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b2d72-6514-46ce-bfc8-50f43494a3c3 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:02.833522 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1046/2070] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:27:02.837874 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b2d72-6514-46ce-bfc8-50f43494a3c3 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:02.850150 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b2d72-6514-46ce-bfc8-50f43494a3c3 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:02.855442 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31541cd8-f96a-4b9c-9afc-aa1438f4e19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:02.856054 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31541cd8-f96a-4b9c-9afc-aa1438f4e19b admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:02.856343 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31541cd8-f96a-4b9c-9afc-aa1438f4e19b admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:02.856615 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31541cd8-f96a-4b9c-9afc-aa1438f4e19b admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:02.857246 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31541cd8-f96a-4b9c-9afc-aa1438f4e19b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:02.859147 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31541cd8-f96a-4b9c-9afc-aa1438f4e19b admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:02.966528 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1047/2071] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:27:02 2022] POST /identity/v3/projects => generated 363 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:27:02.971465 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31541cd8-f96a-4b9c-9afc-aa1438f4e19b admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:02.982331 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c2db1426-0361-40a1-b045-9d57944ea967 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7f0847b1bc44400a01f21fa059a50bf', 'request_id': 'req-c2db1426-0361-40a1-b045-9d57944ea967'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:02.989565 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c2db1426-0361-40a1-b045-9d57944ea967 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7f0847b1bc44400a01f21fa059a50bf', 'request_id': 'req-c2db1426-0361-40a1-b045-9d57944ea967'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:02.997193 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c2db1426-0361-40a1-b045-9d57944ea967 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7f0847b1bc44400a01f21fa059a50bf', 'request_id': 'req-c2db1426-0361-40a1-b045-9d57944ea967'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:03.041306 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31541cd8-f96a-4b9c-9afc-aa1438f4e19b admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:03.046761 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34bd8a-3e5c-4647-bd89-e8180bac332d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:03.047319 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34bd8a-3e5c-4647-bd89-e8180bac332d admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:03.049608 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34bd8a-3e5c-4647-bd89-e8180bac332d admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:03.049608 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34bd8a-3e5c-4647-bd89-e8180bac332d admin admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:03.049608 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d34bd8a-3e5c-4647-bd89-e8180bac332d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:03.051609 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d34bd8a-3e5c-4647-bd89-e8180bac332d admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:03.084034 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c2db1426-0361-40a1-b045-9d57944ea967 admin admin] The token cache is being invalidate because project b7f0847b1bc44400a01f21fa059a50bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:27:03.084631 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c2db1426-0361-40a1-b045-9d57944ea967 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:03.087399 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c2db1426-0361-40a1-b045-9d57944ea967 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:03.087399 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1025/2072] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:27:02 2022] DELETE /identity/v3/projects/b7f0847b1bc44400a01f21fa059a50bf => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:27:03.093070 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416759ac-b14a-4f5d-be3a-755ccb8da001 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:03.093355 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416759ac-b14a-4f5d-be3a-755ccb8da001 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:03.093632 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416759ac-b14a-4f5d-be3a-755ccb8da001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:03.115556 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-416759ac-b14a-4f5d-be3a-755ccb8da001 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:27:03.116786 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-416759ac-b14a-4f5d-be3a-755ccb8da001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:03.125490 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1026/2073] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:27:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:27:03.134780 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf26ff-e054-4161-9058-111a842ff5c2 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:03.135076 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf26ff-e054-4161-9058-111a842ff5c2 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:03.135380 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf26ff-e054-4161-9058-111a842ff5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:03.149287 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1048/2074] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:27:02 2022] POST /identity/v3/users => generated 282 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:27:03.153261 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34bd8a-3e5c-4647-bd89-e8180bac332d admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:03.155744 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-4d34bd8a-3e5c-4647-bd89-e8180bac332d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:03.159902 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-40bf26ff-e054-4161-9058-111a842ff5c2 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:27:03.161306 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-40bf26ff-e054-4161-9058-111a842ff5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:03.170323 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34bd8a-3e5c-4647-bd89-e8180bac332d admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:03.173502 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1027/2075] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:27:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:27:03.176640 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258ee15-d37e-49b8-9a12-8667ba42f449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:03.177292 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258ee15-d37e-49b8-9a12-8667ba42f449 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:03.180779 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258ee15-d37e-49b8-9a12-8667ba42f449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:03.180779 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258ee15-d37e-49b8-9a12-8667ba42f449 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:03.180779 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258ee15-d37e-49b8-9a12-8667ba42f449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:03.180779 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258ee15-d37e-49b8-9a12-8667ba42f449 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:03.182229 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf26ff-e054-4161-9058-111a842ff5c2 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:03.194702 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1049/2076] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:27:03.194896 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf26ff-e054-4161-9058-111a842ff5c2 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:03.196030 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258ee15-d37e-49b8-9a12-8667ba42f449 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:03.198084 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0089dcc-9709-4eb3-8661-c77ad85384ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:03.198821 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0089dcc-9709-4eb3-8661-c77ad85384ab admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:03.199172 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0089dcc-9709-4eb3-8661-c77ad85384ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:03.199562 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0089dcc-9709-4eb3-8661-c77ad85384ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:03.200338 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0089dcc-9709-4eb3-8661-c77ad85384ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:27:03.200716 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0089dcc-9709-4eb3-8661-c77ad85384ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:03.202391 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0089dcc-9709-4eb3-8661-c77ad85384ab admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:03.208985 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258ee15-d37e-49b8-9a12-8667ba42f449 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:03.215534 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c8421-f6b4-4ef2-9b7d-9f66e1ba1129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:03.216174 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1028/2077] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:27:03.216313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c8421-f6b4-4ef2-9b7d-9f66e1ba1129 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:03.216498 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c8421-f6b4-4ef2-9b7d-9f66e1ba1129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:03.216887 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c8421-f6b4-4ef2-9b7d-9f66e1ba1129 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:03.217486 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c8421-f6b4-4ef2-9b7d-9f66e1ba1129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:03.219123 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c8421-f6b4-4ef2-9b7d-9f66e1ba1129 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:03.220509 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0089dcc-9709-4eb3-8661-c77ad85384ab admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:03.230163 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1050/2078] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:27:03.233951 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0089dcc-9709-4eb3-8661-c77ad85384ab admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:03.234363 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c8421-f6b4-4ef2-9b7d-9f66e1ba1129 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:03.245955 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c8421-f6b4-4ef2-9b7d-9f66e1ba1129 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:03.252153 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff0249-84c7-4171-819b-b911b06c3f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:03.252153 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff0249-84c7-4171-819b-b911b06c3f86 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:03.252153 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff0249-84c7-4171-819b-b911b06c3f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:03.252153 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff0249-84c7-4171-819b-b911b06c3f86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:03.252477 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff0249-84c7-4171-819b-b911b06c3f86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:03.252590 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b239ec4-9bcd-4e80-afed-e08589586ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:03.252590 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b239ec4-9bcd-4e80-afed-e08589586ee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:03.252590 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b239ec4-9bcd-4e80-afed-e08589586ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:03.252803 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b239ec4-9bcd-4e80-afed-e08589586ee4 admin admin] PATH_INFO: `/v3/projects/71b25937d1d04ff4a8b0b6ae25bd3545/users/427da4434cf340589ccecc0433248883/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:03.253227 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff0249-84c7-4171-819b-b911b06c3f86 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:03.269950 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b239ec4-9bcd-4e80-afed-e08589586ee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71b25937d1d04ff4a8b0b6ae25bd3545, user_id=427da4434cf340589ccecc0433248883, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:03.274977 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b239ec4-9bcd-4e80-afed-e08589586ee4 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:03.316957 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:03.377946 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1029/2079] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:27:03 2022] POST /identity/v3/projects => generated 383 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:27:03.381510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff0249-84c7-4171-819b-b911b06c3f86 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:03.412640 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1051/2080] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:27:03 2022] PUT /identity/v3/projects/71b25937d1d04ff4a8b0b6ae25bd3545/users/427da4434cf340589ccecc0433248883/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:27:03.416825 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e333cd3-08b3-444c-b937-245e1825b1b6 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:03.417168 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e333cd3-08b3-444c-b937-245e1825b1b6 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:03.417511 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e333cd3-08b3-444c-b937-245e1825b1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:03.451148 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-2e333cd3-08b3-444c-b937-245e1825b1b6 None None] MFA Rules not processed for user `427da4434cf340589ccecc0433248883`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:27:03.452678 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-2e333cd3-08b3-444c-b937-245e1825b1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:03.480728 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff0249-84c7-4171-819b-b911b06c3f86 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:03.527474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1052/2081] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:27:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:27:03.532227 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e333cd3-08b3-444c-b937-245e1825b1b6 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:03.559703 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67008171-928b-4ecd-b455-15cba423c674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:03.560700 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67008171-928b-4ecd-b455-15cba423c674 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:03.561261 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67008171-928b-4ecd-b455-15cba423c674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:03.561824 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67008171-928b-4ecd-b455-15cba423c674 admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:03.562563 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67008171-928b-4ecd-b455-15cba423c674 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:03.564652 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67008171-928b-4ecd-b455-15cba423c674 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:03.607339 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e333cd3-08b3-444c-b937-245e1825b1b6 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:03.612779 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb10e14-cbf3-4aa2-8bc6-525076461e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:03.613398 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb10e14-cbf3-4aa2-8bc6-525076461e08 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:03.613672 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb10e14-cbf3-4aa2-8bc6-525076461e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:03.614372 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb10e14-cbf3-4aa2-8bc6-525076461e08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:03.614485 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:03.614566 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb10e14-cbf3-4aa2-8bc6-525076461e08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:03.616525 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb10e14-cbf3-4aa2-8bc6-525076461e08 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:03.679784 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1030/2082] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:27:03 2022] POST /identity/v3/users => generated 292 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:27:03.682836 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67008171-928b-4ecd-b455-15cba423c674 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:03.702652 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67008171-928b-4ecd-b455-15cba423c674 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:03.716031 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09383f12-5396-49c1-b970-8664078376d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:03.716686 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09383f12-5396-49c1-b970-8664078376d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:03.717276 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09383f12-5396-49c1-b970-8664078376d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:03.717702 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09383f12-5396-49c1-b970-8664078376d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:03.718691 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09383f12-5396-49c1-b970-8664078376d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:03.721295 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09383f12-5396-49c1-b970-8664078376d0 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:03.737123 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1031/2083] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:27:03.741442 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09383f12-5396-49c1-b970-8664078376d0 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:03.743158 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1053/2084] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:27:03 2022] POST /identity/v3/projects => generated 365 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:27:03.747714 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb10e14-cbf3-4aa2-8bc6-525076461e08 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:03.756208 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09383f12-5396-49c1-b970-8664078376d0 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:03.823449 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b8ee4-e039-4b14-8a0d-3fe79efb8407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:03.824276 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b8ee4-e039-4b14-8a0d-3fe79efb8407 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:03.834916 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b8ee4-e039-4b14-8a0d-3fe79efb8407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:03.835196 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb10e14-cbf3-4aa2-8bc6-525076461e08 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:03.835666 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b8ee4-e039-4b14-8a0d-3fe79efb8407 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:03.835666 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b8ee4-e039-4b14-8a0d-3fe79efb8407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:03.835666 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b8ee4-e039-4b14-8a0d-3fe79efb8407 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:03.835889 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ef185-d82e-425f-ae72-a2019b360e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:03.835889 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ef185-d82e-425f-ae72-a2019b360e97 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:03.835889 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ef185-d82e-425f-ae72-a2019b360e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:03.835889 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ef185-d82e-425f-ae72-a2019b360e97 admin admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:03.836215 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ef185-d82e-425f-ae72-a2019b360e97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:03.838078 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ef185-d82e-425f-ae72-a2019b360e97 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:03.852836 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1032/2085] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:27:03.857568 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b8ee4-e039-4b14-8a0d-3fe79efb8407 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:03.870932 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b8ee4-e039-4b14-8a0d-3fe79efb8407 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:03.878976 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56390b0e-c9ae-4c31-a714-4fab60e314d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:03.879709 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56390b0e-c9ae-4c31-a714-4fab60e314d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:03.880085 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56390b0e-c9ae-4c31-a714-4fab60e314d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:03.880576 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56390b0e-c9ae-4c31-a714-4fab60e314d6 admin admin] PATH_INFO: `/v3/projects/4cb2251823f34c3cb0393814ec2fb61f/users/b08a0d4e5e3c4f2cb74363089cb95311/roles/5691bce246d6452990f13933e19f2825` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:03.907114 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56390b0e-c9ae-4c31-a714-4fab60e314d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cb2251823f34c3cb0393814ec2fb61f, user_id=b08a0d4e5e3c4f2cb74363089cb95311, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:03.914714 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56390b0e-c9ae-4c31-a714-4fab60e314d6 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:03.963755 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1054/2086] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:27:03 2022] POST /identity/v3/users => generated 289 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:27:03.967815 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ef185-d82e-425f-ae72-a2019b360e97 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:03.985910 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ef185-d82e-425f-ae72-a2019b360e97 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:03.991652 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74ebd8-f274-439e-9a55-bc53f9b089cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:03.993152 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74ebd8-f274-439e-9a55-bc53f9b089cf admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:03.993442 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74ebd8-f274-439e-9a55-bc53f9b089cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:03.993723 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74ebd8-f274-439e-9a55-bc53f9b089cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:03.999517 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74ebd8-f274-439e-9a55-bc53f9b089cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:04.008084 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1033/2087] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:27:03 2022] PUT /identity/v3/projects/4cb2251823f34c3cb0393814ec2fb61f/users/b08a0d4e5e3c4f2cb74363089cb95311/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:27:04.008191 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74ebd8-f274-439e-9a55-bc53f9b089cf admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:04.016219 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de036c3-8724-461f-aa67-8a81e9a38f6f None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:04.016691 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de036c3-8724-461f-aa67-8a81e9a38f6f None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:04.017626 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de036c3-8724-461f-aa67-8a81e9a38f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:04.022389 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1055/2088] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:27:04.028919 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74ebd8-f274-439e-9a55-bc53f9b089cf admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:04.072034 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-1de036c3-8724-461f-aa67-8a81e9a38f6f None None] MFA Rules not processed for user `b08a0d4e5e3c4f2cb74363089cb95311`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:27:04.073670 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-1de036c3-8724-461f-aa67-8a81e9a38f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:04.082703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74ebd8-f274-439e-9a55-bc53f9b089cf admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:04.277546 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4e4ee-559c-4b1a-a721-f82847e1f2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:04.278146 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4e4ee-559c-4b1a-a721-f82847e1f2b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:04.278567 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4e4ee-559c-4b1a-a721-f82847e1f2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:04.279027 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4e4ee-559c-4b1a-a721-f82847e1f2b8 admin admin] PATH_INFO: `/v3/projects/4f1fee95ff094998bd79ca5e77b9b10d/users/93d1d65771fd422da5afc3bfa8bd763e/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:04.283498 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1034/2089] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:27:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:27:04.296073 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de036c3-8724-461f-aa67-8a81e9a38f6f None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:04.298053 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-1de036c3-8724-461f-aa67-8a81e9a38f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:04.299655 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b4e4ee-559c-4b1a-a721-f82847e1f2b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f1fee95ff094998bd79ca5e77b9b10d, user_id=93d1d65771fd422da5afc3bfa8bd763e, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:04.304128 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b4e4ee-559c-4b1a-a721-f82847e1f2b8 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:04.366227 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de036c3-8724-461f-aa67-8a81e9a38f6f None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:04.369964 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989cd19-2ae5-4484-8d3d-32126db94717 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:04.370575 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989cd19-2ae5-4484-8d3d-32126db94717 service cinder] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:04.370855 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989cd19-2ae5-4484-8d3d-32126db94717 service cinder] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:04.371131 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989cd19-2ae5-4484-8d3d-32126db94717 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:04.388012 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989cd19-2ae5-4484-8d3d-32126db94717 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:04.390215 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989cd19-2ae5-4484-8d3d-32126db94717 service cinder] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:04.403034 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1035/2090] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:27:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:27:04.433936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989cd19-2ae5-4484-8d3d-32126db94717 service cinder] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:04.459240 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989cd19-2ae5-4484-8d3d-32126db94717 service cinder] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:04.465162 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56caa8-a72f-4bd3-8612-0488740721f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:04.466050 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56caa8-a72f-4bd3-8612-0488740721f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:04.466163 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56caa8-a72f-4bd3-8612-0488740721f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:04.466362 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56caa8-a72f-4bd3-8612-0488740721f0 admin admin] PATH_INFO: `/v3/users/b08a0d4e5e3c4f2cb74363089cb95311` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:04.469386 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56caa8-a72f-4bd3-8612-0488740721f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b08a0d4e5e3c4f2cb74363089cb95311)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:04.469489 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56caa8-a72f-4bd3-8612-0488740721f0 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:04.488349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1056/2091] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:27:04 2022] PUT /identity/v3/projects/4f1fee95ff094998bd79ca5e77b9b10d/users/93d1d65771fd422da5afc3bfa8bd763e/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:27:04.492522 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4e4ee-559c-4b1a-a721-f82847e1f2b8 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:04.585302 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4e4ee-559c-4b1a-a721-f82847e1f2b8 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:04.590284 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478bcd3-dd63-482c-8841-d644a7f33467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:04.591233 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478bcd3-dd63-482c-8841-d644a7f33467 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:04.591959 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478bcd3-dd63-482c-8841-d644a7f33467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:04.591959 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478bcd3-dd63-482c-8841-d644a7f33467 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:04.592417 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6478bcd3-dd63-482c-8841-d644a7f33467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:04.594171 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6478bcd3-dd63-482c-8841-d644a7f33467 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:04.606538 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1057/2092] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:27:04.607722 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478bcd3-dd63-482c-8841-d644a7f33467 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:04.611616 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-6478bcd3-dd63-482c-8841-d644a7f33467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:04.625787 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478bcd3-dd63-482c-8841-d644a7f33467 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:04.631577 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a7390-edb5-45e3-b66e-10eeedba1799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:04.632284 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a7390-edb5-45e3-b66e-10eeedba1799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:04.632575 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a7390-edb5-45e3-b66e-10eeedba1799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:04.633400 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a7390-edb5-45e3-b66e-10eeedba1799 admin admin] PATH_INFO: `/v3/users/892e86888673421b875ca74eb2d54530` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:04.635301 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a7390-edb5-45e3-b66e-10eeedba1799 admin admin] RBAC: Authorizing `identity:delete_user(user_id=892e86888673421b875ca74eb2d54530)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:04.637340 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a7390-edb5-45e3-b66e-10eeedba1799 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:04.840584 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-5e56caa8-a72f-4bd3-8612-0488740721f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b08a0d4e5e3c4f2cb74363089cb95311'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:04.961179 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-5e56caa8-a72f-4bd3-8612-0488740721f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b08a0d4e5e3c4f2cb74363089cb95311'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:04.961952 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-5e56caa8-a72f-4bd3-8612-0488740721f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b08a0d4e5e3c4f2cb74363089cb95311'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:04.962589 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-5e56caa8-a72f-4bd3-8612-0488740721f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b08a0d4e5e3c4f2cb74363089cb95311'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:04.975740 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-1d4a7390-edb5-45e3-b66e-10eeedba1799 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '892e86888673421b875ca74eb2d54530'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:04.976245 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-5e56caa8-a72f-4bd3-8612-0488740721f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b08a0d4e5e3c4f2cb74363089cb95311'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:04.985084 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:04.989547 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1036/2093] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:27:04 2022] DELETE /identity/v3/users/b08a0d4e5e3c4f2cb74363089cb95311 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:27:04.990348 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56caa8-a72f-4bd3-8612-0488740721f0 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:05.000364 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-5e56caa8-a72f-4bd3-8612-0488740721f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:05.057120 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56caa8-a72f-4bd3-8612-0488740721f0 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:05.062132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a70cb-2ddc-499b-b21e-458c4f40b9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:05.062798 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a70cb-2ddc-499b-b21e-458c4f40b9e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:05.063084 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a70cb-2ddc-499b-b21e-458c4f40b9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:05.063407 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a70cb-2ddc-499b-b21e-458c4f40b9e3 admin admin] PATH_INFO: `/v3/projects/4f1fee95ff094998bd79ca5e77b9b10d/users/93d1d65771fd422da5afc3bfa8bd763e/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:05.065374 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a70cb-2ddc-499b-b21e-458c4f40b9e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f1fee95ff094998bd79ca5e77b9b10d, user_id=93d1d65771fd422da5afc3bfa8bd763e, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:05.068060 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a70cb-2ddc-499b-b21e-458c4f40b9e3 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:05.076300 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-1d4a7390-edb5-45e3-b66e-10eeedba1799 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '892e86888673421b875ca74eb2d54530'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:05.076926 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-1d4a7390-edb5-45e3-b66e-10eeedba1799 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '892e86888673421b875ca74eb2d54530'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:05.079709 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1037/2094] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:27:04 2022] PUT /identity/v3/projects/4f1fee95ff094998bd79ca5e77b9b10d/users/93d1d65771fd422da5afc3bfa8bd763e/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:27:05.081219 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc231f-8c42-4085-b8b9-22ed9fd1b60d None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:05.081506 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc231f-8c42-4085-b8b9-22ed9fd1b60d None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:05.081781 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc231f-8c42-4085-b8b9-22ed9fd1b60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:05.094161 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-1d4a7390-edb5-45e3-b66e-10eeedba1799 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '892e86888673421b875ca74eb2d54530'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:05.103704 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-8fbc231f-8c42-4085-b8b9-22ed9fd1b60d None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:27:05.104331 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-1d4a7390-edb5-45e3-b66e-10eeedba1799 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '892e86888673421b875ca74eb2d54530'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:05.104907 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-8fbc231f-8c42-4085-b8b9-22ed9fd1b60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:05.115261 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1058/2095] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:27:04 2022] DELETE /identity/v3/users/892e86888673421b875ca74eb2d54530 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:27:05.117344 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3737a9-2fe9-45ec-a293-a3a30a40ff5a None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:05.118534 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3737a9-2fe9-45ec-a293-a3a30a40ff5a None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:05.129006 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3737a9-2fe9-45ec-a293-a3a30a40ff5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:05.167650 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-9d3737a9-2fe9-45ec-a293-a3a30a40ff5a None None] MFA Rules not processed for user `93d1d65771fd422da5afc3bfa8bd763e`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:27:05.169247 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-9d3737a9-2fe9-45ec-a293-a3a30a40ff5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:05.181940 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1038/2096] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:27:05.188877 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ff4aa-e07a-41f1-aff6-9cc4e89ce5dd None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:05.188877 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ff4aa-e07a-41f1-aff6-9cc4e89ce5dd None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:05.188877 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ff4aa-e07a-41f1-aff6-9cc4e89ce5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:05.223167 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-461ff4aa-e07a-41f1-aff6-9cc4e89ce5dd None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:27:05.230696 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-461ff4aa-e07a-41f1-aff6-9cc4e89ce5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:05.335772 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1039/2097] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:27:05.335772 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ff4aa-e07a-41f1-aff6-9cc4e89ce5dd None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:05.336166 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-461ff4aa-e07a-41f1-aff6-9cc4e89ce5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:05.357590 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1059/2098] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:27:05 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:27:05.358567 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3737a9-2fe9-45ec-a293-a3a30a40ff5a None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:05.360070 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-9d3737a9-2fe9-45ec-a293-a3a30a40ff5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:05.415167 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ff4aa-e07a-41f1-aff6-9cc4e89ce5dd None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:05.419174 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26333d-34e3-4d9a-ba32-eeb8dfd5367e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:05.420112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26333d-34e3-4d9a-ba32-eeb8dfd5367e service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:05.420428 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26333d-34e3-4d9a-ba32-eeb8dfd5367e service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:05.420814 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26333d-34e3-4d9a-ba32-eeb8dfd5367e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:05.434070 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26333d-34e3-4d9a-ba32-eeb8dfd5367e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:05.435875 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3737a9-2fe9-45ec-a293-a3a30a40ff5a None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:05.436919 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26333d-34e3-4d9a-ba32-eeb8dfd5367e service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:05.439931 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c58f74-7627-4650-8ebf-72eb7a5cbbd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:05.440550 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c58f74-7627-4650-8ebf-72eb7a5cbbd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:05.440862 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c58f74-7627-4650-8ebf-72eb7a5cbbd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:05.441352 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c58f74-7627-4650-8ebf-72eb7a5cbbd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:05.451068 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c58f74-7627-4650-8ebf-72eb7a5cbbd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:05.452106 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1040/2099] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:27:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:27:05.452819 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26333d-34e3-4d9a-ba32-eeb8dfd5367e service neutron] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:05.454302 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-3f26333d-34e3-4d9a-ba32-eeb8dfd5367e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:05.460213 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c58f74-7627-4650-8ebf-72eb7a5cbbd2 service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:05.471373 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1060/2100] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:27:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:27:05.471769 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:05.513429 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26333d-34e3-4d9a-ba32-eeb8dfd5367e service neutron] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:05.517632 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d2eb1-af4d-43fd-83eb-2596d43ea769 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:05.518240 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d2eb1-af4d-43fd-83eb-2596d43ea769 service cinder] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:05.518518 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d2eb1-af4d-43fd-83eb-2596d43ea769 service cinder] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:05.518791 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d2eb1-af4d-43fd-83eb-2596d43ea769 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:05.527854 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d2eb1-af4d-43fd-83eb-2596d43ea769 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:05.529279 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d2eb1-af4d-43fd-83eb-2596d43ea769 service cinder] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:05.539931 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1041/2101] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:27:05 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:27:05.812608 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c58f74-7627-4650-8ebf-72eb7a5cbbd2 service neutron] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:05.822638 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c58f74-7627-4650-8ebf-72eb7a5cbbd2 service neutron] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:05.826512 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3fa9d6-c5ae-4cf3-8c9c-34993bedd2bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:05.827238 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3fa9d6-c5ae-4cf3-8c9c-34993bedd2bc service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:05.827620 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3fa9d6-c5ae-4cf3-8c9c-34993bedd2bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:05.827998 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3fa9d6-c5ae-4cf3-8c9c-34993bedd2bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:05.830590 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-7c3fa9d6-c5ae-4cf3-8c9c-34993bedd2bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:05.891101 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3fa9d6-c5ae-4cf3-8c9c-34993bedd2bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:05.893195 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3fa9d6-c5ae-4cf3-8c9c-34993bedd2bc service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:05.903326 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1061/2102] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:27:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:27:06.227274 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d2eb1-af4d-43fd-83eb-2596d43ea769 service cinder] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:06.235208 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-941d2eb1-af4d-43fd-83eb-2596d43ea769 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:06.254974 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d2eb1-af4d-43fd-83eb-2596d43ea769 service cinder] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:06.273714 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3fa9d6-c5ae-4cf3-8c9c-34993bedd2bc service cinder] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:06.275099 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-7c3fa9d6-c5ae-4cf3-8c9c-34993bedd2bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:06.287571 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877c581-896e-46de-8fba-ab7ef0159cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:06.288225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877c581-896e-46de-8fba-ab7ef0159cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:06.288509 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877c581-896e-46de-8fba-ab7ef0159cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:06.288789 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877c581-896e-46de-8fba-ab7ef0159cf3 admin admin] PATH_INFO: `/v3/projects/4cb2251823f34c3cb0393814ec2fb61f` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:06.290945 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877c581-896e-46de-8fba-ab7ef0159cf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cb2251823f34c3cb0393814ec2fb61f)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:06.293107 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877c581-896e-46de-8fba-ab7ef0159cf3 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:06.298404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3fa9d6-c5ae-4cf3-8c9c-34993bedd2bc service cinder] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:06.310085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234de89b-e5da-4c73-b20b-056d554e5a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:06.310535 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234de89b-e5da-4c73-b20b-056d554e5a25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:06.310823 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234de89b-e5da-4c73-b20b-056d554e5a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:06.311849 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234de89b-e5da-4c73-b20b-056d554e5a25 admin admin] PATH_INFO: `/v3/projects/ccbed3e837dc46e89487c649cdeb5665` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:06.313004 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234de89b-e5da-4c73-b20b-056d554e5a25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccbed3e837dc46e89487c649cdeb5665)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:06.314964 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234de89b-e5da-4c73-b20b-056d554e5a25 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:06.431401 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c877c581-896e-46de-8fba-ab7ef0159cf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cb2251823f34c3cb0393814ec2fb61f', 'request_id': 'req-c877c581-896e-46de-8fba-ab7ef0159cf3'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:06.437117 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c877c581-896e-46de-8fba-ab7ef0159cf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cb2251823f34c3cb0393814ec2fb61f', 'request_id': 'req-c877c581-896e-46de-8fba-ab7ef0159cf3'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:06.445923 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c877c581-896e-46de-8fba-ab7ef0159cf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cb2251823f34c3cb0393814ec2fb61f', 'request_id': 'req-c877c581-896e-46de-8fba-ab7ef0159cf3'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:06.509704 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-234de89b-e5da-4c73-b20b-056d554e5a25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccbed3e837dc46e89487c649cdeb5665', 'request_id': 'req-234de89b-e5da-4c73-b20b-056d554e5a25'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:06.516996 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-234de89b-e5da-4c73-b20b-056d554e5a25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccbed3e837dc46e89487c649cdeb5665', 'request_id': 'req-234de89b-e5da-4c73-b20b-056d554e5a25'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:06.525411 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-234de89b-e5da-4c73-b20b-056d554e5a25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccbed3e837dc46e89487c649cdeb5665', 'request_id': 'req-234de89b-e5da-4c73-b20b-056d554e5a25'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:06.579537 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c877c581-896e-46de-8fba-ab7ef0159cf3 admin admin] The token cache is being invalidate because project 4cb2251823f34c3cb0393814ec2fb61f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:27:06.580410 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c877c581-896e-46de-8fba-ab7ef0159cf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:06.581291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c877c581-896e-46de-8fba-ab7ef0159cf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:06.582828 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1042/2103] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:27:06 2022] DELETE /identity/v3/projects/4cb2251823f34c3cb0393814ec2fb61f => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:27:06.770524 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-234de89b-e5da-4c73-b20b-056d554e5a25 admin admin] The token cache is being invalidate because project ccbed3e837dc46e89487c649cdeb5665 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:27:06.770911 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-234de89b-e5da-4c73-b20b-056d554e5a25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:06.772962 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-234de89b-e5da-4c73-b20b-056d554e5a25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:06.774680 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1062/2104] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:27:06 2022] DELETE /identity/v3/projects/ccbed3e837dc46e89487c649cdeb5665 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:27:06.778628 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877c581-896e-46de-8fba-ab7ef0159cf3 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:06.780158 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-c877c581-896e-46de-8fba-ab7ef0159cf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:06.858929 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877c581-896e-46de-8fba-ab7ef0159cf3 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:06.936474 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38cce7-0b34-48ef-99ea-a043c48e0ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:06.937335 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38cce7-0b34-48ef-99ea-a043c48e0ca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:06.937604 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38cce7-0b34-48ef-99ea-a043c48e0ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:06.937930 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38cce7-0b34-48ef-99ea-a043c48e0ca1 admin admin] PATH_INFO: `/v3/users/b595903b304a464aa5d8244d9e960d0b` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:06.939294 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38cce7-0b34-48ef-99ea-a043c48e0ca1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b595903b304a464aa5d8244d9e960d0b)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:06.941307 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38cce7-0b34-48ef-99ea-a043c48e0ca1 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:07.233079 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-ba38cce7-0b34-48ef-99ea-a043c48e0ca1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b595903b304a464aa5d8244d9e960d0b'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:07.316806 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-ba38cce7-0b34-48ef-99ea-a043c48e0ca1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b595903b304a464aa5d8244d9e960d0b'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:07.317154 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-ba38cce7-0b34-48ef-99ea-a043c48e0ca1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b595903b304a464aa5d8244d9e960d0b'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:07.318263 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-ba38cce7-0b34-48ef-99ea-a043c48e0ca1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b595903b304a464aa5d8244d9e960d0b'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:07.332279 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-ba38cce7-0b34-48ef-99ea-a043c48e0ca1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b595903b304a464aa5d8244d9e960d0b'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:07.347762 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1043/2105] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:27:06 2022] DELETE /identity/v3/users/b595903b304a464aa5d8244d9e960d0b => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:27:07.607781 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:07.890070 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234de89b-e5da-4c73-b20b-056d554e5a25 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:07.891855 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-234de89b-e5da-4c73-b20b-056d554e5a25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:07.911770 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234de89b-e5da-4c73-b20b-056d554e5a25 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:08.001247 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea43f33-f365-4815-8f01-40b15e8a3e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:08.001923 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea43f33-f365-4815-8f01-40b15e8a3e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:08.002228 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea43f33-f365-4815-8f01-40b15e8a3e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:08.002496 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea43f33-f365-4815-8f01-40b15e8a3e81 admin admin] PATH_INFO: `/v3/projects/559102899a1c422eac27b368b32560b0` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:08.003692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea43f33-f365-4815-8f01-40b15e8a3e81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=559102899a1c422eac27b368b32560b0)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:08.005609 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea43f33-f365-4815-8f01-40b15e8a3e81 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:08.176223 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-9ea43f33-f365-4815-8f01-40b15e8a3e81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '559102899a1c422eac27b368b32560b0', 'request_id': 'req-9ea43f33-f365-4815-8f01-40b15e8a3e81'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:08.182007 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-9ea43f33-f365-4815-8f01-40b15e8a3e81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '559102899a1c422eac27b368b32560b0', 'request_id': 'req-9ea43f33-f365-4815-8f01-40b15e8a3e81'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:08.188595 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-9ea43f33-f365-4815-8f01-40b15e8a3e81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '559102899a1c422eac27b368b32560b0', 'request_id': 'req-9ea43f33-f365-4815-8f01-40b15e8a3e81'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:08.322941 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-9ea43f33-f365-4815-8f01-40b15e8a3e81 admin admin] The token cache is being invalidate because project 559102899a1c422eac27b368b32560b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:27:08.323441 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-9ea43f33-f365-4815-8f01-40b15e8a3e81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:08.325259 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-9ea43f33-f365-4815-8f01-40b15e8a3e81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:08.334413 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1063/2106] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:27:07 2022] DELETE /identity/v3/projects/559102899a1c422eac27b368b32560b0 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:27:08.335695 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93e7e5-8b58-4091-9235-6da2bf135f24 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:08.336546 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93e7e5-8b58-4091-9235-6da2bf135f24 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:08.337000 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93e7e5-8b58-4091-9235-6da2bf135f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:08.374505 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-4a93e7e5-8b58-4091-9235-6da2bf135f24 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:27:08.375887 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-4a93e7e5-8b58-4091-9235-6da2bf135f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:08.502811 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1044/2107] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:27:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:27:08.511664 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26686c41-e4a9-4380-b1b9-09fd3c056b07 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:08.512126 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26686c41-e4a9-4380-b1b9-09fd3c056b07 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:08.512413 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26686c41-e4a9-4380-b1b9-09fd3c056b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:08.552455 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-26686c41-e4a9-4380-b1b9-09fd3c056b07 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:27:08.554354 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-26686c41-e4a9-4380-b1b9-09fd3c056b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:08.564675 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1064/2108] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:27:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:27:08.568716 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93e7e5-8b58-4091-9235-6da2bf135f24 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:08.582742 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93e7e5-8b58-4091-9235-6da2bf135f24 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:08.591759 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7af654-2b2b-4c63-8e40-41fc1b9e2166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:08.591759 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7af654-2b2b-4c63-8e40-41fc1b9e2166 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:08.591759 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7af654-2b2b-4c63-8e40-41fc1b9e2166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:08.591759 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7af654-2b2b-4c63-8e40-41fc1b9e2166 admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:08.592137 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7af654-2b2b-4c63-8e40-41fc1b9e2166 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:27:08.592281 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7af654-2b2b-4c63-8e40-41fc1b9e2166 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:08.594197 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7af654-2b2b-4c63-8e40-41fc1b9e2166 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:08.615402 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1045/2109] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:27:08.617133 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26686c41-e4a9-4380-b1b9-09fd3c056b07 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:08.629906 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26686c41-e4a9-4380-b1b9-09fd3c056b07 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:08.631724 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b90e50-1663-4f82-90e8-dc0dd702a131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:08.632319 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b90e50-1663-4f82-90e8-dc0dd702a131 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:08.632600 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b90e50-1663-4f82-90e8-dc0dd702a131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:08.632878 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b90e50-1663-4f82-90e8-dc0dd702a131 admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:08.633526 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b90e50-1663-4f82-90e8-dc0dd702a131 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:08.635528 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b90e50-1663-4f82-90e8-dc0dd702a131 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:08.660234 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:08.711338 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1065/2110] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:27:08 2022] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:27:08.715724 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7af654-2b2b-4c63-8e40-41fc1b9e2166 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:08.725653 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7af654-2b2b-4c63-8e40-41fc1b9e2166 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:08.780733 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247a92e-f654-4dc1-8f7a-113effd11945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:08.781333 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247a92e-f654-4dc1-8f7a-113effd11945 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:08.781944 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247a92e-f654-4dc1-8f7a-113effd11945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:08.782258 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247a92e-f654-4dc1-8f7a-113effd11945 admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:08.784295 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6247a92e-f654-4dc1-8f7a-113effd11945 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:08.786061 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6247a92e-f654-4dc1-8f7a-113effd11945 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:08.857023 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1046/2111] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:27:08 2022] POST /identity/v3/users => generated 291 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:27:08.860861 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b90e50-1663-4f82-90e8-dc0dd702a131 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:08.884659 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b90e50-1663-4f82-90e8-dc0dd702a131 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:08.889422 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182cb03a-625d-4ff4-9833-3aca5b4238a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:08.890033 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182cb03a-625d-4ff4-9833-3aca5b4238a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:08.890537 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182cb03a-625d-4ff4-9833-3aca5b4238a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:08.890802 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182cb03a-625d-4ff4-9833-3aca5b4238a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:08.891532 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182cb03a-625d-4ff4-9833-3aca5b4238a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:08.893602 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182cb03a-625d-4ff4-9833-3aca5b4238a1 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:08.906020 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1066/2112] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:27:08.909812 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247a92e-f654-4dc1-8f7a-113effd11945 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:08.920469 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247a92e-f654-4dc1-8f7a-113effd11945 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:08.925455 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19dd18-fd96-413f-bec9-4b9d5ef04fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:08.926200 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19dd18-fd96-413f-bec9-4b9d5ef04fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:08.926511 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19dd18-fd96-413f-bec9-4b9d5ef04fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:08.926805 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19dd18-fd96-413f-bec9-4b9d5ef04fc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:08.927590 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19dd18-fd96-413f-bec9-4b9d5ef04fc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:08.929209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19dd18-fd96-413f-bec9-4b9d5ef04fc8 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:08.943238 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1047/2113] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:27:08.953301 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182cb03a-625d-4ff4-9833-3aca5b4238a1 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:08.975253 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182cb03a-625d-4ff4-9833-3aca5b4238a1 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:08.980606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5cb73-7105-45e8-9d2a-21eee701a537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:08.981277 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5cb73-7105-45e8-9d2a-21eee701a537 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:08.981561 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5cb73-7105-45e8-9d2a-21eee701a537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:08.981839 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5cb73-7105-45e8-9d2a-21eee701a537 admin admin] PATH_INFO: `/v3/projects/10a5b23ec4ce463cbb3f5cfd857c78a1/users/488a506b8a8d4da8808db81fa471f22b/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:08.996896 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5cb73-7105-45e8-9d2a-21eee701a537 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10a5b23ec4ce463cbb3f5cfd857c78a1, user_id=488a506b8a8d4da8808db81fa471f22b, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:08.999583 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5cb73-7105-45e8-9d2a-21eee701a537 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:09.099342 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1067/2114] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:27:08 2022] PUT /identity/v3/projects/10a5b23ec4ce463cbb3f5cfd857c78a1/users/488a506b8a8d4da8808db81fa471f22b/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:27:09.109416 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970c1bc-3e55-46e6-b7ec-dd706f87d0a7 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:09.109801 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970c1bc-3e55-46e6-b7ec-dd706f87d0a7 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:09.110202 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970c1bc-3e55-46e6-b7ec-dd706f87d0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:09.142476 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-2970c1bc-3e55-46e6-b7ec-dd706f87d0a7 None None] MFA Rules not processed for user `488a506b8a8d4da8808db81fa471f22b`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:27:09.144070 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-2970c1bc-3e55-46e6-b7ec-dd706f87d0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:09.222473 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1048/2115] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:27:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:27:09.230594 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5cb73-7105-45e8-9d2a-21eee701a537 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:09.294542 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5cb73-7105-45e8-9d2a-21eee701a537 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:09.301094 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899341a-1005-4e1a-8080-3b53beb88741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:09.301929 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899341a-1005-4e1a-8080-3b53beb88741 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:09.302216 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899341a-1005-4e1a-8080-3b53beb88741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:09.302487 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899341a-1005-4e1a-8080-3b53beb88741 admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:09.303113 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3899341a-1005-4e1a-8080-3b53beb88741 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:09.305080 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3899341a-1005-4e1a-8080-3b53beb88741 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:09.412085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1068/2116] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:27:09 2022] POST /identity/v3/projects => generated 379 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:27:09.415789 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970c1bc-3e55-46e6-b7ec-dd706f87d0a7 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:09.430020 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970c1bc-3e55-46e6-b7ec-dd706f87d0a7 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:09.508109 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7880c2-0b19-49d8-84ff-f60095b72ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:09.508696 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7880c2-0b19-49d8-84ff-f60095b72ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:09.508987 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7880c2-0b19-49d8-84ff-f60095b72ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:09.509272 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7880c2-0b19-49d8-84ff-f60095b72ba7 admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:09.509958 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7880c2-0b19-49d8-84ff-f60095b72ba7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:09.512072 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7880c2-0b19-49d8-84ff-f60095b72ba7 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:09.636406 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899341a-1005-4e1a-8080-3b53beb88741 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:09.637120 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1049/2117] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:27:09 2022] POST /identity/v3/users => generated 296 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:27:09.655842 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899341a-1005-4e1a-8080-3b53beb88741 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:09.662786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319eccf-51f6-4325-80ff-4fcc030353df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:09.664045 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319eccf-51f6-4325-80ff-4fcc030353df admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:09.664783 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319eccf-51f6-4325-80ff-4fcc030353df admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:09.665212 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319eccf-51f6-4325-80ff-4fcc030353df admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:09.666122 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f319eccf-51f6-4325-80ff-4fcc030353df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:09.669449 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f319eccf-51f6-4325-80ff-4fcc030353df admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:09.685117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1069/2118] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:27:09.689295 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7880c2-0b19-49d8-84ff-f60095b72ba7 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:09.700393 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7880c2-0b19-49d8-84ff-f60095b72ba7 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:09.716165 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ceecf5-7ec3-4f65-ae0e-4d75563f0f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:09.718609 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ceecf5-7ec3-4f65-ae0e-4d75563f0f8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:09.721272 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ceecf5-7ec3-4f65-ae0e-4d75563f0f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:09.721777 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ceecf5-7ec3-4f65-ae0e-4d75563f0f8a admin admin] PATH_INFO: `/v3/projects/b556adce115846379acf0131525734d7/users/ed1daf89d3b64452966fe7630a682836/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:09.742244 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ceecf5-7ec3-4f65-ae0e-4d75563f0f8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b556adce115846379acf0131525734d7, user_id=ed1daf89d3b64452966fe7630a682836, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:09.746516 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ceecf5-7ec3-4f65-ae0e-4d75563f0f8a admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:09.937310 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1050/2119] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:27:09 2022] PUT /identity/v3/projects/b556adce115846379acf0131525734d7/users/ed1daf89d3b64452966fe7630a682836/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:27:09.941158 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319eccf-51f6-4325-80ff-4fcc030353df admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:09.953374 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319eccf-51f6-4325-80ff-4fcc030353df admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:10.030389 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f7256-1035-44d2-8066-f78faa584782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:10.031191 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f7256-1035-44d2-8066-f78faa584782 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:10.031599 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f7256-1035-44d2-8066-f78faa584782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:10.032190 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f7256-1035-44d2-8066-f78faa584782 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:10.033806 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f7256-1035-44d2-8066-f78faa584782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:10.035764 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f7256-1035-44d2-8066-f78faa584782 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:10.050433 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1070/2120] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:27:10.057589 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ceecf5-7ec3-4f65-ae0e-4d75563f0f8a admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:10.070656 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ceecf5-7ec3-4f65-ae0e-4d75563f0f8a admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:10.099867 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eaec8b-259b-4db1-ac91-c9c28b098060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:10.100558 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eaec8b-259b-4db1-ac91-c9c28b098060 admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:10.100858 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eaec8b-259b-4db1-ac91-c9c28b098060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:10.101412 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eaec8b-259b-4db1-ac91-c9c28b098060 admin admin] PATH_INFO: `/v3/projects/b556adce115846379acf0131525734d7/users/ed1daf89d3b64452966fe7630a682836/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:10.103590 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eaec8b-259b-4db1-ac91-c9c28b098060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b556adce115846379acf0131525734d7, user_id=ed1daf89d3b64452966fe7630a682836, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:10.107090 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eaec8b-259b-4db1-ac91-c9c28b098060 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:10.118984 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1051/2121] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:27:10 2022] PUT /identity/v3/projects/b556adce115846379acf0131525734d7/users/ed1daf89d3b64452966fe7630a682836/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:27:10.132344 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ebd7e-21e9-4fba-bb1a-7c5c56371587 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:10.132344 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ebd7e-21e9-4fba-bb1a-7c5c56371587 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:10.132344 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ebd7e-21e9-4fba-bb1a-7c5c56371587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:10.158411 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-e06ebd7e-21e9-4fba-bb1a-7c5c56371587 None None] MFA Rules not processed for user `ed1daf89d3b64452966fe7630a682836`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:27:10.159692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-e06ebd7e-21e9-4fba-bb1a-7c5c56371587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:10.247341 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1071/2122] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:27:10 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:27:10.264562 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eaec8b-259b-4db1-ac91-c9c28b098060 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:10.271703 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-34eaec8b-259b-4db1-ac91-c9c28b098060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:10.337805 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eaec8b-259b-4db1-ac91-c9c28b098060 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:10.343344 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f05f4-ff1a-410a-a1ab-8955b9597247 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:10.344188 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f05f4-ff1a-410a-a1ab-8955b9597247 service cinder] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:10.344380 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f05f4-ff1a-410a-a1ab-8955b9597247 service cinder] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:10.344690 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f05f4-ff1a-410a-a1ab-8955b9597247 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:10.357140 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f05f4-ff1a-410a-a1ab-8955b9597247 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:10.363241 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f05f4-ff1a-410a-a1ab-8955b9597247 service cinder] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:10.369093 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1052/2123] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:27:10 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:27:11.604320 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:11.891823 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ebd7e-21e9-4fba-bb1a-7c5c56371587 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:11.901599 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ebd7e-21e9-4fba-bb1a-7c5c56371587 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:11.906283 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3a1b8-9a94-4bd2-89be-47eddef50c79 tempest-VolumeQuotaClassesTest-299178484 tempest-VolumeQuotaClassesTest-299178484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed1daf89d3b64452966fe7630a682836', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b556adce115846379acf0131525734d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:11.906888 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3a1b8-9a94-4bd2-89be-47eddef50c79 tempest-VolumeQuotaClassesTest-299178484 tempest-VolumeQuotaClassesTest-299178484-project-admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:11.907172 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3a1b8-9a94-4bd2-89be-47eddef50c79 tempest-VolumeQuotaClassesTest-299178484 tempest-VolumeQuotaClassesTest-299178484-project-admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:11.907499 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3a1b8-9a94-4bd2-89be-47eddef50c79 tempest-VolumeQuotaClassesTest-299178484 tempest-VolumeQuotaClassesTest-299178484-project-admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:11.908132 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3a1b8-9a94-4bd2-89be-47eddef50c79 tempest-VolumeQuotaClassesTest-299178484 tempest-VolumeQuotaClassesTest-299178484-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:27:11.908442 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3a1b8-9a94-4bd2-89be-47eddef50c79 tempest-VolumeQuotaClassesTest-299178484 tempest-VolumeQuotaClassesTest-299178484-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:11.910084 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3a1b8-9a94-4bd2-89be-47eddef50c79 tempest-VolumeQuotaClassesTest-299178484 tempest-VolumeQuotaClassesTest-299178484-project-admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:11.922124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1072/2124] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:27:11.925861 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f05f4-ff1a-410a-a1ab-8955b9597247 service cinder] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:11.938304 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f05f4-ff1a-410a-a1ab-8955b9597247 service cinder] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:11.940456 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1860b53-b1b9-49eb-9beb-26b51093cc3f tempest-VolumeQuotaClassesTest-299178484 tempest-VolumeQuotaClassesTest-299178484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed1daf89d3b64452966fe7630a682836', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b556adce115846379acf0131525734d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:11.941066 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1860b53-b1b9-49eb-9beb-26b51093cc3f tempest-VolumeQuotaClassesTest-299178484 tempest-VolumeQuotaClassesTest-299178484-project-admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:11.941353 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1860b53-b1b9-49eb-9beb-26b51093cc3f tempest-VolumeQuotaClassesTest-299178484 tempest-VolumeQuotaClassesTest-299178484-project-admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:11.941632 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1860b53-b1b9-49eb-9beb-26b51093cc3f tempest-VolumeQuotaClassesTest-299178484 tempest-VolumeQuotaClassesTest-299178484-project-admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:11.942314 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1860b53-b1b9-49eb-9beb-26b51093cc3f tempest-VolumeQuotaClassesTest-299178484 tempest-VolumeQuotaClassesTest-299178484-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:11.944243 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1860b53-b1b9-49eb-9beb-26b51093cc3f tempest-VolumeQuotaClassesTest-299178484 tempest-VolumeQuotaClassesTest-299178484-project-admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:11.962955 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:12.106065 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1053/2125] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:27:11 2022] POST /identity/v3/projects => generated 354 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:27:12.110166 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3a1b8-9a94-4bd2-89be-47eddef50c79 tempest-VolumeQuotaClassesTest-299178484 tempest-VolumeQuotaClassesTest-299178484-project-admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:12.119876 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3a1b8-9a94-4bd2-89be-47eddef50c79 tempest-VolumeQuotaClassesTest-299178484 tempest-VolumeQuotaClassesTest-299178484-project-admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:12.202525 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019206aa-f93a-474e-93fb-2a650caa775b tempest-VolumeQuotaClassesTest-299178484 tempest-VolumeQuotaClassesTest-299178484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed1daf89d3b64452966fe7630a682836', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b556adce115846379acf0131525734d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:12.202525 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019206aa-f93a-474e-93fb-2a650caa775b tempest-VolumeQuotaClassesTest-299178484 tempest-VolumeQuotaClassesTest-299178484-project-admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:12.202525 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019206aa-f93a-474e-93fb-2a650caa775b tempest-VolumeQuotaClassesTest-299178484 tempest-VolumeQuotaClassesTest-299178484-project-admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:12.202891 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019206aa-f93a-474e-93fb-2a650caa775b tempest-VolumeQuotaClassesTest-299178484 tempest-VolumeQuotaClassesTest-299178484-project-admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:12.202891 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019206aa-f93a-474e-93fb-2a650caa775b tempest-VolumeQuotaClassesTest-299178484 tempest-VolumeQuotaClassesTest-299178484-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:27:12.202891 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019206aa-f93a-474e-93fb-2a650caa775b tempest-VolumeQuotaClassesTest-299178484 tempest-VolumeQuotaClassesTest-299178484-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:12.202891 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019206aa-f93a-474e-93fb-2a650caa775b tempest-VolumeQuotaClassesTest-299178484 tempest-VolumeQuotaClassesTest-299178484-project-admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:12.216855 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1073/2126] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:27:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:27:12.258257 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1860b53-b1b9-49eb-9beb-26b51093cc3f tempest-VolumeQuotaClassesTest-299178484 tempest-VolumeQuotaClassesTest-299178484-project-admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:12.269187 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1860b53-b1b9-49eb-9beb-26b51093cc3f tempest-VolumeQuotaClassesTest-299178484 tempest-VolumeQuotaClassesTest-299178484-project-admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:12.273722 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451f156-a484-40df-973b-8d027ac0c3fc tempest-VolumeQuotaClassesTest-299178484 tempest-VolumeQuotaClassesTest-299178484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed1daf89d3b64452966fe7630a682836', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b556adce115846379acf0131525734d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:12.274350 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451f156-a484-40df-973b-8d027ac0c3fc tempest-VolumeQuotaClassesTest-299178484 tempest-VolumeQuotaClassesTest-299178484-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:12.274635 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451f156-a484-40df-973b-8d027ac0c3fc tempest-VolumeQuotaClassesTest-299178484 tempest-VolumeQuotaClassesTest-299178484-project-admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:12.275024 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451f156-a484-40df-973b-8d027ac0c3fc tempest-VolumeQuotaClassesTest-299178484 tempest-VolumeQuotaClassesTest-299178484-project-admin] PATH_INFO: `/v3/projects/7f784e46fa0f4b98b0c5922ba4755ac7` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:12.276055 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451f156-a484-40df-973b-8d027ac0c3fc tempest-VolumeQuotaClassesTest-299178484 tempest-VolumeQuotaClassesTest-299178484-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7f784e46fa0f4b98b0c5922ba4755ac7)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:12.277947 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451f156-a484-40df-973b-8d027ac0c3fc tempest-VolumeQuotaClassesTest-299178484 tempest-VolumeQuotaClassesTest-299178484-project-admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:12.442365 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-8451f156-a484-40df-973b-8d027ac0c3fc tempest-VolumeQuotaClassesTest-299178484 tempest-VolumeQuotaClassesTest-299178484-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f784e46fa0f4b98b0c5922ba4755ac7', 'request_id': 'req-8451f156-a484-40df-973b-8d027ac0c3fc'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:12.447822 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-8451f156-a484-40df-973b-8d027ac0c3fc tempest-VolumeQuotaClassesTest-299178484 tempest-VolumeQuotaClassesTest-299178484-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f784e46fa0f4b98b0c5922ba4755ac7', 'request_id': 'req-8451f156-a484-40df-973b-8d027ac0c3fc'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:12.454326 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-8451f156-a484-40df-973b-8d027ac0c3fc tempest-VolumeQuotaClassesTest-299178484 tempest-VolumeQuotaClassesTest-299178484-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f784e46fa0f4b98b0c5922ba4755ac7', 'request_id': 'req-8451f156-a484-40df-973b-8d027ac0c3fc'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:12.561770 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-8451f156-a484-40df-973b-8d027ac0c3fc tempest-VolumeQuotaClassesTest-299178484 tempest-VolumeQuotaClassesTest-299178484-project-admin] The token cache is being invalidate because project 7f784e46fa0f4b98b0c5922ba4755ac7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:27:12.567649 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-8451f156-a484-40df-973b-8d027ac0c3fc tempest-VolumeQuotaClassesTest-299178484 tempest-VolumeQuotaClassesTest-299178484-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:12.567649 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-8451f156-a484-40df-973b-8d027ac0c3fc tempest-VolumeQuotaClassesTest-299178484 tempest-VolumeQuotaClassesTest-299178484-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:12.567649 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1054/2127] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:27:12 2022] DELETE /identity/v3/projects/7f784e46fa0f4b98b0c5922ba4755ac7 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:27:13.502559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019206aa-f93a-474e-93fb-2a650caa775b tempest-VolumeQuotaClassesTest-299178484 tempest-VolumeQuotaClassesTest-299178484-project-admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:13.504335 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-019206aa-f93a-474e-93fb-2a650caa775b tempest-VolumeQuotaClassesTest-299178484 tempest-VolumeQuotaClassesTest-299178484-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:13.574212 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019206aa-f93a-474e-93fb-2a650caa775b tempest-VolumeQuotaClassesTest-299178484 tempest-VolumeQuotaClassesTest-299178484-project-admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:13.632158 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff4d45-0a55-410b-bcac-8b550d5afcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:13.632710 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff4d45-0a55-410b-bcac-8b550d5afcb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:13.632992 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff4d45-0a55-410b-bcac-8b550d5afcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:13.633271 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff4d45-0a55-410b-bcac-8b550d5afcb2 admin admin] PATH_INFO: `/v3/users/488a506b8a8d4da8808db81fa471f22b` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:13.634431 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff4d45-0a55-410b-bcac-8b550d5afcb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=488a506b8a8d4da8808db81fa471f22b)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:13.636404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff4d45-0a55-410b-bcac-8b550d5afcb2 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:13.796728 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:13.900056 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-89ff4d45-0a55-410b-bcac-8b550d5afcb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '488a506b8a8d4da8808db81fa471f22b'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:13.966719 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-89ff4d45-0a55-410b-bcac-8b550d5afcb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '488a506b8a8d4da8808db81fa471f22b'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:13.967477 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-89ff4d45-0a55-410b-bcac-8b550d5afcb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '488a506b8a8d4da8808db81fa471f22b'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:13.980053 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-89ff4d45-0a55-410b-bcac-8b550d5afcb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '488a506b8a8d4da8808db81fa471f22b'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:13.987176 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-89ff4d45-0a55-410b-bcac-8b550d5afcb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '488a506b8a8d4da8808db81fa471f22b'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:13.993389 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1074/2128] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:27:13 2022] DELETE /identity/v3/users/488a506b8a8d4da8808db81fa471f22b => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:27:13.997995 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20598a37-ef38-48ef-8eef-8a40f4be4eec None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:13.998474 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20598a37-ef38-48ef-8eef-8a40f4be4eec None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:13.998666 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20598a37-ef38-48ef-8eef-8a40f4be4eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:14.019304 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-20598a37-ef38-48ef-8eef-8a40f4be4eec None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:27:14.021287 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-20598a37-ef38-48ef-8eef-8a40f4be4eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:14.062358 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff4d45-0a55-410b-bcac-8b550d5afcb2 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:14.064365 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-89ff4d45-0a55-410b-bcac-8b550d5afcb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:14.081898 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1055/2129] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:27:14.092847 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20598a37-ef38-48ef-8eef-8a40f4be4eec None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:14.094206 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-20598a37-ef38-48ef-8eef-8a40f4be4eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:14.129830 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff4d45-0a55-410b-bcac-8b550d5afcb2 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:14.134769 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e4369-53cf-4ef1-9a97-6d8a8a204160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:14.135414 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e4369-53cf-4ef1-9a97-6d8a8a204160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:14.135700 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e4369-53cf-4ef1-9a97-6d8a8a204160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:14.135978 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e4369-53cf-4ef1-9a97-6d8a8a204160 admin admin] PATH_INFO: `/v3/users/427da4434cf340589ccecc0433248883` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:14.137405 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896e4369-53cf-4ef1-9a97-6d8a8a204160 admin admin] RBAC: Authorizing `identity:delete_user(user_id=427da4434cf340589ccecc0433248883)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:14.139515 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896e4369-53cf-4ef1-9a97-6d8a8a204160 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:14.151463 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20598a37-ef38-48ef-8eef-8a40f4be4eec None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:14.155198 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f6d75-6dfa-4ba1-846a-522225a3bee0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:14.155764 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f6d75-6dfa-4ba1-846a-522225a3bee0 service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:14.156043 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f6d75-6dfa-4ba1-846a-522225a3bee0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:14.156365 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f6d75-6dfa-4ba1-846a-522225a3bee0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:14.165298 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f6d75-6dfa-4ba1-846a-522225a3bee0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:14.166911 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f6d75-6dfa-4ba1-846a-522225a3bee0 service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:14.177193 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1056/2130] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:27:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:27:14.431797 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-896e4369-53cf-4ef1-9a97-6d8a8a204160 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '427da4434cf340589ccecc0433248883'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:14.533567 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-896e4369-53cf-4ef1-9a97-6d8a8a204160 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '427da4434cf340589ccecc0433248883'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:14.534637 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-896e4369-53cf-4ef1-9a97-6d8a8a204160 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '427da4434cf340589ccecc0433248883'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:14.555489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-896e4369-53cf-4ef1-9a97-6d8a8a204160 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '427da4434cf340589ccecc0433248883'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:14.563770 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-896e4369-53cf-4ef1-9a97-6d8a8a204160 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '427da4434cf340589ccecc0433248883'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:14.573832 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1075/2131] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:27:14 2022] DELETE /identity/v3/users/427da4434cf340589ccecc0433248883 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:27:14.577803 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc714e5-835d-458c-aaa3-171da566bb65 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:14.578145 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc714e5-835d-458c-aaa3-171da566bb65 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:14.578426 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc714e5-835d-458c-aaa3-171da566bb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:14.606113 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-abc714e5-835d-458c-aaa3-171da566bb65 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:27:14.607312 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-abc714e5-835d-458c-aaa3-171da566bb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:14.670971 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1057/2132] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:27:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:27:14.686522 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e4369-53cf-4ef1-9a97-6d8a8a204160 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:14.687990 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-896e4369-53cf-4ef1-9a97-6d8a8a204160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:14.747789 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e4369-53cf-4ef1-9a97-6d8a8a204160 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:14.751689 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01b49b-f08d-4b72-919a-a5064020c0d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:14.752366 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01b49b-f08d-4b72-919a-a5064020c0d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:14.752715 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01b49b-f08d-4b72-919a-a5064020c0d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:14.753057 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01b49b-f08d-4b72-919a-a5064020c0d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:14.762086 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01b49b-f08d-4b72-919a-a5064020c0d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:14.763724 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01b49b-f08d-4b72-919a-a5064020c0d7 service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:14.770001 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc714e5-835d-458c-aaa3-171da566bb65 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:14.771447 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-abc714e5-835d-458c-aaa3-171da566bb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:14.783581 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1076/2133] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:27:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:27:14.786240 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc714e5-835d-458c-aaa3-171da566bb65 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:14.790456 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c44c7a-7c40-4aeb-b5da-74d4b83399ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:14.791114 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c44c7a-7c40-4aeb-b5da-74d4b83399ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:14.791407 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c44c7a-7c40-4aeb-b5da-74d4b83399ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:14.791684 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c44c7a-7c40-4aeb-b5da-74d4b83399ed admin admin] PATH_INFO: `/v3/projects/10a5b23ec4ce463cbb3f5cfd857c78a1` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:14.792990 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c44c7a-7c40-4aeb-b5da-74d4b83399ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=10a5b23ec4ce463cbb3f5cfd857c78a1)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:14.794856 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c44c7a-7c40-4aeb-b5da-74d4b83399ed admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:15.164607 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-d2c44c7a-7c40-4aeb-b5da-74d4b83399ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10a5b23ec4ce463cbb3f5cfd857c78a1', 'request_id': 'req-d2c44c7a-7c40-4aeb-b5da-74d4b83399ed'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:15.170263 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-d2c44c7a-7c40-4aeb-b5da-74d4b83399ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10a5b23ec4ce463cbb3f5cfd857c78a1', 'request_id': 'req-d2c44c7a-7c40-4aeb-b5da-74d4b83399ed'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:15.178733 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-d2c44c7a-7c40-4aeb-b5da-74d4b83399ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10a5b23ec4ce463cbb3f5cfd857c78a1', 'request_id': 'req-d2c44c7a-7c40-4aeb-b5da-74d4b83399ed'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:15.284821 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-d2c44c7a-7c40-4aeb-b5da-74d4b83399ed admin admin] The token cache is being invalidate because project 10a5b23ec4ce463cbb3f5cfd857c78a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:27:15.284821 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-d2c44c7a-7c40-4aeb-b5da-74d4b83399ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:15.285658 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-d2c44c7a-7c40-4aeb-b5da-74d4b83399ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:15.290549 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1058/2134] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:27:14 2022] DELETE /identity/v3/projects/10a5b23ec4ce463cbb3f5cfd857c78a1 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:27:15.292390 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01b49b-f08d-4b72-919a-a5064020c0d7 service neutron] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:15.302542 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01b49b-f08d-4b72-919a-a5064020c0d7 service neutron] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:15.420154 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ca514-c698-477e-b909-f3a3de15fcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:15.420856 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ca514-c698-477e-b909-f3a3de15fcb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:15.421140 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ca514-c698-477e-b909-f3a3de15fcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:15.421416 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ca514-c698-477e-b909-f3a3de15fcb0 admin admin] PATH_INFO: `/v3/users/ed1daf89d3b64452966fe7630a682836` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:15.422819 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ca514-c698-477e-b909-f3a3de15fcb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed1daf89d3b64452966fe7630a682836)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:15.424894 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ca514-c698-477e-b909-f3a3de15fcb0 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:15.677629 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c25ca514-c698-477e-b909-f3a3de15fcb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed1daf89d3b64452966fe7630a682836'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:15.750771 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:15.758495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c25ca514-c698-477e-b909-f3a3de15fcb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed1daf89d3b64452966fe7630a682836'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:15.759111 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c25ca514-c698-477e-b909-f3a3de15fcb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed1daf89d3b64452966fe7630a682836'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:15.782435 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c25ca514-c698-477e-b909-f3a3de15fcb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed1daf89d3b64452966fe7630a682836'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:15.789870 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c25ca514-c698-477e-b909-f3a3de15fcb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed1daf89d3b64452966fe7630a682836'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:15.795875 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1077/2135] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:27:15 2022] DELETE /identity/v3/users/ed1daf89d3b64452966fe7630a682836 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:27:15.823439 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c44c7a-7c40-4aeb-b5da-74d4b83399ed admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:15.824956 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-d2c44c7a-7c40-4aeb-b5da-74d4b83399ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:15.838644 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c44c7a-7c40-4aeb-b5da-74d4b83399ed admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:15.902225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bfafc7-203e-4af4-afbb-08846cf57ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:15.903135 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfafc7-203e-4af4-afbb-08846cf57ea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:15.903618 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfafc7-203e-4af4-afbb-08846cf57ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:15.904068 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfafc7-203e-4af4-afbb-08846cf57ea7 admin admin] PATH_INFO: `/v3/projects/71b25937d1d04ff4a8b0b6ae25bd3545` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:15.905417 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bfafc7-203e-4af4-afbb-08846cf57ea7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71b25937d1d04ff4a8b0b6ae25bd3545)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:15.907748 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bfafc7-203e-4af4-afbb-08846cf57ea7 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:16.058623 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c5bfafc7-203e-4af4-afbb-08846cf57ea7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71b25937d1d04ff4a8b0b6ae25bd3545', 'request_id': 'req-c5bfafc7-203e-4af4-afbb-08846cf57ea7'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:16.065531 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c5bfafc7-203e-4af4-afbb-08846cf57ea7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71b25937d1d04ff4a8b0b6ae25bd3545', 'request_id': 'req-c5bfafc7-203e-4af4-afbb-08846cf57ea7'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:16.073158 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c5bfafc7-203e-4af4-afbb-08846cf57ea7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71b25937d1d04ff4a8b0b6ae25bd3545', 'request_id': 'req-c5bfafc7-203e-4af4-afbb-08846cf57ea7'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:16.176133 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c5bfafc7-203e-4af4-afbb-08846cf57ea7 admin admin] The token cache is being invalidate because project 71b25937d1d04ff4a8b0b6ae25bd3545 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:27:16.177267 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c5bfafc7-203e-4af4-afbb-08846cf57ea7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:16.178447 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c5bfafc7-203e-4af4-afbb-08846cf57ea7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:16.180200 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1059/2136] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:27:15 2022] DELETE /identity/v3/projects/71b25937d1d04ff4a8b0b6ae25bd3545 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:27:16.185853 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ca514-c698-477e-b909-f3a3de15fcb0 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:16.189432 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-c25ca514-c698-477e-b909-f3a3de15fcb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:16.202094 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ca514-c698-477e-b909-f3a3de15fcb0 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:16.304467 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5ae9c-bf80-4437-9586-50041c6d39cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:16.305443 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5ae9c-bf80-4437-9586-50041c6d39cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:16.305952 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5ae9c-bf80-4437-9586-50041c6d39cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:16.306572 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5ae9c-bf80-4437-9586-50041c6d39cf admin admin] PATH_INFO: `/v3/users/93d1d65771fd422da5afc3bfa8bd763e` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:16.307994 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c5ae9c-bf80-4437-9586-50041c6d39cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=93d1d65771fd422da5afc3bfa8bd763e)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:16.310611 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c5ae9c-bf80-4437-9586-50041c6d39cf admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:16.341732 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:16.581527 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bfafc7-203e-4af4-afbb-08846cf57ea7 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:16.581678 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-c5bfafc7-203e-4af4-afbb-08846cf57ea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:16.605843 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bfafc7-203e-4af4-afbb-08846cf57ea7 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:16.616541 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2774156-1884-48fe-a540-d6d913fe1764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:16.617239 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2774156-1884-48fe-a540-d6d913fe1764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:16.617549 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2774156-1884-48fe-a540-d6d913fe1764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:16.617830 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2774156-1884-48fe-a540-d6d913fe1764 admin admin] PATH_INFO: `/v3/projects/b556adce115846379acf0131525734d7` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:16.619044 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2774156-1884-48fe-a540-d6d913fe1764 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b556adce115846379acf0131525734d7)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:16.620999 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2774156-1884-48fe-a540-d6d913fe1764 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:16.641379 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-b2c5ae9c-bf80-4437-9586-50041c6d39cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93d1d65771fd422da5afc3bfa8bd763e'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:16.775889 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-b2c5ae9c-bf80-4437-9586-50041c6d39cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93d1d65771fd422da5afc3bfa8bd763e'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:16.776975 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-b2c5ae9c-bf80-4437-9586-50041c6d39cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93d1d65771fd422da5afc3bfa8bd763e'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:16.793505 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-b2c5ae9c-bf80-4437-9586-50041c6d39cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93d1d65771fd422da5afc3bfa8bd763e'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:16.803166 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-b2c5ae9c-bf80-4437-9586-50041c6d39cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93d1d65771fd422da5afc3bfa8bd763e'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:16.811414 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1078/2137] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:27:16 2022] DELETE /identity/v3/users/93d1d65771fd422da5afc3bfa8bd763e => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:27:16.832364 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-a2774156-1884-48fe-a540-d6d913fe1764 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b556adce115846379acf0131525734d7', 'request_id': 'req-a2774156-1884-48fe-a540-d6d913fe1764'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:16.837676 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-a2774156-1884-48fe-a540-d6d913fe1764 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b556adce115846379acf0131525734d7', 'request_id': 'req-a2774156-1884-48fe-a540-d6d913fe1764'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:16.844281 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-a2774156-1884-48fe-a540-d6d913fe1764 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b556adce115846379acf0131525734d7', 'request_id': 'req-a2774156-1884-48fe-a540-d6d913fe1764'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:17.013264 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-a2774156-1884-48fe-a540-d6d913fe1764 admin admin] The token cache is being invalidate because project b556adce115846379acf0131525734d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:27:17.013561 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-a2774156-1884-48fe-a540-d6d913fe1764 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:17.014179 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-a2774156-1884-48fe-a540-d6d913fe1764 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:17.015723 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1060/2138] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:27:16 2022] DELETE /identity/v3/projects/b556adce115846379acf0131525734d7 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:27:17.020747 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef76aa-23ad-486b-b25d-71f39fc706b6 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:17.021039 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef76aa-23ad-486b-b25d-71f39fc706b6 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:17.021321 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef76aa-23ad-486b-b25d-71f39fc706b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:17.041686 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-d3ef76aa-23ad-486b-b25d-71f39fc706b6 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:27:17.042912 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-d3ef76aa-23ad-486b-b25d-71f39fc706b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:17.131294 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1079/2139] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:27:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:27:17.134110 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa4109-11a1-49c4-b6a6-fb75bdb9f247 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:17.134750 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa4109-11a1-49c4-b6a6-fb75bdb9f247 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:17.135034 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa4109-11a1-49c4-b6a6-fb75bdb9f247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:17.158126 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-edaa4109-11a1-49c4-b6a6-fb75bdb9f247 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:27:17.159609 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-edaa4109-11a1-49c4-b6a6-fb75bdb9f247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:17.168025 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1061/2140] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:27:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:27:17.172610 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef76aa-23ad-486b-b25d-71f39fc706b6 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:17.187629 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef76aa-23ad-486b-b25d-71f39fc706b6 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:17.192926 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f93a6-6b30-4a79-b09b-09f80b78fa35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:17.193781 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f93a6-6b30-4a79-b09b-09f80b78fa35 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:17.194072 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f93a6-6b30-4a79-b09b-09f80b78fa35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:17.194350 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f93a6-6b30-4a79-b09b-09f80b78fa35 admin admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:17.195014 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f93a6-6b30-4a79-b09b-09f80b78fa35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:27:17.195515 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f93a6-6b30-4a79-b09b-09f80b78fa35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:17.197239 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f93a6-6b30-4a79-b09b-09f80b78fa35 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:17.210653 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1080/2141] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:27:17.214752 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa4109-11a1-49c4-b6a6-fb75bdb9f247 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:17.225357 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa4109-11a1-49c4-b6a6-fb75bdb9f247 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:17.230865 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b3c35-603d-4a0e-ad0c-0e75abff3d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:17.231779 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b3c35-603d-4a0e-ad0c-0e75abff3d0d admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:17.232223 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b3c35-603d-4a0e-ad0c-0e75abff3d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:17.232654 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b3c35-603d-4a0e-ad0c-0e75abff3d0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:17.233498 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b3c35-603d-4a0e-ad0c-0e75abff3d0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:17.235622 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b3c35-603d-4a0e-ad0c-0e75abff3d0d admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:17.404557 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1062/2142] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:27:17 2022] POST /identity/v3/projects => generated 371 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:27:17.408457 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f93a6-6b30-4a79-b09b-09f80b78fa35 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:17.418580 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f93a6-6b30-4a79-b09b-09f80b78fa35 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:17.457310 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b3c35-603d-4a0e-ad0c-0e75abff3d0d admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:17.459837 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-9f9b3c35-603d-4a0e-ad0c-0e75abff3d0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:17.483899 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96d409-fa25-4c9c-abc9-cfcb2021ec17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:17.483899 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96d409-fa25-4c9c-abc9-cfcb2021ec17 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:17.483899 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96d409-fa25-4c9c-abc9-cfcb2021ec17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:17.483899 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96d409-fa25-4c9c-abc9-cfcb2021ec17 admin admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:17.484360 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96d409-fa25-4c9c-abc9-cfcb2021ec17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:17.485960 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96d409-fa25-4c9c-abc9-cfcb2021ec17 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:17.564407 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b3c35-603d-4a0e-ad0c-0e75abff3d0d admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:17.569543 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44aa9e-dede-4c1a-b517-add66cb9e3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:17.573615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44aa9e-dede-4c1a-b517-add66cb9e3fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:17.573615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44aa9e-dede-4c1a-b517-add66cb9e3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:17.573615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44aa9e-dede-4c1a-b517-add66cb9e3fe admin admin] PATH_INFO: `/v3/projects/4f1fee95ff094998bd79ca5e77b9b10d` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:17.573615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f44aa9e-dede-4c1a-b517-add66cb9e3fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f1fee95ff094998bd79ca5e77b9b10d)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:17.574202 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f44aa9e-dede-4c1a-b517-add66cb9e3fe admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:17.608758 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1081/2143] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:27:17 2022] POST /identity/v3/users => generated 286 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:27:17.613842 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96d409-fa25-4c9c-abc9-cfcb2021ec17 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:17.622930 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96d409-fa25-4c9c-abc9-cfcb2021ec17 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:17.627701 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86da3a9-ee34-4f94-838a-c3761f791294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:17.628300 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86da3a9-ee34-4f94-838a-c3761f791294 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:17.628751 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86da3a9-ee34-4f94-838a-c3761f791294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:17.629021 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86da3a9-ee34-4f94-838a-c3761f791294 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:17.629856 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86da3a9-ee34-4f94-838a-c3761f791294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:17.631466 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86da3a9-ee34-4f94-838a-c3761f791294 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:17.647961 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1082/2144] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:27:17.656268 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86da3a9-ee34-4f94-838a-c3761f791294 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:17.668160 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86da3a9-ee34-4f94-838a-c3761f791294 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:17.673431 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805a164-2afc-4676-9a7f-f8378832f725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:17.674081 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805a164-2afc-4676-9a7f-f8378832f725 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:17.674369 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805a164-2afc-4676-9a7f-f8378832f725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:17.674649 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805a164-2afc-4676-9a7f-f8378832f725 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:17.675517 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d805a164-2afc-4676-9a7f-f8378832f725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:17.677208 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d805a164-2afc-4676-9a7f-f8378832f725 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:17.687642 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1083/2145] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:27:17.692158 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805a164-2afc-4676-9a7f-f8378832f725 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:17.701882 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805a164-2afc-4676-9a7f-f8378832f725 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:17.707026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f2f1c-086d-442e-abea-5377cdf66d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:17.707700 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f2f1c-086d-442e-abea-5377cdf66d89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:17.707982 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f2f1c-086d-442e-abea-5377cdf66d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:17.708254 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f2f1c-086d-442e-abea-5377cdf66d89 admin admin] PATH_INFO: `/v3/projects/eea5a6f74e624e8b9c83477ac64d351d/users/559e25d50bb74268aaac2e8c85bf139a/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:17.723125 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322f2f1c-086d-442e-abea-5377cdf66d89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eea5a6f74e624e8b9c83477ac64d351d, user_id=559e25d50bb74268aaac2e8c85bf139a, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:17.725803 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322f2f1c-086d-442e-abea-5377cdf66d89 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:17.871145 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1084/2146] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:27:17 2022] PUT /identity/v3/projects/eea5a6f74e624e8b9c83477ac64d351d/users/559e25d50bb74268aaac2e8c85bf139a/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:27:17.875160 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-2f44aa9e-dede-4c1a-b517-add66cb9e3fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f1fee95ff094998bd79ca5e77b9b10d', 'request_id': 'req-2f44aa9e-dede-4c1a-b517-add66cb9e3fe'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:17.882940 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0e43a-9147-4482-89ac-00acb99b5404 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:17.883166 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-2f44aa9e-dede-4c1a-b517-add66cb9e3fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f1fee95ff094998bd79ca5e77b9b10d', 'request_id': 'req-2f44aa9e-dede-4c1a-b517-add66cb9e3fe'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:17.883529 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0e43a-9147-4482-89ac-00acb99b5404 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:17.883870 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0e43a-9147-4482-89ac-00acb99b5404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:17.894792 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-2f44aa9e-dede-4c1a-b517-add66cb9e3fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f1fee95ff094998bd79ca5e77b9b10d', 'request_id': 'req-2f44aa9e-dede-4c1a-b517-add66cb9e3fe'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:17.914488 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-c6c0e43a-9147-4482-89ac-00acb99b5404 None None] MFA Rules not processed for user `559e25d50bb74268aaac2e8c85bf139a`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:27:17.915808 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-c6c0e43a-9147-4482-89ac-00acb99b5404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:17.981407 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1085/2147] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:27:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:27:17.993646 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0e43a-9147-4482-89ac-00acb99b5404 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:17.995001 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-c6c0e43a-9147-4482-89ac-00acb99b5404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:18.058472 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-2f44aa9e-dede-4c1a-b517-add66cb9e3fe admin admin] The token cache is being invalidate because project 4f1fee95ff094998bd79ca5e77b9b10d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:27:18.058472 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-2f44aa9e-dede-4c1a-b517-add66cb9e3fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:18.058472 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-2f44aa9e-dede-4c1a-b517-add66cb9e3fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:18.058472 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1063/2148] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:27:17 2022] DELETE /identity/v3/projects/4f1fee95ff094998bd79ca5e77b9b10d => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:27:18.063747 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5366d52-a3b0-48b3-8a86-35e2a45f418d None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:18.064120 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5366d52-a3b0-48b3-8a86-35e2a45f418d None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:18.064993 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5366d52-a3b0-48b3-8a86-35e2a45f418d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:18.081355 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0e43a-9147-4482-89ac-00acb99b5404 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:18.084841 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6eab15-1ec7-4f4b-bfb8-1f7bff8cfdb1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aae574170d6f4eb8ab70805d8b5f4f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:18.085453 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6eab15-1ec7-4f4b-bfb8-1f7bff8cfdb1 service glance] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:18.085730 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6eab15-1ec7-4f4b-bfb8-1f7bff8cfdb1 service glance] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:18.086007 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6eab15-1ec7-4f4b-bfb8-1f7bff8cfdb1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:18.087286 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-d5366d52-a3b0-48b3-8a86-35e2a45f418d None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:27:18.087762 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-8c6eab15-1ec7-4f4b-bfb8-1f7bff8cfdb1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:18.088717 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-d5366d52-a3b0-48b3-8a86-35e2a45f418d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:18.106521 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6eab15-1ec7-4f4b-bfb8-1f7bff8cfdb1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:18.107989 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6eab15-1ec7-4f4b-bfb8-1f7bff8cfdb1 service glance] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:18.121377 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1086/2149] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:27:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:27:18.160594 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1064/2150] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:27:18.169098 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc6779-2532-4b1c-9bcd-48b43cd5da72 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:18.169098 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc6779-2532-4b1c-9bcd-48b43cd5da72 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:18.169384 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc6779-2532-4b1c-9bcd-48b43cd5da72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:18.189016 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-63dc6779-2532-4b1c-9bcd-48b43cd5da72 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:27:18.190209 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-63dc6779-2532-4b1c-9bcd-48b43cd5da72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:18.199648 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1087/2151] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:27:18.202946 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5366d52-a3b0-48b3-8a86-35e2a45f418d None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:18.214195 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5366d52-a3b0-48b3-8a86-35e2a45f418d None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:18.219238 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402c846-256f-46ec-94dd-69653d692bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:18.228035 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402c846-256f-46ec-94dd-69653d692bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:18.228035 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402c846-256f-46ec-94dd-69653d692bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:18.228035 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402c846-256f-46ec-94dd-69653d692bf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:18.228035 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6402c846-256f-46ec-94dd-69653d692bf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:27:18.228035 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6402c846-256f-46ec-94dd-69653d692bf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:18.228035 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6402c846-256f-46ec-94dd-69653d692bf9 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:18.237025 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1065/2152] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:27:18.241433 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc6779-2532-4b1c-9bcd-48b43cd5da72 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:18.257278 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc6779-2532-4b1c-9bcd-48b43cd5da72 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:18.260619 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9a5f4-f5e1-4e7a-989f-2c4867a59e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:18.261197 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9a5f4-f5e1-4e7a-989f-2c4867a59e1c admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:18.261677 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9a5f4-f5e1-4e7a-989f-2c4867a59e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:18.261768 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9a5f4-f5e1-4e7a-989f-2c4867a59e1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:18.262350 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9a5f4-f5e1-4e7a-989f-2c4867a59e1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:18.264345 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9a5f4-f5e1-4e7a-989f-2c4867a59e1c admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:18.278432 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:18.493754 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1088/2153] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:27:18 2022] POST /identity/v3/projects => generated 383 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:27:18.495680 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402c846-256f-46ec-94dd-69653d692bf9 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:18.515688 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402c846-256f-46ec-94dd-69653d692bf9 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:18.586968 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4213a-b249-495c-b83f-d61e799c610d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:18.587605 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4213a-b249-495c-b83f-d61e799c610d admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:18.587933 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4213a-b249-495c-b83f-d61e799c610d admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:18.588214 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4213a-b249-495c-b83f-d61e799c610d admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:18.588873 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4213a-b249-495c-b83f-d61e799c610d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:18.590791 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4213a-b249-495c-b83f-d61e799c610d admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:18.712738 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1066/2154] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:27:18 2022] POST /identity/v3/users => generated 292 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:27:18.714680 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9a5f4-f5e1-4e7a-989f-2c4867a59e1c admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:18.726171 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9a5f4-f5e1-4e7a-989f-2c4867a59e1c admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:18.731026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c02f61-4e4b-47e4-9ad5-1cd332db429b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:18.733326 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c02f61-4e4b-47e4-9ad5-1cd332db429b admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:18.735666 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c02f61-4e4b-47e4-9ad5-1cd332db429b admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:18.735666 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c02f61-4e4b-47e4-9ad5-1cd332db429b admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:18.735666 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c02f61-4e4b-47e4-9ad5-1cd332db429b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:18.737297 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c02f61-4e4b-47e4-9ad5-1cd332db429b admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:18.769507 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1089/2155] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:27:18.773206 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4213a-b249-495c-b83f-d61e799c610d admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:18.785295 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4213a-b249-495c-b83f-d61e799c610d admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:18.790649 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c38eb-de14-473c-966d-7640dc349c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:18.791857 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c38eb-de14-473c-966d-7640dc349c21 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:18.792258 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c38eb-de14-473c-966d-7640dc349c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:18.792728 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c38eb-de14-473c-966d-7640dc349c21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:18.793848 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c38eb-de14-473c-966d-7640dc349c21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:18.797183 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c38eb-de14-473c-966d-7640dc349c21 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:18.816445 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1067/2156] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:27:18.817703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c02f61-4e4b-47e4-9ad5-1cd332db429b admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:18.832511 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c02f61-4e4b-47e4-9ad5-1cd332db429b admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:18.838539 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b8938e-5b44-40ee-9227-917a1a08b325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:18.839223 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b8938e-5b44-40ee-9227-917a1a08b325 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:18.839598 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b8938e-5b44-40ee-9227-917a1a08b325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:18.840074 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b8938e-5b44-40ee-9227-917a1a08b325 admin admin] PATH_INFO: `/v3/projects/3f7a1989404246e7b4e00cae7228bd89/users/8a24f9c21bc0476eb25f10429365764b/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:18.857888 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b8938e-5b44-40ee-9227-917a1a08b325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f7a1989404246e7b4e00cae7228bd89, user_id=8a24f9c21bc0476eb25f10429365764b, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:18.860730 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b8938e-5b44-40ee-9227-917a1a08b325 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:18.964506 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1090/2157] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:27:18 2022] PUT /identity/v3/projects/3f7a1989404246e7b4e00cae7228bd89/users/8a24f9c21bc0476eb25f10429365764b/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:27:18.976981 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1769e3-6d4c-4857-b6a4-625d89e7a422 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:18.977261 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1769e3-6d4c-4857-b6a4-625d89e7a422 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:18.977544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1769e3-6d4c-4857-b6a4-625d89e7a422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:19.013171 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-ca1769e3-6d4c-4857-b6a4-625d89e7a422 None None] MFA Rules not processed for user `8a24f9c21bc0476eb25f10429365764b`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:27:19.014563 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-ca1769e3-6d4c-4857-b6a4-625d89e7a422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:19.087797 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1068/2158] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:27:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:27:19.089166 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b8938e-5b44-40ee-9227-917a1a08b325 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:19.152753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b8938e-5b44-40ee-9227-917a1a08b325 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:19.159188 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d29893-499d-474d-8ce7-79917144aa09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:19.159804 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d29893-499d-474d-8ce7-79917144aa09 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:19.160156 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d29893-499d-474d-8ce7-79917144aa09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:19.160503 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d29893-499d-474d-8ce7-79917144aa09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:19.161202 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d29893-499d-474d-8ce7-79917144aa09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:19.163159 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d29893-499d-474d-8ce7-79917144aa09 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:19.352469 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1091/2159] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:27:19 2022] POST /identity/v3/projects => generated 381 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:27:19.353001 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1769e3-6d4c-4857-b6a4-625d89e7a422 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:19.366628 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1769e3-6d4c-4857-b6a4-625d89e7a422 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:19.435115 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19a189-a964-4de6-9c4a-85848ff65b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:19.435752 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19a189-a964-4de6-9c4a-85848ff65b5c admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:19.436078 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19a189-a964-4de6-9c4a-85848ff65b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:19.436320 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19a189-a964-4de6-9c4a-85848ff65b5c admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:19.436979 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae19a189-a964-4de6-9c4a-85848ff65b5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:19.439409 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae19a189-a964-4de6-9c4a-85848ff65b5c admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:19.586521 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1069/2160] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:27:19 2022] POST /identity/v3/users => generated 291 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:27:19.592863 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d29893-499d-474d-8ce7-79917144aa09 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:19.604920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d29893-499d-474d-8ce7-79917144aa09 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:19.612114 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64744d4a-37a7-4862-9041-33eacf081f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:19.612734 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64744d4a-37a7-4862-9041-33eacf081f60 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:19.613574 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64744d4a-37a7-4862-9041-33eacf081f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:19.614001 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64744d4a-37a7-4862-9041-33eacf081f60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:19.614664 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64744d4a-37a7-4862-9041-33eacf081f60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:19.616559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64744d4a-37a7-4862-9041-33eacf081f60 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:19.632497 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1092/2161] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:27:19.633794 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19a189-a964-4de6-9c4a-85848ff65b5c admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:19.644773 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19a189-a964-4de6-9c4a-85848ff65b5c admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:19.649927 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923452f-6bd5-4b86-9429-a3a8b889beb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:19.650614 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923452f-6bd5-4b86-9429-a3a8b889beb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:19.650970 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923452f-6bd5-4b86-9429-a3a8b889beb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:19.651340 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923452f-6bd5-4b86-9429-a3a8b889beb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:19.652186 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e923452f-6bd5-4b86-9429-a3a8b889beb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:19.653895 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e923452f-6bd5-4b86-9429-a3a8b889beb5 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:19.666211 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1070/2162] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:27:19.677704 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64744d4a-37a7-4862-9041-33eacf081f60 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:19.688699 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64744d4a-37a7-4862-9041-33eacf081f60 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:19.693989 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c7b56-ee37-4c8a-bc0b-ef431fcfef2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:19.694774 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c7b56-ee37-4c8a-bc0b-ef431fcfef2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:19.695136 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c7b56-ee37-4c8a-bc0b-ef431fcfef2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:19.695448 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c7b56-ee37-4c8a-bc0b-ef431fcfef2a admin admin] PATH_INFO: `/v3/projects/ee7d77bc932f4979bbb5294cc1bc9ac9/users/60c4a59652d14cb2a87566cf10248dcb/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:19.712311 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230c7b56-ee37-4c8a-bc0b-ef431fcfef2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee7d77bc932f4979bbb5294cc1bc9ac9, user_id=60c4a59652d14cb2a87566cf10248dcb, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:19.715109 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230c7b56-ee37-4c8a-bc0b-ef431fcfef2a admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:19.858746 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1093/2163] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:27:19 2022] PUT /identity/v3/projects/ee7d77bc932f4979bbb5294cc1bc9ac9/users/60c4a59652d14cb2a87566cf10248dcb/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:27:19.869691 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c13623-e7a7-4568-bd50-188c6ff15701 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:19.869981 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c13623-e7a7-4568-bd50-188c6ff15701 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:19.870333 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c13623-e7a7-4568-bd50-188c6ff15701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:19.898854 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-c9c13623-e7a7-4568-bd50-188c6ff15701 None None] MFA Rules not processed for user `60c4a59652d14cb2a87566cf10248dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:27:19.900236 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-c9c13623-e7a7-4568-bd50-188c6ff15701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:19.978753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9635a6-0df4-4ad0-927d-f1a59ee99141 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:19.979257 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9635a6-0df4-4ad0-927d-f1a59ee99141 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:19.979378 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9635a6-0df4-4ad0-927d-f1a59ee99141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:19.989395 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1071/2164] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:27:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:27:19.990903 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c13623-e7a7-4568-bd50-188c6ff15701 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:20.004816 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-3f9635a6-0df4-4ad0-927d-f1a59ee99141 None None] MFA Rules not processed for user `014a5ebd029d43d194722af661e4675b`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:27:20.006084 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-3f9635a6-0df4-4ad0-927d-f1a59ee99141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:20.092477 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c13623-e7a7-4568-bd50-188c6ff15701 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:20.099447 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae19275-7a0a-45a7-9aef-294038be3d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:20.100181 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae19275-7a0a-45a7-9aef-294038be3d27 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:20.100465 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae19275-7a0a-45a7-9aef-294038be3d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:20.100755 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae19275-7a0a-45a7-9aef-294038be3d27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:20.101557 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae19275-7a0a-45a7-9aef-294038be3d27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:20.103561 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae19275-7a0a-45a7-9aef-294038be3d27 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:20.109411 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1094/2165] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:27:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:27:20.219477 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1072/2166] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:27:19 2022] POST /identity/v3/projects => generated 385 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:27:20.221403 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9635a6-0df4-4ad0-927d-f1a59ee99141 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:20.233901 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9635a6-0df4-4ad0-927d-f1a59ee99141 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:20.305513 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7d072-74e5-4009-b200-9c8bc77dcf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:20.306218 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7d072-74e5-4009-b200-9c8bc77dcf4a admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:20.306725 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7d072-74e5-4009-b200-9c8bc77dcf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:20.307144 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7d072-74e5-4009-b200-9c8bc77dcf4a admin admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:20.307829 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd7d072-74e5-4009-b200-9c8bc77dcf4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:20.309761 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd7d072-74e5-4009-b200-9c8bc77dcf4a admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:20.496592 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1095/2167] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:27:20 2022] POST /identity/v3/users => generated 299 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:27:20.497757 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae19275-7a0a-45a7-9aef-294038be3d27 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:20.511693 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae19275-7a0a-45a7-9aef-294038be3d27 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:20.517962 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17358727-bd17-480a-bba6-45aacffba0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:20.518747 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17358727-bd17-480a-bba6-45aacffba0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:20.519032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17358727-bd17-480a-bba6-45aacffba0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:20.519573 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17358727-bd17-480a-bba6-45aacffba0a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:20.520368 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17358727-bd17-480a-bba6-45aacffba0a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:20.525889 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17358727-bd17-480a-bba6-45aacffba0a2 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:20.540446 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1073/2168] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:27:20.543823 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7d072-74e5-4009-b200-9c8bc77dcf4a admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:20.554412 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7d072-74e5-4009-b200-9c8bc77dcf4a admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:20.563796 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4e072-cbf2-4ae6-95ae-16908f3ebeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:20.565093 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4e072-cbf2-4ae6-95ae-16908f3ebeb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:20.565093 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4e072-cbf2-4ae6-95ae-16908f3ebeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:20.565326 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4e072-cbf2-4ae6-95ae-16908f3ebeb8 admin admin] PATH_INFO: `/v3/projects/83dce9b2149643ad96d74ad8af9c0c8e/users/274624fb2dc34581a3c439d1f1718ef9/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:20.584471 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4e072-cbf2-4ae6-95ae-16908f3ebeb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83dce9b2149643ad96d74ad8af9c0c8e, user_id=274624fb2dc34581a3c439d1f1718ef9, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:20.587491 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4e072-cbf2-4ae6-95ae-16908f3ebeb8 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:20.703575 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1096/2169] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:27:20 2022] PUT /identity/v3/projects/83dce9b2149643ad96d74ad8af9c0c8e/users/274624fb2dc34581a3c439d1f1718ef9/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:27:20.708707 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17358727-bd17-480a-bba6-45aacffba0a2 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:20.731664 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17358727-bd17-480a-bba6-45aacffba0a2 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:20.846650 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70a15e-9705-40a7-8458-fca54136e85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:20.847291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70a15e-9705-40a7-8458-fca54136e85b admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:20.847650 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70a15e-9705-40a7-8458-fca54136e85b admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:20.847929 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70a15e-9705-40a7-8458-fca54136e85b admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:20.848600 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb70a15e-9705-40a7-8458-fca54136e85b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:20.850286 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb70a15e-9705-40a7-8458-fca54136e85b admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:20.862865 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1074/2170] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:27:20.869021 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4e072-cbf2-4ae6-95ae-16908f3ebeb8 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:20.881575 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4e072-cbf2-4ae6-95ae-16908f3ebeb8 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:20.887860 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586f685-dea8-4619-b17c-7d2a792a62e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:20.895062 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586f685-dea8-4619-b17c-7d2a792a62e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:20.895647 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586f685-dea8-4619-b17c-7d2a792a62e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:20.895936 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586f685-dea8-4619-b17c-7d2a792a62e4 admin admin] PATH_INFO: `/v3/projects/83dce9b2149643ad96d74ad8af9c0c8e/users/274624fb2dc34581a3c439d1f1718ef9/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:20.899236 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586f685-dea8-4619-b17c-7d2a792a62e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83dce9b2149643ad96d74ad8af9c0c8e, user_id=274624fb2dc34581a3c439d1f1718ef9, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:20.902236 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586f685-dea8-4619-b17c-7d2a792a62e4 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:20.937471 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1097/2171] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:27:20 2022] PUT /identity/v3/projects/83dce9b2149643ad96d74ad8af9c0c8e/users/274624fb2dc34581a3c439d1f1718ef9/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:27:20.947909 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac81e6-68ec-463c-a3ac-b652a77db47e None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:20.948374 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac81e6-68ec-463c-a3ac-b652a77db47e None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:20.948655 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac81e6-68ec-463c-a3ac-b652a77db47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:20.989497 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-7fac81e6-68ec-463c-a3ac-b652a77db47e None None] MFA Rules not processed for user `274624fb2dc34581a3c439d1f1718ef9`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:27:20.991205 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-7fac81e6-68ec-463c-a3ac-b652a77db47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:21.076643 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:21.096815 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1075/2172] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:27:20 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:27:21.112097 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586f685-dea8-4619-b17c-7d2a792a62e4 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:21.118921 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-4586f685-dea8-4619-b17c-7d2a792a62e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:21.213132 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586f685-dea8-4619-b17c-7d2a792a62e4 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:21.216814 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9d89b-5cb6-40ac-b5dd-57486ecb8042 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:21.217530 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9d89b-5cb6-40ac-b5dd-57486ecb8042 service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:21.217821 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9d89b-5cb6-40ac-b5dd-57486ecb8042 service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:21.218236 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9d89b-5cb6-40ac-b5dd-57486ecb8042 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:21.304287 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d9d89b-5cb6-40ac-b5dd-57486ecb8042 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:21.306258 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d9d89b-5cb6-40ac-b5dd-57486ecb8042 service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:21.339558 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1098/2173] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:27:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:27:22.056811 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736cfc4-d4fa-4dfc-90c4-f6de5a0f14bd None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:22.057357 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736cfc4-d4fa-4dfc-90c4-f6de5a0f14bd None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:22.057715 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736cfc4-d4fa-4dfc-90c4-f6de5a0f14bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:22.080565 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-e736cfc4-d4fa-4dfc-90c4-f6de5a0f14bd None None] MFA Rules not processed for user `1d39439278814d4faac4cfb1e71aa4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:27:22.082044 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-e736cfc4-d4fa-4dfc-90c4-f6de5a0f14bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:22.146186 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1076/2174] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 8 02:27:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:27:22.202477 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9d89b-5cb6-40ac-b5dd-57486ecb8042 service cinder] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:22.205316 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-d7d9d89b-5cb6-40ac-b5dd-57486ecb8042 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:22.293944 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9d89b-5cb6-40ac-b5dd-57486ecb8042 service cinder] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:22.299213 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd6ac4-ba51-4995-b076-3794d7ba6be1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c212009b6a44e1bad92769630116408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:22.299916 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd6ac4-ba51-4995-b076-3794d7ba6be1 service swift] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:22.300197 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd6ac4-ba51-4995-b076-3794d7ba6be1 service swift] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:22.300736 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd6ac4-ba51-4995-b076-3794d7ba6be1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:22.310622 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd6ac4-ba51-4995-b076-3794d7ba6be1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:22.312266 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd6ac4-ba51-4995-b076-3794d7ba6be1 service swift] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:22.321349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1099/2175] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 8 02:27:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:27:22.449168 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:23.133166 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:24.051749 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736cfc4-d4fa-4dfc-90c4-f6de5a0f14bd None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:24.068065 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736cfc4-d4fa-4dfc-90c4-f6de5a0f14bd None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:24.072448 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac85edf-ee93-405d-b83e-ff771ff92e2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:24.073198 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac85edf-ee93-405d-b83e-ff771ff92e2c service cinder] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:24.073586 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac85edf-ee93-405d-b83e-ff771ff92e2c service cinder] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:24.074146 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac85edf-ee93-405d-b83e-ff771ff92e2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:24.180992 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac85edf-ee93-405d-b83e-ff771ff92e2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:24.182875 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac85edf-ee93-405d-b83e-ff771ff92e2c service cinder] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:24.212400 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1077/2176] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:27:24 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:27:24.723146 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:25.991780 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:26.471473 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd6ac4-ba51-4995-b076-3794d7ba6be1 service swift] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:26.482823 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd6ac4-ba51-4995-b076-3794d7ba6be1 service swift] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:26.489897 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fea06-4d48-43bf-81b9-39b890428907 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:26.490539 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fea06-4d48-43bf-81b9-39b890428907 service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:26.490826 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fea06-4d48-43bf-81b9-39b890428907 service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:26.491103 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fea06-4d48-43bf-81b9-39b890428907 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:26.503168 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697fea06-4d48-43bf-81b9-39b890428907 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:26.510304 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697fea06-4d48-43bf-81b9-39b890428907 service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:26.519864 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1100/2177] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:27:26 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:27:26.762266 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:28.086910 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:28.940157 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:29.515154 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:29.682502 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:31.226000 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:31.350921 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:31.688219 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac85edf-ee93-405d-b83e-ff771ff92e2c service cinder] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:31.783636 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac85edf-ee93-405d-b83e-ff771ff92e2c service cinder] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:31.789026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b4350-60d4-4fbe-9981-38be3cbb0d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:31.789670 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b4350-60d4-4fbe-9981-38be3cbb0d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:31.789952 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b4350-60d4-4fbe-9981-38be3cbb0d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:31.790230 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b4350-60d4-4fbe-9981-38be3cbb0d1c admin admin] PATH_INFO: `/v3/users/8a24f9c21bc0476eb25f10429365764b` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:31.793680 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72b4350-60d4-4fbe-9981-38be3cbb0d1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a24f9c21bc0476eb25f10429365764b)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:31.795708 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72b4350-60d4-4fbe-9981-38be3cbb0d1c admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:32.003194 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-d72b4350-60d4-4fbe-9981-38be3cbb0d1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a24f9c21bc0476eb25f10429365764b'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:32.082044 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-d72b4350-60d4-4fbe-9981-38be3cbb0d1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a24f9c21bc0476eb25f10429365764b'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:32.082815 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-d72b4350-60d4-4fbe-9981-38be3cbb0d1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a24f9c21bc0476eb25f10429365764b'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:32.083549 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-d72b4350-60d4-4fbe-9981-38be3cbb0d1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a24f9c21bc0476eb25f10429365764b'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:32.099216 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-d72b4350-60d4-4fbe-9981-38be3cbb0d1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a24f9c21bc0476eb25f10429365764b'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:32.113661 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1078/2178] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:27:31 2022] DELETE /identity/v3/users/8a24f9c21bc0476eb25f10429365764b => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:27:32.118537 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b351070-955f-4430-8090-6ce85ee112d4 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:32.118830 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b351070-955f-4430-8090-6ce85ee112d4 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:32.119171 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b351070-955f-4430-8090-6ce85ee112d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:32.141136 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-1b351070-955f-4430-8090-6ce85ee112d4 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:27:32.142984 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-1b351070-955f-4430-8090-6ce85ee112d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:32.234275 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b4350-60d4-4fbe-9981-38be3cbb0d1c admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:32.239836 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-d72b4350-60d4-4fbe-9981-38be3cbb0d1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:32.240000 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1101/2179] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:27:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:27:32.335620 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b4350-60d4-4fbe-9981-38be3cbb0d1c admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:32.341092 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e8779-1363-43bd-988d-23a5e77bea13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:32.342310 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e8779-1363-43bd-988d-23a5e77bea13 service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:32.342609 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e8779-1363-43bd-988d-23a5e77bea13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:32.342887 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e8779-1363-43bd-988d-23a5e77bea13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:32.352924 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e8779-1363-43bd-988d-23a5e77bea13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:32.354482 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e8779-1363-43bd-988d-23a5e77bea13 service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:32.365483 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1079/2180] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:27:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:27:32.408921 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:32.916734 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b351070-955f-4430-8090-6ce85ee112d4 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:32.918323 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-1b351070-955f-4430-8090-6ce85ee112d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:32.931964 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b351070-955f-4430-8090-6ce85ee112d4 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:32.936556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5f8a3-f457-485f-9505-4c7d6093ddcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:32.937254 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5f8a3-f457-485f-9505-4c7d6093ddcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:32.937532 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5f8a3-f457-485f-9505-4c7d6093ddcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:32.937810 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5f8a3-f457-485f-9505-4c7d6093ddcc admin admin] PATH_INFO: `/v3/projects/3f7a1989404246e7b4e00cae7228bd89` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:32.940226 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5f8a3-f457-485f-9505-4c7d6093ddcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f7a1989404246e7b4e00cae7228bd89)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:32.942462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5f8a3-f457-485f-9505-4c7d6093ddcc admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:32.980501 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:33.100434 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-b0e5f8a3-f457-485f-9505-4c7d6093ddcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f7a1989404246e7b4e00cae7228bd89', 'request_id': 'req-b0e5f8a3-f457-485f-9505-4c7d6093ddcc'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:33.107981 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-b0e5f8a3-f457-485f-9505-4c7d6093ddcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f7a1989404246e7b4e00cae7228bd89', 'request_id': 'req-b0e5f8a3-f457-485f-9505-4c7d6093ddcc'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:33.120547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-b0e5f8a3-f457-485f-9505-4c7d6093ddcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f7a1989404246e7b4e00cae7228bd89', 'request_id': 'req-b0e5f8a3-f457-485f-9505-4c7d6093ddcc'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:33.232127 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-b0e5f8a3-f457-485f-9505-4c7d6093ddcc admin admin] The token cache is being invalidate because project 3f7a1989404246e7b4e00cae7228bd89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:27:33.233045 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-b0e5f8a3-f457-485f-9505-4c7d6093ddcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:33.233961 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-b0e5f8a3-f457-485f-9505-4c7d6093ddcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:33.238928 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1102/2181] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:27:32 2022] DELETE /identity/v3/projects/3f7a1989404246e7b4e00cae7228bd89 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:27:33.242619 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e8779-1363-43bd-988d-23a5e77bea13 service neutron] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:33.254239 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e8779-1363-43bd-988d-23a5e77bea13 service neutron] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:33.391515 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca291c1-bfbb-4a33-b75d-f0a68e60c7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:33.392238 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca291c1-bfbb-4a33-b75d-f0a68e60c7a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:33.392716 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca291c1-bfbb-4a33-b75d-f0a68e60c7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:33.393169 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca291c1-bfbb-4a33-b75d-f0a68e60c7a6 admin admin] PATH_INFO: `/v3/users/60c4a59652d14cb2a87566cf10248dcb` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:33.394686 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca291c1-bfbb-4a33-b75d-f0a68e60c7a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60c4a59652d14cb2a87566cf10248dcb)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:33.397533 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca291c1-bfbb-4a33-b75d-f0a68e60c7a6 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:33.647933 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-9ca291c1-bfbb-4a33-b75d-f0a68e60c7a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60c4a59652d14cb2a87566cf10248dcb'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:33.738903 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-9ca291c1-bfbb-4a33-b75d-f0a68e60c7a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60c4a59652d14cb2a87566cf10248dcb'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:33.739706 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-9ca291c1-bfbb-4a33-b75d-f0a68e60c7a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60c4a59652d14cb2a87566cf10248dcb'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:33.740417 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-9ca291c1-bfbb-4a33-b75d-f0a68e60c7a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60c4a59652d14cb2a87566cf10248dcb'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:33.761651 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-9ca291c1-bfbb-4a33-b75d-f0a68e60c7a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60c4a59652d14cb2a87566cf10248dcb'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:33.783632 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1080/2182] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:27:33 2022] DELETE /identity/v3/users/60c4a59652d14cb2a87566cf10248dcb => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:27:34.156811 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:34.277125 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:34.289267 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5f8a3-f457-485f-9505-4c7d6093ddcc admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:34.290829 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-b0e5f8a3-f457-485f-9505-4c7d6093ddcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:34.313344 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5f8a3-f457-485f-9505-4c7d6093ddcc admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:34.451395 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224c48b-1d5b-442f-8273-c51b7910355b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:34.452132 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224c48b-1d5b-442f-8273-c51b7910355b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:34.452410 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224c48b-1d5b-442f-8273-c51b7910355b admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:34.453000 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224c48b-1d5b-442f-8273-c51b7910355b admin admin] PATH_INFO: `/v3/projects/ee7d77bc932f4979bbb5294cc1bc9ac9` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:34.455196 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224c48b-1d5b-442f-8273-c51b7910355b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee7d77bc932f4979bbb5294cc1bc9ac9)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:34.458686 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224c48b-1d5b-442f-8273-c51b7910355b admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:34.646958 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-e224c48b-1d5b-442f-8273-c51b7910355b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee7d77bc932f4979bbb5294cc1bc9ac9', 'request_id': 'req-e224c48b-1d5b-442f-8273-c51b7910355b'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:34.653514 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-e224c48b-1d5b-442f-8273-c51b7910355b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee7d77bc932f4979bbb5294cc1bc9ac9', 'request_id': 'req-e224c48b-1d5b-442f-8273-c51b7910355b'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:34.661192 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-e224c48b-1d5b-442f-8273-c51b7910355b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee7d77bc932f4979bbb5294cc1bc9ac9', 'request_id': 'req-e224c48b-1d5b-442f-8273-c51b7910355b'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:34.750617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-e224c48b-1d5b-442f-8273-c51b7910355b admin admin] The token cache is being invalidate because project ee7d77bc932f4979bbb5294cc1bc9ac9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:27:34.750997 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-e224c48b-1d5b-442f-8273-c51b7910355b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:34.752126 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-e224c48b-1d5b-442f-8273-c51b7910355b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:34.757502 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1103/2183] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:27:34 2022] DELETE /identity/v3/projects/ee7d77bc932f4979bbb5294cc1bc9ac9 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:27:34.760282 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca291c1-bfbb-4a33-b75d-f0a68e60c7a6 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:34.762517 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-9ca291c1-bfbb-4a33-b75d-f0a68e60c7a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:34.777114 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca291c1-bfbb-4a33-b75d-f0a68e60c7a6 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:34.840836 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e157b-90e0-4705-8bf5-5692685cc543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:34.841559 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e157b-90e0-4705-8bf5-5692685cc543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:34.841847 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e157b-90e0-4705-8bf5-5692685cc543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:34.842129 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e157b-90e0-4705-8bf5-5692685cc543 admin admin] PATH_INFO: `/v3/users/274624fb2dc34581a3c439d1f1718ef9` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:34.843275 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e157b-90e0-4705-8bf5-5692685cc543 admin admin] RBAC: Authorizing `identity:delete_user(user_id=274624fb2dc34581a3c439d1f1718ef9)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:34.845301 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e157b-90e0-4705-8bf5-5692685cc543 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:35.137445 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-581e157b-90e0-4705-8bf5-5692685cc543 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '274624fb2dc34581a3c439d1f1718ef9'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:35.243224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:35.244312 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-581e157b-90e0-4705-8bf5-5692685cc543 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '274624fb2dc34581a3c439d1f1718ef9'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:35.245161 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-581e157b-90e0-4705-8bf5-5692685cc543 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '274624fb2dc34581a3c439d1f1718ef9'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:35.246072 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-581e157b-90e0-4705-8bf5-5692685cc543 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '274624fb2dc34581a3c439d1f1718ef9'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:35.256763 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706354cf-36f0-4a59-b662-988981f33cef None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:35.257094 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706354cf-36f0-4a59-b662-988981f33cef None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:35.257888 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706354cf-36f0-4a59-b662-988981f33cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:35.262393 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-581e157b-90e0-4705-8bf5-5692685cc543 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '274624fb2dc34581a3c439d1f1718ef9'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:35.278787 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1081/2184] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:27:34 2022] DELETE /identity/v3/users/274624fb2dc34581a3c439d1f1718ef9 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:27:35.284655 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-706354cf-36f0-4a59-b662-988981f33cef None None] MFA Rules not processed for user `1d39439278814d4faac4cfb1e71aa4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:27:35.285902 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-706354cf-36f0-4a59-b662-988981f33cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:35.416322 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1104/2185] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 8 02:27:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:27:35.434920 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e157b-90e0-4705-8bf5-5692685cc543 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:35.436774 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-581e157b-90e0-4705-8bf5-5692685cc543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:35.539255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e157b-90e0-4705-8bf5-5692685cc543 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:35.546901 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db1fbb-5256-4960-ba84-16070c68aa66 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c212009b6a44e1bad92769630116408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:35.547718 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db1fbb-5256-4960-ba84-16070c68aa66 service swift] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:35.548640 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db1fbb-5256-4960-ba84-16070c68aa66 service swift] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:35.549012 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db1fbb-5256-4960-ba84-16070c68aa66 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:35.564603 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db1fbb-5256-4960-ba84-16070c68aa66 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:35.564603 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db1fbb-5256-4960-ba84-16070c68aa66 service swift] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:35.572228 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1082/2186] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 8 02:27:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:27:35.852465 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706354cf-36f0-4a59-b662-988981f33cef None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:35.854917 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:35.856964 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-706354cf-36f0-4a59-b662-988981f33cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:36.043445 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706354cf-36f0-4a59-b662-988981f33cef None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:36.056421 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aaa668-21e1-4a62-9f5b-611bb18eb43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:36.069395 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aaa668-21e1-4a62-9f5b-611bb18eb43e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:36.069981 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aaa668-21e1-4a62-9f5b-611bb18eb43e admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:36.070451 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aaa668-21e1-4a62-9f5b-611bb18eb43e admin admin] PATH_INFO: `/v3/projects/83dce9b2149643ad96d74ad8af9c0c8e` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:36.075936 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aaa668-21e1-4a62-9f5b-611bb18eb43e admin admin] RBAC: Authorizing `identity:delete_project(project_id=83dce9b2149643ad96d74ad8af9c0c8e)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:36.078177 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aaa668-21e1-4a62-9f5b-611bb18eb43e admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:36.332783 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c6aaa668-21e1-4a62-9f5b-611bb18eb43e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83dce9b2149643ad96d74ad8af9c0c8e', 'request_id': 'req-c6aaa668-21e1-4a62-9f5b-611bb18eb43e'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:36.349339 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c6aaa668-21e1-4a62-9f5b-611bb18eb43e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83dce9b2149643ad96d74ad8af9c0c8e', 'request_id': 'req-c6aaa668-21e1-4a62-9f5b-611bb18eb43e'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:36.361211 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c6aaa668-21e1-4a62-9f5b-611bb18eb43e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83dce9b2149643ad96d74ad8af9c0c8e', 'request_id': 'req-c6aaa668-21e1-4a62-9f5b-611bb18eb43e'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:36.453818 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:36.584502 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c6aaa668-21e1-4a62-9f5b-611bb18eb43e admin admin] The token cache is being invalidate because project 83dce9b2149643ad96d74ad8af9c0c8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:27:36.585043 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c6aaa668-21e1-4a62-9f5b-611bb18eb43e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:36.586262 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c6aaa668-21e1-4a62-9f5b-611bb18eb43e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:36.588062 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1105/2187] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:27:35 2022] DELETE /identity/v3/projects/83dce9b2149643ad96d74ad8af9c0c8e => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:27:37.453920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:38.082843 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:38.455002 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:38.899778 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:39.288124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:39.911267 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:40.356395 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:40.790716 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:41.053957 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:41.163383 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:41.682489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:41.797437 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:42.099550 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:42.197268 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:42.242591 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:42.448217 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:42.991900 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:43.191066 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:43.367833 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:43.745117 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=11 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:43.904343 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:44.276967 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:44.305328 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:44.488358 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:44.516403 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:44.647426 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:44.705542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:44.727584 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:44.778987 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:44.887970 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:46.787846 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d53c7f-36bb-4629-8719-c9f1cb578d1a None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:46.788424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d53c7f-36bb-4629-8719-c9f1cb578d1a None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:46.788424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d53c7f-36bb-4629-8719-c9f1cb578d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:46.807906 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-66d53c7f-36bb-4629-8719-c9f1cb578d1a None None] MFA Rules not processed for user `1d39439278814d4faac4cfb1e71aa4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:27:46.809101 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-66d53c7f-36bb-4629-8719-c9f1cb578d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:46.829014 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:46.863831 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1083/2188] 10.222.0.23 () {58 vars in 967 bytes} [Mon Aug 8 02:27:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:27:46.879968 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aaa668-21e1-4a62-9f5b-611bb18eb43e admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:46.879968 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-c6aaa668-21e1-4a62-9f5b-611bb18eb43e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:46.940208 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:46.965269 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aaa668-21e1-4a62-9f5b-611bb18eb43e admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:46.971964 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4864a-1c95-4672-b2cf-3877e4ca6605 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c212009b6a44e1bad92769630116408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:46.972707 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4864a-1c95-4672-b2cf-3877e4ca6605 service swift] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:46.973091 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4864a-1c95-4672-b2cf-3877e4ca6605 service swift] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:46.973503 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4864a-1c95-4672-b2cf-3877e4ca6605 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:46.983745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4864a-1c95-4672-b2cf-3877e4ca6605 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:46.985563 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4864a-1c95-4672-b2cf-3877e4ca6605 service swift] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:46.994759 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1106/2189] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 8 02:27:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 08 02:27:50.889104 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d53c7f-36bb-4629-8719-c9f1cb578d1a None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:50.890759 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-66d53c7f-36bb-4629-8719-c9f1cb578d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:50.967327 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d53c7f-36bb-4629-8719-c9f1cb578d1a None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:50.974211 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc61db-91a7-4ba0-8c85-cfcb42c37c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:50.974968 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc61db-91a7-4ba0-8c85-cfcb42c37c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:50.975432 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc61db-91a7-4ba0-8c85-cfcb42c37c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:50.975716 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc61db-91a7-4ba0-8c85-cfcb42c37c32 admin admin] PATH_INFO: `/v3/users/1cc1e75117a247718ee6976b92c52ef9` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:50.976905 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc61db-91a7-4ba0-8c85-cfcb42c37c32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cc1e75117a247718ee6976b92c52ef9)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:50.978820 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc61db-91a7-4ba0-8c85-cfcb42c37c32 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:51.195817 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-facc61db-91a7-4ba0-8c85-cfcb42c37c32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cc1e75117a247718ee6976b92c52ef9'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:51.338683 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-facc61db-91a7-4ba0-8c85-cfcb42c37c32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cc1e75117a247718ee6976b92c52ef9'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:51.339208 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-facc61db-91a7-4ba0-8c85-cfcb42c37c32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cc1e75117a247718ee6976b92c52ef9'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:51.339848 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-facc61db-91a7-4ba0-8c85-cfcb42c37c32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cc1e75117a247718ee6976b92c52ef9'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:51.353092 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-facc61db-91a7-4ba0-8c85-cfcb42c37c32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cc1e75117a247718ee6976b92c52ef9'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:51.366765 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1084/2190] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:27:50 2022] DELETE /identity/v3/users/1cc1e75117a247718ee6976b92c52ef9 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:27:51.683498 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4864a-1c95-4672-b2cf-3877e4ca6605 service swift] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:51.694642 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4864a-1c95-4672-b2cf-3877e4ca6605 service swift] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:51.755488 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3085591-c888-4fdc-8fce-0b2e8be0652a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:51.756114 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3085591-c888-4fdc-8fce-0b2e8be0652a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:51.756398 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3085591-c888-4fdc-8fce-0b2e8be0652a admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:51.756676 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3085591-c888-4fdc-8fce-0b2e8be0652a admin admin] PATH_INFO: `/v3/projects/1cdb819d4ee14cf5b88da385f4a74fda` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:51.757791 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3085591-c888-4fdc-8fce-0b2e8be0652a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cdb819d4ee14cf5b88da385f4a74fda)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:51.759732 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3085591-c888-4fdc-8fce-0b2e8be0652a admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:51.928342 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-b3085591-c888-4fdc-8fce-0b2e8be0652a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cdb819d4ee14cf5b88da385f4a74fda', 'request_id': 'req-b3085591-c888-4fdc-8fce-0b2e8be0652a'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:51.934404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-b3085591-c888-4fdc-8fce-0b2e8be0652a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cdb819d4ee14cf5b88da385f4a74fda', 'request_id': 'req-b3085591-c888-4fdc-8fce-0b2e8be0652a'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:51.943339 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-b3085591-c888-4fdc-8fce-0b2e8be0652a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cdb819d4ee14cf5b88da385f4a74fda', 'request_id': 'req-b3085591-c888-4fdc-8fce-0b2e8be0652a'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:52.064690 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-b3085591-c888-4fdc-8fce-0b2e8be0652a admin admin] The token cache is being invalidate because project 1cdb819d4ee14cf5b88da385f4a74fda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:27:52.065193 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-b3085591-c888-4fdc-8fce-0b2e8be0652a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:52.065985 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-b3085591-c888-4fdc-8fce-0b2e8be0652a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:27:52.068139 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1107/2191] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:27:51 2022] DELETE /identity/v3/projects/1cdb819d4ee14cf5b88da385f4a74fda => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:27:52.073985 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e33ec-9667-4cad-aa0e-5bb56d889d3c None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:52.074466 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e33ec-9667-4cad-aa0e-5bb56d889d3c None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:52.074576 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e33ec-9667-4cad-aa0e-5bb56d889d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:52.096547 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-9d0e33ec-9667-4cad-aa0e-5bb56d889d3c None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:27:52.097939 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-9d0e33ec-9667-4cad-aa0e-5bb56d889d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:52.166892 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:52.191516 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1085/2192] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:27:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:27:52.192747 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e35a4-38f8-411a-81b3-ee1a40dae24c None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:52.193036 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e35a4-38f8-411a-81b3-ee1a40dae24c None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:52.193310 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e35a4-38f8-411a-81b3-ee1a40dae24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:52.214626 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-cf1e35a4-38f8-411a-81b3-ee1a40dae24c None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:27:52.215873 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-cf1e35a4-38f8-411a-81b3-ee1a40dae24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:52.223885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1108/2193] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:27:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:27:52.228321 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e33ec-9667-4cad-aa0e-5bb56d889d3c None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:52.238530 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e33ec-9667-4cad-aa0e-5bb56d889d3c None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:52.243383 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16244235-b75a-4e6e-9929-a5522316ea53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:52.244089 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16244235-b75a-4e6e-9929-a5522316ea53 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:52.244451 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16244235-b75a-4e6e-9929-a5522316ea53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:52.244790 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16244235-b75a-4e6e-9929-a5522316ea53 admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:52.245508 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16244235-b75a-4e6e-9929-a5522316ea53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:27:52.245950 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16244235-b75a-4e6e-9929-a5522316ea53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:52.247651 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16244235-b75a-4e6e-9929-a5522316ea53 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:52.262730 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1086/2194] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:27:52.269540 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e35a4-38f8-411a-81b3-ee1a40dae24c None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:52.279653 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e35a4-38f8-411a-81b3-ee1a40dae24c None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:52.284247 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0453a-cb6e-45b0-bbad-6bf680e694b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:52.284836 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0453a-cb6e-45b0-bbad-6bf680e694b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:52.285142 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0453a-cb6e-45b0-bbad-6bf680e694b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:52.285609 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0453a-cb6e-45b0-bbad-6bf680e694b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:52.286241 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d0453a-cb6e-45b0-bbad-6bf680e694b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:52.288148 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d0453a-cb6e-45b0-bbad-6bf680e694b2 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:52.403557 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1109/2195] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:27:52 2022] POST /identity/v3/projects => generated 369 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:27:52.408062 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16244235-b75a-4e6e-9929-a5522316ea53 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:52.417948 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16244235-b75a-4e6e-9929-a5522316ea53 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:52.473016 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ee7f1-5b7b-48a1-95e4-6bade16a6791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:52.473614 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ee7f1-5b7b-48a1-95e4-6bade16a6791 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:52.473897 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ee7f1-5b7b-48a1-95e4-6bade16a6791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:52.474173 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ee7f1-5b7b-48a1-95e4-6bade16a6791 admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:52.474836 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ee7f1-5b7b-48a1-95e4-6bade16a6791 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:52.476781 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ee7f1-5b7b-48a1-95e4-6bade16a6791 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:52.561883 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1087/2196] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:27:52 2022] POST /identity/v3/users => generated 285 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:27:52.566644 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0453a-cb6e-45b0-bbad-6bf680e694b2 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:52.577358 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0453a-cb6e-45b0-bbad-6bf680e694b2 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:52.582394 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0148f-aa53-4b06-9fb3-d1ce96a905d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:52.582997 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0148f-aa53-4b06-9fb3-d1ce96a905d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:52.583281 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0148f-aa53-4b06-9fb3-d1ce96a905d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:52.583587 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0148f-aa53-4b06-9fb3-d1ce96a905d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:52.584235 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0148f-aa53-4b06-9fb3-d1ce96a905d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:52.585824 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0148f-aa53-4b06-9fb3-d1ce96a905d8 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:52.596385 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1110/2197] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:27:52.600433 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ee7f1-5b7b-48a1-95e4-6bade16a6791 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:52.610215 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ee7f1-5b7b-48a1-95e4-6bade16a6791 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:52.615329 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e32096-946a-4fc7-ab38-fe435e3a2100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:52.615938 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e32096-946a-4fc7-ab38-fe435e3a2100 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:52.616219 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e32096-946a-4fc7-ab38-fe435e3a2100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:52.616495 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e32096-946a-4fc7-ab38-fe435e3a2100 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:52.617189 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e32096-946a-4fc7-ab38-fe435e3a2100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:52.618753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e32096-946a-4fc7-ab38-fe435e3a2100 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:52.630417 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1088/2198] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:27:52.634559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0148f-aa53-4b06-9fb3-d1ce96a905d8 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:52.644666 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0148f-aa53-4b06-9fb3-d1ce96a905d8 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:52.649813 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2dfc44-e30f-451e-9300-d32ab4ced5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:52.650784 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2dfc44-e30f-451e-9300-d32ab4ced5b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:52.651077 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2dfc44-e30f-451e-9300-d32ab4ced5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:52.651433 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2dfc44-e30f-451e-9300-d32ab4ced5b4 admin admin] PATH_INFO: `/v3/projects/fabb8d13211d4683805c92235119c96a/users/0334738b4c69496eb27de1725a24344c/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:52.667739 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2dfc44-e30f-451e-9300-d32ab4ced5b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fabb8d13211d4683805c92235119c96a, user_id=0334738b4c69496eb27de1725a24344c, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:52.670466 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2dfc44-e30f-451e-9300-d32ab4ced5b4 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:52.744299 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1111/2199] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:27:52 2022] PUT /identity/v3/projects/fabb8d13211d4683805c92235119c96a/users/0334738b4c69496eb27de1725a24344c/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:27:52.757277 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420dd2e1-fbde-46ad-9e94-eec1e648ce34 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:52.757544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420dd2e1-fbde-46ad-9e94-eec1e648ce34 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:52.757832 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420dd2e1-fbde-46ad-9e94-eec1e648ce34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:52.785840 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-420dd2e1-fbde-46ad-9e94-eec1e648ce34 None None] MFA Rules not processed for user `0334738b4c69496eb27de1725a24344c`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:27:52.787047 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-420dd2e1-fbde-46ad-9e94-eec1e648ce34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:52.852503 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1089/2200] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:27:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:27:52.864703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2dfc44-e30f-451e-9300-d32ab4ced5b4 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:52.866428 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-0d2dfc44-e30f-451e-9300-d32ab4ced5b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:52.876630 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:52.924051 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2dfc44-e30f-451e-9300-d32ab4ced5b4 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:52.927906 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc82f5-6b0d-4dd6-8404-b592dac48085 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aae574170d6f4eb8ab70805d8b5f4f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:52.928514 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc82f5-6b0d-4dd6-8404-b592dac48085 service glance] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:52.928797 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc82f5-6b0d-4dd6-8404-b592dac48085 service glance] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:52.929072 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc82f5-6b0d-4dd6-8404-b592dac48085 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:52.937488 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc82f5-6b0d-4dd6-8404-b592dac48085 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:52.940676 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc82f5-6b0d-4dd6-8404-b592dac48085 service glance] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:52.947885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1112/2201] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:27:52 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:27:53.823964 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43748653-d621-4c74-832d-4a2230be2ca0 None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:53.823964 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43748653-d621-4c74-832d-4a2230be2ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:53.823964 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43748653-d621-4c74-832d-4a2230be2ca0 None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:53.823964 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1090/2202] 10.222.0.23 () {54 vars in 921 bytes} [Mon Aug 8 02:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:27:53.825033 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b62ed-fb2d-4854-8c38-493840750193 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:53.825033 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b62ed-fb2d-4854-8c38-493840750193 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:53.825033 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b62ed-fb2d-4854-8c38-493840750193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:53.825033 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-b22b62ed-fb2d-4854-8c38-493840750193 None None] MFA Rules not processed for user `5d89e0c7d62444e4b75d3f4da49b2bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:27:53.825033 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-b22b62ed-fb2d-4854-8c38-493840750193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:53.893965 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1113/2203] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Aug 8 02:27:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:27:53.906217 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43748653-d621-4c74-832d-4a2230be2ca0 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:53.907389 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-43748653-d621-4c74-832d-4a2230be2ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:53.920429 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43748653-d621-4c74-832d-4a2230be2ca0 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:53.924688 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7f5ca-5256-4f2e-829b-786fb3f3b6ab service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aae574170d6f4eb8ab70805d8b5f4f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:53.925281 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7f5ca-5256-4f2e-829b-786fb3f3b6ab service glance] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:53.925564 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7f5ca-5256-4f2e-829b-786fb3f3b6ab service glance] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:53.925840 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7f5ca-5256-4f2e-829b-786fb3f3b6ab service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:53.936287 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd7f5ca-5256-4f2e-829b-786fb3f3b6ab service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:53.937707 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd7f5ca-5256-4f2e-829b-786fb3f3b6ab service glance] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:53.949080 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1091/2204] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:27:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:27:54.214785 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13824ec-2012-4541-93e8-c97c180f661a None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:54.215180 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13824ec-2012-4541-93e8-c97c180f661a None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:54.215511 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13824ec-2012-4541-93e8-c97c180f661a None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:54.216893 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1114/2205] 10.222.0.23 () {54 vars in 921 bytes} [Mon Aug 8 02:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:27:54.222130 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbecf8a-0c09-4742-8172-29a3a47bb0d8 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:54.222417 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbecf8a-0c09-4742-8172-29a3a47bb0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:54.222696 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbecf8a-0c09-4742-8172-29a3a47bb0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:54.242662 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-3bbecf8a-0c09-4742-8172-29a3a47bb0d8 None None] MFA Rules not processed for user `fa4c5732acb844369140e8d970577f94`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:27:54.243901 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-3bbecf8a-0c09-4742-8172-29a3a47bb0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:54.271971 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:54.293473 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1092/2206] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Aug 8 02:27:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:27:54.305699 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13824ec-2012-4541-93e8-c97c180f661a None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:54.307470 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-f13824ec-2012-4541-93e8-c97c180f661a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:54.320440 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13824ec-2012-4541-93e8-c97c180f661a None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:54.323912 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1e991-aa1a-4ed6-93a7-acc4d1949052 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:54.324501 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1e991-aa1a-4ed6-93a7-acc4d1949052 service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:54.324782 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1e991-aa1a-4ed6-93a7-acc4d1949052 service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:54.325057 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1e991-aa1a-4ed6-93a7-acc4d1949052 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:54.332773 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1e991-aa1a-4ed6-93a7-acc4d1949052 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:54.334207 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1e991-aa1a-4ed6-93a7-acc4d1949052 service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:54.342898 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1115/2207] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:27:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:27:54.427520 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65760165-680c-42a4-ad3a-e595bc16904b None None] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:54.427815 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65760165-680c-42a4-ad3a-e595bc16904b None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:54.428124 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65760165-680c-42a4-ad3a-e595bc16904b None None] PATH_INFO: `/` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:54.429494 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1093/2208] 10.222.0.23 () {54 vars in 921 bytes} [Mon Aug 8 02:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:27:54.434367 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5679c-5ea5-4527-97c6-a6fd2f97f2f0 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:54.435312 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5679c-5ea5-4527-97c6-a6fd2f97f2f0 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:54.435312 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5679c-5ea5-4527-97c6-a6fd2f97f2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:54.456204 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-1ce5679c-5ea5-4527-97c6-a6fd2f97f2f0 None None] MFA Rules not processed for user `5d89e0c7d62444e4b75d3f4da49b2bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:27:54.457661 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-1ce5679c-5ea5-4527-97c6-a6fd2f97f2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:54.467015 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1116/2209] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Aug 8 02:27:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:27:54.477385 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65760165-680c-42a4-ad3a-e595bc16904b None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:54.491256 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65760165-680c-42a4-ad3a-e595bc16904b None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:54.498598 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e6bd4-e7cf-44e0-98b4-3da48f9fefa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:54.498598 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e6bd4-e7cf-44e0-98b4-3da48f9fefa7 service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:54.498598 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e6bd4-e7cf-44e0-98b4-3da48f9fefa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:54.498598 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e6bd4-e7cf-44e0-98b4-3da48f9fefa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:54.508105 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e6bd4-e7cf-44e0-98b4-3da48f9fefa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:54.509523 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e6bd4-e7cf-44e0-98b4-3da48f9fefa7 service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:54.520253 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1094/2210] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:27:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:27:58.578371 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bad63-d775-47fa-8456-1104fba0c520 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:58.578864 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bad63-d775-47fa-8456-1104fba0c520 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:58.578955 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bad63-d775-47fa-8456-1104fba0c520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:58.598849 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-565bad63-d775-47fa-8456-1104fba0c520 None None] MFA Rules not processed for user `1d39439278814d4faac4cfb1e71aa4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:27:58.600061 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-565bad63-d775-47fa-8456-1104fba0c520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:58.657820 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1117/2211] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 8 02:27:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:27:58.670449 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e6bd4-e7cf-44e0-98b4-3da48f9fefa7 service neutron] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:27:58.672037 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-691e6bd4-e7cf-44e0-98b4-3da48f9fefa7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:27:58.750687 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e6bd4-e7cf-44e0-98b4-3da48f9fefa7 service neutron] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:27:58.758963 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b657b0-e18d-49b8-81ee-0505c589b49b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c212009b6a44e1bad92769630116408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:27:58.758963 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b657b0-e18d-49b8-81ee-0505c589b49b service swift] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:27:58.758963 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b657b0-e18d-49b8-81ee-0505c589b49b service swift] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:27:58.758963 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b657b0-e18d-49b8-81ee-0505c589b49b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:27:58.768110 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b657b0-e18d-49b8-81ee-0505c589b49b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:27:58.769745 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b657b0-e18d-49b8-81ee-0505c589b49b service swift] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:27:58.778198 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1095/2212] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 8 02:27:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:28:02.286893 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565bad63-d775-47fa-8456-1104fba0c520 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:02.288421 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-565bad63-d775-47fa-8456-1104fba0c520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:02.326551 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:02.367563 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565bad63-d775-47fa-8456-1104fba0c520 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:02.372662 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2869d-a10d-4cd4-b4ff-2ab5c97b2c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:02.373301 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2869d-a10d-4cd4-b4ff-2ab5c97b2c40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:02.373582 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2869d-a10d-4cd4-b4ff-2ab5c97b2c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:02.373862 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2869d-a10d-4cd4-b4ff-2ab5c97b2c40 admin admin] PATH_INFO: `/v3/users/559e25d50bb74268aaac2e8c85bf139a` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:02.375032 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2869d-a10d-4cd4-b4ff-2ab5c97b2c40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=559e25d50bb74268aaac2e8c85bf139a)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:02.377521 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2869d-a10d-4cd4-b4ff-2ab5c97b2c40 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:02.687025 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-dad2869d-a10d-4cd4-b4ff-2ab5c97b2c40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '559e25d50bb74268aaac2e8c85bf139a'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:02.773137 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-dad2869d-a10d-4cd4-b4ff-2ab5c97b2c40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '559e25d50bb74268aaac2e8c85bf139a'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:02.774010 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-dad2869d-a10d-4cd4-b4ff-2ab5c97b2c40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '559e25d50bb74268aaac2e8c85bf139a'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:02.788493 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-dad2869d-a10d-4cd4-b4ff-2ab5c97b2c40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '559e25d50bb74268aaac2e8c85bf139a'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:02.796053 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-dad2869d-a10d-4cd4-b4ff-2ab5c97b2c40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '559e25d50bb74268aaac2e8c85bf139a'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:02.805805 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1118/2213] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:28:02 2022] DELETE /identity/v3/users/559e25d50bb74268aaac2e8c85bf139a => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:02.807285 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776612d-ca98-42de-88c6-dd9ba2fda3a9 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:02.807805 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776612d-ca98-42de-88c6-dd9ba2fda3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:02.807902 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776612d-ca98-42de-88c6-dd9ba2fda3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:02.833057 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-c776612d-ca98-42de-88c6-dd9ba2fda3a9 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:02.834604 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-c776612d-ca98-42de-88c6-dd9ba2fda3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:02.923535 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1096/2214] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:28:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:28:02.930858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2869d-a10d-4cd4-b4ff-2ab5c97b2c40 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:02.932314 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-dad2869d-a10d-4cd4-b4ff-2ab5c97b2c40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:02.998389 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2869d-a10d-4cd4-b4ff-2ab5c97b2c40 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:03.002925 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57cea71-930c-45f9-a1bd-3647b62178fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:03.005758 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57cea71-930c-45f9-a1bd-3647b62178fe service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:03.006045 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57cea71-930c-45f9-a1bd-3647b62178fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:03.006321 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57cea71-930c-45f9-a1bd-3647b62178fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:03.017132 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57cea71-930c-45f9-a1bd-3647b62178fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:03.018839 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57cea71-930c-45f9-a1bd-3647b62178fe service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:03.030088 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1119/2215] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:28:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:28:03.532105 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776612d-ca98-42de-88c6-dd9ba2fda3a9 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:03.532327 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-c776612d-ca98-42de-88c6-dd9ba2fda3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:03.548998 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776612d-ca98-42de-88c6-dd9ba2fda3a9 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:03.572787 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf1c0a-a734-4730-9054-20a5bc6214a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:03.572787 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf1c0a-a734-4730-9054-20a5bc6214a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:03.572787 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf1c0a-a734-4730-9054-20a5bc6214a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:03.572787 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf1c0a-a734-4730-9054-20a5bc6214a6 admin admin] PATH_INFO: `/v3/projects/eea5a6f74e624e8b9c83477ac64d351d` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:03.573476 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf1c0a-a734-4730-9054-20a5bc6214a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eea5a6f74e624e8b9c83477ac64d351d)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:03.573476 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf1c0a-a734-4730-9054-20a5bc6214a6 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:03.713265 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-f5cf1c0a-a734-4730-9054-20a5bc6214a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eea5a6f74e624e8b9c83477ac64d351d', 'request_id': 'req-f5cf1c0a-a734-4730-9054-20a5bc6214a6'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:03.723116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:03.726243 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-f5cf1c0a-a734-4730-9054-20a5bc6214a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eea5a6f74e624e8b9c83477ac64d351d', 'request_id': 'req-f5cf1c0a-a734-4730-9054-20a5bc6214a6'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:03.745814 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-f5cf1c0a-a734-4730-9054-20a5bc6214a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eea5a6f74e624e8b9c83477ac64d351d', 'request_id': 'req-f5cf1c0a-a734-4730-9054-20a5bc6214a6'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:03.861583 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-f5cf1c0a-a734-4730-9054-20a5bc6214a6 admin admin] The token cache is being invalidate because project eea5a6f74e624e8b9c83477ac64d351d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:28:03.863176 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-f5cf1c0a-a734-4730-9054-20a5bc6214a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:03.863176 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-f5cf1c0a-a734-4730-9054-20a5bc6214a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:03.865316 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1097/2216] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:28:03 2022] DELETE /identity/v3/projects/eea5a6f74e624e8b9c83477ac64d351d => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:12.769543 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57cea71-930c-45f9-a1bd-3647b62178fe service neutron] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:12.770960 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-a57cea71-930c-45f9-a1bd-3647b62178fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:12.840884 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:12.863640 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57cea71-930c-45f9-a1bd-3647b62178fe service neutron] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:12.999630 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d9885-0e4d-4918-b426-da3775f64052 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43a39dd539974180a8165e34de57b552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:12.999630 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d9885-0e4d-4918-b426-da3775f64052 service placement] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:12.999630 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d9885-0e4d-4918-b426-da3775f64052 service placement] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:12.999630 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d9885-0e4d-4918-b426-da3775f64052 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:13.000479 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-db7d9885-0e4d-4918-b426-da3775f64052 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:13.000479 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d9885-0e4d-4918-b426-da3775f64052 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:13.000479 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d9885-0e4d-4918-b426-da3775f64052 service placement] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:13.000479 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1120/2217] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:28:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:28:13.921456 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:DELETE=2,keystone:SELECT=5,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:15.713899 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3a2c5-75af-46ae-8c4d-e4ce64da57f7 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:15.715112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3a2c5-75af-46ae-8c4d-e4ce64da57f7 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:15.715289 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3a2c5-75af-46ae-8c4d-e4ce64da57f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:15.735642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-dcd3a2c5-75af-46ae-8c4d-e4ce64da57f7 None None] MFA Rules not processed for user `1d39439278814d4faac4cfb1e71aa4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:15.736868 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-dcd3a2c5-75af-46ae-8c4d-e4ce64da57f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:15.815533 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1098/2218] 10.222.0.23 () {58 vars in 967 bytes} [Mon Aug 8 02:28:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:28:15.827036 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d9885-0e4d-4918-b426-da3775f64052 service placement] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:15.829201 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-db7d9885-0e4d-4918-b426-da3775f64052 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:15.918703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d9885-0e4d-4918-b426-da3775f64052 service placement] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:15.927463 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8088791-5c4e-4976-abc6-fb92c9af2352 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c212009b6a44e1bad92769630116408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:15.928191 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8088791-5c4e-4976-abc6-fb92c9af2352 service swift] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:15.928595 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8088791-5c4e-4976-abc6-fb92c9af2352 service swift] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:15.928983 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8088791-5c4e-4976-abc6-fb92c9af2352 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:15.940963 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8088791-5c4e-4976-abc6-fb92c9af2352 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:15.942730 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8088791-5c4e-4976-abc6-fb92c9af2352 service swift] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:15.953382 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1121/2219] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 8 02:28:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 08 02:28:22.534327 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3a2c5-75af-46ae-8c4d-e4ce64da57f7 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:22.535947 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-dcd3a2c5-75af-46ae-8c4d-e4ce64da57f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:22.599955 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3a2c5-75af-46ae-8c4d-e4ce64da57f7 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:22.604592 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5555bea-a7ca-4ba2-bdab-fa36e4ee4081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:22.605222 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5555bea-a7ca-4ba2-bdab-fa36e4ee4081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:22.605507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5555bea-a7ca-4ba2-bdab-fa36e4ee4081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:22.605786 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5555bea-a7ca-4ba2-bdab-fa36e4ee4081 admin admin] PATH_INFO: `/v3/users/0334738b4c69496eb27de1725a24344c` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:22.606945 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5555bea-a7ca-4ba2-bdab-fa36e4ee4081 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0334738b4c69496eb27de1725a24344c)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:22.608907 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5555bea-a7ca-4ba2-bdab-fa36e4ee4081 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:22.792407 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-d5555bea-a7ca-4ba2-bdab-fa36e4ee4081 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0334738b4c69496eb27de1725a24344c'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:22.875244 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-d5555bea-a7ca-4ba2-bdab-fa36e4ee4081 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0334738b4c69496eb27de1725a24344c'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:22.876408 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-d5555bea-a7ca-4ba2-bdab-fa36e4ee4081 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0334738b4c69496eb27de1725a24344c'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:22.877009 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-d5555bea-a7ca-4ba2-bdab-fa36e4ee4081 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0334738b4c69496eb27de1725a24344c'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:22.889453 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-d5555bea-a7ca-4ba2-bdab-fa36e4ee4081 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0334738b4c69496eb27de1725a24344c'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:22.902118 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1099/2220] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:28:22 2022] DELETE /identity/v3/users/0334738b4c69496eb27de1725a24344c => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:22.906573 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d711cf-7b2d-4157-84d3-b3b0d1e11b50 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:22.907076 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d711cf-7b2d-4157-84d3-b3b0d1e11b50 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:22.907177 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d711cf-7b2d-4157-84d3-b3b0d1e11b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:22.925562 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-81d711cf-7b2d-4157-84d3-b3b0d1e11b50 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:22.926891 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-81d711cf-7b2d-4157-84d3-b3b0d1e11b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:22.984834 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1122/2221] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:28:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:28:22.995013 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5555bea-a7ca-4ba2-bdab-fa36e4ee4081 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:22.996452 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-d5555bea-a7ca-4ba2-bdab-fa36e4ee4081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:23.024166 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:23.053188 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5555bea-a7ca-4ba2-bdab-fa36e4ee4081 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:23.056799 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f14cf5-a64a-4c51-9c0b-157d987c9cb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:23.057414 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f14cf5-a64a-4c51-9c0b-157d987c9cb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:23.057900 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f14cf5-a64a-4c51-9c0b-157d987c9cb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:23.058424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f14cf5-a64a-4c51-9c0b-157d987c9cb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:23.067859 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f14cf5-a64a-4c51-9c0b-157d987c9cb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:23.069333 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f14cf5-a64a-4c51-9c0b-157d987c9cb9 service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:23.080084 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1100/2222] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:28:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:28:23.889400 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d711cf-7b2d-4157-84d3-b3b0d1e11b50 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:23.896555 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-81d711cf-7b2d-4157-84d3-b3b0d1e11b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:23.918042 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d711cf-7b2d-4157-84d3-b3b0d1e11b50 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:23.923481 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55a60b-bc86-40d9-9283-6a54e42fadb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:23.924428 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55a60b-bc86-40d9-9283-6a54e42fadb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:23.924775 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55a60b-bc86-40d9-9283-6a54e42fadb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:23.925144 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55a60b-bc86-40d9-9283-6a54e42fadb9 admin admin] PATH_INFO: `/v3/projects/fabb8d13211d4683805c92235119c96a` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:23.926674 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab55a60b-bc86-40d9-9283-6a54e42fadb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fabb8d13211d4683805c92235119c96a)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:23.928955 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab55a60b-bc86-40d9-9283-6a54e42fadb9 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:23.936552 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:24.065992 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-ab55a60b-bc86-40d9-9283-6a54e42fadb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fabb8d13211d4683805c92235119c96a', 'request_id': 'req-ab55a60b-bc86-40d9-9283-6a54e42fadb9'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:24.071503 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-ab55a60b-bc86-40d9-9283-6a54e42fadb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fabb8d13211d4683805c92235119c96a', 'request_id': 'req-ab55a60b-bc86-40d9-9283-6a54e42fadb9'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:24.078145 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-ab55a60b-bc86-40d9-9283-6a54e42fadb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fabb8d13211d4683805c92235119c96a', 'request_id': 'req-ab55a60b-bc86-40d9-9283-6a54e42fadb9'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:24.197985 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-ab55a60b-bc86-40d9-9283-6a54e42fadb9 admin admin] The token cache is being invalidate because project fabb8d13211d4683805c92235119c96a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:28:24.207279 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-ab55a60b-bc86-40d9-9283-6a54e42fadb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:24.207279 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-ab55a60b-bc86-40d9-9283-6a54e42fadb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:24.207279 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1123/2223] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:28:23 2022] DELETE /identity/v3/projects/fabb8d13211d4683805c92235119c96a => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:24.209759 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d2602-0458-4630-9ec6-8941c4a825fd None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:24.210831 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d2602-0458-4630-9ec6-8941c4a825fd None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:24.211465 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d2602-0458-4630-9ec6-8941c4a825fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:24.233796 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-4f4d2602-0458-4630-9ec6-8941c4a825fd None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:24.235832 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-4f4d2602-0458-4630-9ec6-8941c4a825fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:24.344501 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baacc086-5670-45cf-be53-ded56b747f98 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:24.344801 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baacc086-5670-45cf-be53-ded56b747f98 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:24.345092 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baacc086-5670-45cf-be53-ded56b747f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:24.354269 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1101/2224] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:28:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:28:24.368637 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-baacc086-5670-45cf-be53-ded56b747f98 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:24.370011 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-baacc086-5670-45cf-be53-ded56b747f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:24.380214 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1124/2225] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:28:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:28:24.385111 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d2602-0458-4630-9ec6-8941c4a825fd None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:24.398554 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d2602-0458-4630-9ec6-8941c4a825fd None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:24.404247 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62906814-b885-492d-990b-2dc2740a67db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:24.405013 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62906814-b885-492d-990b-2dc2740a67db admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:24.405297 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62906814-b885-492d-990b-2dc2740a67db admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:24.405572 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62906814-b885-492d-990b-2dc2740a67db admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:24.406304 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62906814-b885-492d-990b-2dc2740a67db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:28:24.406688 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62906814-b885-492d-990b-2dc2740a67db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:24.408436 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62906814-b885-492d-990b-2dc2740a67db admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:24.422546 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1102/2226] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:28:24.427086 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baacc086-5670-45cf-be53-ded56b747f98 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:24.437933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baacc086-5670-45cf-be53-ded56b747f98 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:24.443654 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d37020-e865-4d72-a456-27272b57b65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:24.444494 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d37020-e865-4d72-a456-27272b57b65f admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:24.445025 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d37020-e865-4d72-a456-27272b57b65f admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:24.445169 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d37020-e865-4d72-a456-27272b57b65f admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:24.445902 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d37020-e865-4d72-a456-27272b57b65f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:24.448117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d37020-e865-4d72-a456-27272b57b65f admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:24.589859 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1125/2227] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:28:24 2022] POST /identity/v3/projects => generated 381 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:28:24.591052 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62906814-b885-492d-990b-2dc2740a67db admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:24.601894 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62906814-b885-492d-990b-2dc2740a67db admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:24.663741 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3790472d-cf93-44aa-a143-cb77ab5df549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:24.664343 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790472d-cf93-44aa-a143-cb77ab5df549 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:24.664640 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790472d-cf93-44aa-a143-cb77ab5df549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:24.664896 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790472d-cf93-44aa-a143-cb77ab5df549 admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:24.665543 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3790472d-cf93-44aa-a143-cb77ab5df549 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:24.667456 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3790472d-cf93-44aa-a143-cb77ab5df549 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:24.783172 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1103/2228] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:28:24 2022] POST /identity/v3/users => generated 291 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:28:24.784851 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d37020-e865-4d72-a456-27272b57b65f admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:24.796843 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d37020-e865-4d72-a456-27272b57b65f admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:24.802801 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f0ae3-bceb-4460-81f5-d04e5ac04a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:24.803581 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f0ae3-bceb-4460-81f5-d04e5ac04a06 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:24.803944 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f0ae3-bceb-4460-81f5-d04e5ac04a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:24.805448 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f0ae3-bceb-4460-81f5-d04e5ac04a06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:24.805448 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35f0ae3-bceb-4460-81f5-d04e5ac04a06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:24.806654 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35f0ae3-bceb-4460-81f5-d04e5ac04a06 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:24.821809 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1126/2229] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:28:24.823137 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3790472d-cf93-44aa-a143-cb77ab5df549 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:24.835968 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3790472d-cf93-44aa-a143-cb77ab5df549 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:24.840935 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2d7b0-60d1-47af-8f05-de81b4b7054d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:24.841656 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2d7b0-60d1-47af-8f05-de81b4b7054d admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:24.841809 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2d7b0-60d1-47af-8f05-de81b4b7054d admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:24.842087 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2d7b0-60d1-47af-8f05-de81b4b7054d admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:24.842726 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2d7b0-60d1-47af-8f05-de81b4b7054d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:24.846626 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2d7b0-60d1-47af-8f05-de81b4b7054d admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:24.869998 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1104/2230] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:28:24.870852 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f0ae3-bceb-4460-81f5-d04e5ac04a06 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:24.882416 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f0ae3-bceb-4460-81f5-d04e5ac04a06 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:24.890489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969c6e4-3f1e-4296-8c86-bd6939105711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:24.891836 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969c6e4-3f1e-4296-8c86-bd6939105711 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:24.892128 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969c6e4-3f1e-4296-8c86-bd6939105711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:24.892406 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969c6e4-3f1e-4296-8c86-bd6939105711 admin admin] PATH_INFO: `/v3/projects/a2d7804a5b93400d8fbbcef554c86729/users/f78d8c00b1de4246adbec27e6970c751/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:24.917208 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969c6e4-3f1e-4296-8c86-bd6939105711 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2d7804a5b93400d8fbbcef554c86729, user_id=f78d8c00b1de4246adbec27e6970c751, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:24.919995 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969c6e4-3f1e-4296-8c86-bd6939105711 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:25.007451 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1127/2231] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:28:24 2022] PUT /identity/v3/projects/a2d7804a5b93400d8fbbcef554c86729/users/f78d8c00b1de4246adbec27e6970c751/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:28:25.021158 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2e18c-10ae-4e94-978d-0b6d6bb2f567 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:25.021446 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2e18c-10ae-4e94-978d-0b6d6bb2f567 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:25.021756 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2e18c-10ae-4e94-978d-0b6d6bb2f567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:25.049799 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-f4c2e18c-10ae-4e94-978d-0b6d6bb2f567 None None] MFA Rules not processed for user `f78d8c00b1de4246adbec27e6970c751`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:25.051010 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-f4c2e18c-10ae-4e94-978d-0b6d6bb2f567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:25.070784 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:25.118934 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1105/2232] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:28:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:28:25.131189 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969c6e4-3f1e-4296-8c86-bd6939105711 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:25.133030 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-b969c6e4-3f1e-4296-8c86-bd6939105711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:25.192431 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969c6e4-3f1e-4296-8c86-bd6939105711 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:25.196223 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ca1a4-381d-4aef-921c-bab4e4411d79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:25.196837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ca1a4-381d-4aef-921c-bab4e4411d79 service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:25.197118 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ca1a4-381d-4aef-921c-bab4e4411d79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:25.213121 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ca1a4-381d-4aef-921c-bab4e4411d79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:25.213121 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ca1a4-381d-4aef-921c-bab4e4411d79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:25.213121 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ca1a4-381d-4aef-921c-bab4e4411d79 service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:25.218229 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1128/2233] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:28:25 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:28:28.352678 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2e18c-10ae-4e94-978d-0b6d6bb2f567 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:28.441241 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2e18c-10ae-4e94-978d-0b6d6bb2f567 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:28.445832 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830be7f3-d187-4261-916c-6fe3b7721b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:28.446498 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830be7f3-d187-4261-916c-6fe3b7721b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:28.446785 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830be7f3-d187-4261-916c-6fe3b7721b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:28.447066 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830be7f3-d187-4261-916c-6fe3b7721b56 admin admin] PATH_INFO: `/v3/users/f78d8c00b1de4246adbec27e6970c751` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:28.448234 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830be7f3-d187-4261-916c-6fe3b7721b56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f78d8c00b1de4246adbec27e6970c751)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:28.450149 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830be7f3-d187-4261-916c-6fe3b7721b56 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:28.655121 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-830be7f3-d187-4261-916c-6fe3b7721b56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f78d8c00b1de4246adbec27e6970c751'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:28.732671 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-830be7f3-d187-4261-916c-6fe3b7721b56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f78d8c00b1de4246adbec27e6970c751'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:28.733296 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-830be7f3-d187-4261-916c-6fe3b7721b56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f78d8c00b1de4246adbec27e6970c751'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:28.733911 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-830be7f3-d187-4261-916c-6fe3b7721b56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f78d8c00b1de4246adbec27e6970c751'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:28.747091 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-830be7f3-d187-4261-916c-6fe3b7721b56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f78d8c00b1de4246adbec27e6970c751'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:28.759881 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1106/2234] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:28:28 2022] DELETE /identity/v3/users/f78d8c00b1de4246adbec27e6970c751 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:28.764506 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a2235-97a0-4378-8a36-62cf0cbbe50c None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:28.765355 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a2235-97a0-4378-8a36-62cf0cbbe50c None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:28.765668 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a2235-97a0-4378-8a36-62cf0cbbe50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:28.785733 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-cc3a2235-97a0-4378-8a36-62cf0cbbe50c None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:28.786970 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-cc3a2235-97a0-4378-8a36-62cf0cbbe50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:28.819238 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:28.849921 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1129/2235] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:28:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:28:28.859729 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830be7f3-d187-4261-916c-6fe3b7721b56 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:28.861359 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-830be7f3-d187-4261-916c-6fe3b7721b56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:28.908444 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:28.919734 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830be7f3-d187-4261-916c-6fe3b7721b56 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:28.923887 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dff042-a14e-42a5-b898-b01ab96413bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:28.924482 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dff042-a14e-42a5-b898-b01ab96413bb service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:28.924765 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dff042-a14e-42a5-b898-b01ab96413bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:28.925037 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dff042-a14e-42a5-b898-b01ab96413bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:28.933765 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dff042-a14e-42a5-b898-b01ab96413bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:28.935173 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dff042-a14e-42a5-b898-b01ab96413bb service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:28.944430 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1107/2236] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:28:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:28:29.442949 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a2235-97a0-4378-8a36-62cf0cbbe50c None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:29.444517 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-cc3a2235-97a0-4378-8a36-62cf0cbbe50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:29.457028 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a2235-97a0-4378-8a36-62cf0cbbe50c None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:29.461868 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860396fb-0c69-43f8-b257-fca664cc3ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:29.462525 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860396fb-0c69-43f8-b257-fca664cc3ca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:29.462783 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860396fb-0c69-43f8-b257-fca664cc3ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:29.463059 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860396fb-0c69-43f8-b257-fca664cc3ca2 admin admin] PATH_INFO: `/v3/projects/a2d7804a5b93400d8fbbcef554c86729` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:29.464222 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860396fb-0c69-43f8-b257-fca664cc3ca2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2d7804a5b93400d8fbbcef554c86729)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:29.466136 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860396fb-0c69-43f8-b257-fca664cc3ca2 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:29.524330 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44449cff-6721-4e53-9991-1ef2c0cd77c0 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:29.524829 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44449cff-6721-4e53-9991-1ef2c0cd77c0 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:29.524923 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44449cff-6721-4e53-9991-1ef2c0cd77c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:29.543881 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-44449cff-6721-4e53-9991-1ef2c0cd77c0 None None] MFA Rules not processed for user `bf2422e88cc94ef9b19f24f5d8e7d56c`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:29.545111 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-44449cff-6721-4e53-9991-1ef2c0cd77c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:29.601405 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1108/2237] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:28:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:28:29.615058 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-860396fb-0c69-43f8-b257-fca664cc3ca2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2d7804a5b93400d8fbbcef554c86729', 'request_id': 'req-860396fb-0c69-43f8-b257-fca664cc3ca2'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:29.622527 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-860396fb-0c69-43f8-b257-fca664cc3ca2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2d7804a5b93400d8fbbcef554c86729', 'request_id': 'req-860396fb-0c69-43f8-b257-fca664cc3ca2'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:29.630290 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-860396fb-0c69-43f8-b257-fca664cc3ca2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2d7804a5b93400d8fbbcef554c86729', 'request_id': 'req-860396fb-0c69-43f8-b257-fca664cc3ca2'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:29.772639 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-860396fb-0c69-43f8-b257-fca664cc3ca2 admin admin] The token cache is being invalidate because project a2d7804a5b93400d8fbbcef554c86729 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:28:29.773228 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-860396fb-0c69-43f8-b257-fca664cc3ca2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:29.773602 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-860396fb-0c69-43f8-b257-fca664cc3ca2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:28:29.775278 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1130/2238] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:28:29 2022] DELETE /identity/v3/projects/a2d7804a5b93400d8fbbcef554c86729 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:28:29.781619 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f269e5-fbec-4e5a-8359-a007858b430f None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:29.781619 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f269e5-fbec-4e5a-8359-a007858b430f None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:29.781619 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f269e5-fbec-4e5a-8359-a007858b430f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:29.801077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-07f269e5-fbec-4e5a-8359-a007858b430f None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:29.802280 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-07f269e5-fbec-4e5a-8359-a007858b430f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:29.879977 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1109/2239] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:28:29.891931 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75d2a5-7a1c-438b-81a8-77c2e4f9a25a None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:29.892311 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75d2a5-7a1c-438b-81a8-77c2e4f9a25a None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:29.892685 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75d2a5-7a1c-438b-81a8-77c2e4f9a25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:29.913098 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-fb75d2a5-7a1c-438b-81a8-77c2e4f9a25a None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:29.914299 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-fb75d2a5-7a1c-438b-81a8-77c2e4f9a25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:29.922208 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1131/2240] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:28:29.926570 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f269e5-fbec-4e5a-8359-a007858b430f None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:29.936502 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f269e5-fbec-4e5a-8359-a007858b430f None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:29.941151 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b7b47-cb8f-42bd-a605-65be10113198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:29.941759 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b7b47-cb8f-42bd-a605-65be10113198 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:29.942041 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b7b47-cb8f-42bd-a605-65be10113198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:29.942317 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b7b47-cb8f-42bd-a605-65be10113198 admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:29.942969 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b7b47-cb8f-42bd-a605-65be10113198 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:28:29.943422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b7b47-cb8f-42bd-a605-65be10113198 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:29.945020 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b7b47-cb8f-42bd-a605-65be10113198 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:29.957279 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1110/2241] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:28:29.966756 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb75d2a5-7a1c-438b-81a8-77c2e4f9a25a None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:29.976575 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb75d2a5-7a1c-438b-81a8-77c2e4f9a25a None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:29.981442 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b800ae-26fd-4abf-92d4-44bed3b373fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:29.982071 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b800ae-26fd-4abf-92d4-44bed3b373fa admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:29.982343 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b800ae-26fd-4abf-92d4-44bed3b373fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:29.983052 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b800ae-26fd-4abf-92d4-44bed3b373fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:29.983725 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b800ae-26fd-4abf-92d4-44bed3b373fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:29.985673 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b800ae-26fd-4abf-92d4-44bed3b373fa admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:30.154477 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1132/2242] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:28:29 2022] POST /identity/v3/projects => generated 363 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:28:30.155665 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b7b47-cb8f-42bd-a605-65be10113198 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:30.176174 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b7b47-cb8f-42bd-a605-65be10113198 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:30.242718 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191a549-8709-4e2f-aac3-866ed1a2864c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:30.243314 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191a549-8709-4e2f-aac3-866ed1a2864c admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:30.243657 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191a549-8709-4e2f-aac3-866ed1a2864c admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:30.243932 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191a549-8709-4e2f-aac3-866ed1a2864c admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:30.244544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191a549-8709-4e2f-aac3-866ed1a2864c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:30.246425 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191a549-8709-4e2f-aac3-866ed1a2864c admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:30.422753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1111/2243] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:28:30 2022] POST /identity/v3/users => generated 282 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:28:30.427861 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b800ae-26fd-4abf-92d4-44bed3b373fa admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:30.440493 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b800ae-26fd-4abf-92d4-44bed3b373fa admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:30.447059 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2061f8-8842-47d0-a3ac-fd441295b9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:30.448019 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2061f8-8842-47d0-a3ac-fd441295b9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:30.448525 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2061f8-8842-47d0-a3ac-fd441295b9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:30.449236 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2061f8-8842-47d0-a3ac-fd441295b9b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:30.450246 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2061f8-8842-47d0-a3ac-fd441295b9b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:30.452132 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2061f8-8842-47d0-a3ac-fd441295b9b6 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:30.466828 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1133/2244] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:28:30.472417 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191a549-8709-4e2f-aac3-866ed1a2864c admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:30.482477 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191a549-8709-4e2f-aac3-866ed1a2864c admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:30.487894 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858c594-9f1f-47e1-92d3-696985c5698d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:30.488609 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858c594-9f1f-47e1-92d3-696985c5698d admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:30.488887 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858c594-9f1f-47e1-92d3-696985c5698d admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:30.489131 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858c594-9f1f-47e1-92d3-696985c5698d admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:30.489760 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858c594-9f1f-47e1-92d3-696985c5698d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:30.491348 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858c594-9f1f-47e1-92d3-696985c5698d admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:30.492737 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:30.503142 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1112/2245] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:28:30.508177 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2061f8-8842-47d0-a3ac-fd441295b9b6 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:30.519684 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2061f8-8842-47d0-a3ac-fd441295b9b6 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:30.524591 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae5ddf-630d-4ce6-8c63-217529c2d57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:30.525185 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae5ddf-630d-4ce6-8c63-217529c2d57a admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:30.525467 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae5ddf-630d-4ce6-8c63-217529c2d57a admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:30.525743 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae5ddf-630d-4ce6-8c63-217529c2d57a admin admin] PATH_INFO: `/v3/projects/2816ee2bba944cdea3ccd7587f81cc06/users/88aad2bf25ec49a9a6ce931dba0f5edb/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:30.541703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae5ddf-630d-4ce6-8c63-217529c2d57a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2816ee2bba944cdea3ccd7587f81cc06, user_id=88aad2bf25ec49a9a6ce931dba0f5edb, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:30.544745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae5ddf-630d-4ce6-8c63-217529c2d57a admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:30.687866 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1134/2246] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:28:30 2022] PUT /identity/v3/projects/2816ee2bba944cdea3ccd7587f81cc06/users/88aad2bf25ec49a9a6ce931dba0f5edb/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:28:30.698069 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e11fa-ebae-4ec5-b7fc-f0e905ed7e27 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:30.698539 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e11fa-ebae-4ec5-b7fc-f0e905ed7e27 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:30.698649 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e11fa-ebae-4ec5-b7fc-f0e905ed7e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:30.726389 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-b85e11fa-ebae-4ec5-b7fc-f0e905ed7e27 None None] MFA Rules not processed for user `88aad2bf25ec49a9a6ce931dba0f5edb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:28:30.727614 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-b85e11fa-ebae-4ec5-b7fc-f0e905ed7e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:30.791604 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1113/2247] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:28:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:28:30.803046 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae5ddf-630d-4ce6-8c63-217529c2d57a admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:28:30.804845 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-49ae5ddf-630d-4ce6-8c63-217529c2d57a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:28:30.861551 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae5ddf-630d-4ce6-8c63-217529c2d57a admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:28:30.865693 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af69b5f-105f-4fff-b85b-2b1998dad0cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:28:30.866780 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af69b5f-105f-4fff-b85b-2b1998dad0cc service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:28:30.866780 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af69b5f-105f-4fff-b85b-2b1998dad0cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:28:30.867245 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af69b5f-105f-4fff-b85b-2b1998dad0cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:28:30.879870 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:30.879870 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af69b5f-105f-4fff-b85b-2b1998dad0cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:28:30.879870 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af69b5f-105f-4fff-b85b-2b1998dad0cc service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:28:30.888481 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1135/2248] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:28:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:28:40.788789 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=34 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:41.263952 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=2 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:29:04.229614 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1b24f-36cb-419a-a467-dffeb7d581b5 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:29:04.230069 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1b24f-36cb-419a-a467-dffeb7d581b5 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:29:04.230069 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1b24f-36cb-419a-a467-dffeb7d581b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:29:04.252470 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-b0b1b24f-36cb-419a-a467-dffeb7d581b5 None None] MFA Rules not processed for user `014a5ebd029d43d194722af661e4675b`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:29:04.255381 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-b0b1b24f-36cb-419a-a467-dffeb7d581b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:29:04.318942 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1114/2249] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:29:04 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:29:07.493450 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af69b5f-105f-4fff-b85b-2b1998dad0cc service cinder] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:29:07.560338 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af69b5f-105f-4fff-b85b-2b1998dad0cc service cinder] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:29:07.565696 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b493e0-15b4-4cc8-8a2e-7fad486df257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:29:07.566365 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b493e0-15b4-4cc8-8a2e-7fad486df257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:29:07.566649 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b493e0-15b4-4cc8-8a2e-7fad486df257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:29:07.566928 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b493e0-15b4-4cc8-8a2e-7fad486df257 admin admin] PATH_INFO: `/v3/users/88aad2bf25ec49a9a6ce931dba0f5edb` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:29:07.568102 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b493e0-15b4-4cc8-8a2e-7fad486df257 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88aad2bf25ec49a9a6ce931dba0f5edb)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:29:07.570039 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b493e0-15b4-4cc8-8a2e-7fad486df257 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:29:07.789714 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-52b493e0-15b4-4cc8-8a2e-7fad486df257 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88aad2bf25ec49a9a6ce931dba0f5edb'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:29:07.895832 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-52b493e0-15b4-4cc8-8a2e-7fad486df257 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88aad2bf25ec49a9a6ce931dba0f5edb'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:29:07.896541 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-52b493e0-15b4-4cc8-8a2e-7fad486df257 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88aad2bf25ec49a9a6ce931dba0f5edb'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:29:07.909261 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-52b493e0-15b4-4cc8-8a2e-7fad486df257 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88aad2bf25ec49a9a6ce931dba0f5edb'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:29:07.916216 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-52b493e0-15b4-4cc8-8a2e-7fad486df257 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88aad2bf25ec49a9a6ce931dba0f5edb'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:29:07.923690 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1136/2250] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:29:07 2022] DELETE /identity/v3/users/88aad2bf25ec49a9a6ce931dba0f5edb => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:29:07.928472 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05f5e2-40de-4c5e-a6bb-1b7130c0bc95 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:29:07.929022 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05f5e2-40de-4c5e-a6bb-1b7130c0bc95 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:29:07.929022 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05f5e2-40de-4c5e-a6bb-1b7130c0bc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:29:07.949857 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-cd05f5e2-40de-4c5e-a6bb-1b7130c0bc95 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:29:07.951106 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-cd05f5e2-40de-4c5e-a6bb-1b7130c0bc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:29:08.018965 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1115/2251] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:29:08.028842 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b493e0-15b4-4cc8-8a2e-7fad486df257 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:29:08.030375 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-52b493e0-15b4-4cc8-8a2e-7fad486df257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:29:08.096983 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b493e0-15b4-4cc8-8a2e-7fad486df257 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:29:08.100844 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84629f8b-57d5-459c-b7bb-4f80ed30b734 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:29:08.101456 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84629f8b-57d5-459c-b7bb-4f80ed30b734 service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:29:08.101736 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84629f8b-57d5-459c-b7bb-4f80ed30b734 service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:29:08.102007 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84629f8b-57d5-459c-b7bb-4f80ed30b734 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:29:08.112338 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84629f8b-57d5-459c-b7bb-4f80ed30b734 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:29:08.113765 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84629f8b-57d5-459c-b7bb-4f80ed30b734 service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:29:08.124799 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1137/2252] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:29:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:29:08.739657 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05f5e2-40de-4c5e-a6bb-1b7130c0bc95 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:29:08.741267 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-cd05f5e2-40de-4c5e-a6bb-1b7130c0bc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:29:08.755700 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05f5e2-40de-4c5e-a6bb-1b7130c0bc95 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:29:08.762797 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf4346-710c-44b4-944f-8a05cb9b52d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:29:08.767546 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf4346-710c-44b4-944f-8a05cb9b52d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:29:08.767546 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf4346-710c-44b4-944f-8a05cb9b52d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:29:08.767546 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf4346-710c-44b4-944f-8a05cb9b52d2 admin admin] PATH_INFO: `/v3/projects/2816ee2bba944cdea3ccd7587f81cc06` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:29:08.767546 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf4346-710c-44b4-944f-8a05cb9b52d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2816ee2bba944cdea3ccd7587f81cc06)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:29:08.768767 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf4346-710c-44b4-944f-8a05cb9b52d2 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:29:08.944987 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-deaf4346-710c-44b4-944f-8a05cb9b52d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2816ee2bba944cdea3ccd7587f81cc06', 'request_id': 'req-deaf4346-710c-44b4-944f-8a05cb9b52d2'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:29:08.953761 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-deaf4346-710c-44b4-944f-8a05cb9b52d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2816ee2bba944cdea3ccd7587f81cc06', 'request_id': 'req-deaf4346-710c-44b4-944f-8a05cb9b52d2'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:29:08.960753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-deaf4346-710c-44b4-944f-8a05cb9b52d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2816ee2bba944cdea3ccd7587f81cc06', 'request_id': 'req-deaf4346-710c-44b4-944f-8a05cb9b52d2'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:29:09.059724 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-deaf4346-710c-44b4-944f-8a05cb9b52d2 admin admin] The token cache is being invalidate because project 2816ee2bba944cdea3ccd7587f81cc06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:29:09.060110 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-deaf4346-710c-44b4-944f-8a05cb9b52d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:29:09.061769 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-deaf4346-710c-44b4-944f-8a05cb9b52d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:29:09.068967 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1116/2253] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:29:08 2022] DELETE /identity/v3/projects/2816ee2bba944cdea3ccd7587f81cc06 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:29:09.217993 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49ac9a-25d2-4365-857b-f11c34e50605 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:29:09.218826 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49ac9a-25d2-4365-857b-f11c34e50605 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:29:09.219263 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49ac9a-25d2-4365-857b-f11c34e50605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:29:09.241824 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-cd49ac9a-25d2-4365-857b-f11c34e50605 None None] MFA Rules not processed for user `5f1629cbe3e64573bf444834d6083669`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:29:09.243607 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-cd49ac9a-25d2-4365-857b-f11c34e50605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:29:09.264152 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:29:09.304579 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1138/2254] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:29:09 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:29:19.055347 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=79,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:29:19.761092 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=15 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:29:22.059715 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90c387-9aad-48a6-ba8c-de9424f5bcc5 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:29:22.060204 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90c387-9aad-48a6-ba8c-de9424f5bcc5 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:29:22.060326 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90c387-9aad-48a6-ba8c-de9424f5bcc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:29:22.080203 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-ad90c387-9aad-48a6-ba8c-de9424f5bcc5 None None] MFA Rules not processed for user `9222455cb9e047ab8b667b156c6f1f73`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:29:22.085475 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-ad90c387-9aad-48a6-ba8c-de9424f5bcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:29:22.139858 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1117/2255] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:29:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:29:32.133024 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=25 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:29:45.162386 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83143d-8336-4265-bd61-693776c75296 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:29:45.162922 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83143d-8336-4265-bd61-693776c75296 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:29:45.162922 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83143d-8336-4265-bd61-693776c75296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:29:45.182141 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-5e83143d-8336-4265-bd61-693776c75296 None None] MFA Rules not processed for user `bf2422e88cc94ef9b19f24f5d8e7d56c`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:29:45.190164 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-5e83143d-8336-4265-bd61-693776c75296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:29:45.236978 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1139/2256] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:29:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:29:55.230480 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=25 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:08.879306 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90c387-9aad-48a6-ba8c-de9424f5bcc5 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:08.880705 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-ad90c387-9aad-48a6-ba8c-de9424f5bcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:08.935810 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90c387-9aad-48a6-ba8c-de9424f5bcc5 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:08.939327 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ce468-d775-4378-95e2-ece63ff00ed8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:08.939941 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ce468-d775-4378-95e2-ece63ff00ed8 service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:08.940219 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ce468-d775-4378-95e2-ece63ff00ed8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:08.940490 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ce468-d775-4378-95e2-ece63ff00ed8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:08.942148 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-1c6ce468-d775-4378-95e2-ece63ff00ed8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:09.008713 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ce468-d775-4378-95e2-ece63ff00ed8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:09.010131 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ce468-d775-4378-95e2-ece63ff00ed8 service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:09.021204 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1118/2257] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:30:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:30:11.448181 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83143d-8336-4265-bd61-693776c75296 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:11.460633 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83143d-8336-4265-bd61-693776c75296 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:11.465413 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659675f-2458-4952-82dd-005ba9ee6969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:11.466059 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659675f-2458-4952-82dd-005ba9ee6969 service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:11.466335 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659675f-2458-4952-82dd-005ba9ee6969 service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:11.466607 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659675f-2458-4952-82dd-005ba9ee6969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:11.469070 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-2659675f-2458-4952-82dd-005ba9ee6969 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:11.483534 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659675f-2458-4952-82dd-005ba9ee6969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:11.485062 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659675f-2458-4952-82dd-005ba9ee6969 service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:11.496287 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1140/2258] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:30:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:30:12.599904 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ce468-d775-4378-95e2-ece63ff00ed8 service neutron] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:12.608378 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ce468-d775-4378-95e2-ece63ff00ed8 service neutron] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:12.611930 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916bddf-bada-47e1-aa78-d209eacd20bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:12.612515 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916bddf-bada-47e1-aa78-d209eacd20bc service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:12.612790 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916bddf-bada-47e1-aa78-d209eacd20bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:12.613062 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916bddf-bada-47e1-aa78-d209eacd20bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:12.614725 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-f916bddf-bada-47e1-aa78-d209eacd20bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:12.676423 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f916bddf-bada-47e1-aa78-d209eacd20bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:12.677837 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f916bddf-bada-47e1-aa78-d209eacd20bc service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:12.687221 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1119/2259] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:30:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:30:17.082637 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659675f-2458-4952-82dd-005ba9ee6969 service neutron] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:17.084897 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-2659675f-2458-4952-82dd-005ba9ee6969 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:17.101028 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659675f-2458-4952-82dd-005ba9ee6969 service neutron] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:17.105904 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0921e1b-b2c9-4cfb-8c9b-f64895d72529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:17.107292 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0921e1b-b2c9-4cfb-8c9b-f64895d72529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:17.107600 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0921e1b-b2c9-4cfb-8c9b-f64895d72529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:17.108095 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0921e1b-b2c9-4cfb-8c9b-f64895d72529 admin admin] PATH_INFO: `/v3/users/014a5ebd029d43d194722af661e4675b` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:17.109544 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0921e1b-b2c9-4cfb-8c9b-f64895d72529 admin admin] RBAC: Authorizing `identity:delete_user(user_id=014a5ebd029d43d194722af661e4675b)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:17.111625 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0921e1b-b2c9-4cfb-8c9b-f64895d72529 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:17.351456 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-a0921e1b-b2c9-4cfb-8c9b-f64895d72529 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '014a5ebd029d43d194722af661e4675b'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:17.440842 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-a0921e1b-b2c9-4cfb-8c9b-f64895d72529 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '014a5ebd029d43d194722af661e4675b'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:17.441486 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-a0921e1b-b2c9-4cfb-8c9b-f64895d72529 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '014a5ebd029d43d194722af661e4675b'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:17.454659 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-a0921e1b-b2c9-4cfb-8c9b-f64895d72529 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '014a5ebd029d43d194722af661e4675b'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:17.462148 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-a0921e1b-b2c9-4cfb-8c9b-f64895d72529 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '014a5ebd029d43d194722af661e4675b'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:17.468662 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1141/2260] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:30:17 2022] DELETE /identity/v3/users/014a5ebd029d43d194722af661e4675b => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:17.820078 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916bddf-bada-47e1-aa78-d209eacd20bc service neutron] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:17.830690 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916bddf-bada-47e1-aa78-d209eacd20bc service neutron] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:17.866156 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:17.889795 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3fe8a6-95ac-445d-b8c3-77be0fed0c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:17.890416 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fe8a6-95ac-445d-b8c3-77be0fed0c30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:17.890737 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fe8a6-95ac-445d-b8c3-77be0fed0c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:17.891017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fe8a6-95ac-445d-b8c3-77be0fed0c30 admin admin] PATH_INFO: `/v3/projects/b18ce23826594ef2a366ca57b3b147aa` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:17.892196 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3fe8a6-95ac-445d-b8c3-77be0fed0c30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b18ce23826594ef2a366ca57b3b147aa)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:17.894079 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3fe8a6-95ac-445d-b8c3-77be0fed0c30 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:18.057955 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-4d3fe8a6-95ac-445d-b8c3-77be0fed0c30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b18ce23826594ef2a366ca57b3b147aa', 'request_id': 'req-4d3fe8a6-95ac-445d-b8c3-77be0fed0c30'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:18.063468 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-4d3fe8a6-95ac-445d-b8c3-77be0fed0c30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b18ce23826594ef2a366ca57b3b147aa', 'request_id': 'req-4d3fe8a6-95ac-445d-b8c3-77be0fed0c30'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:18.069598 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-4d3fe8a6-95ac-445d-b8c3-77be0fed0c30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b18ce23826594ef2a366ca57b3b147aa', 'request_id': 'req-4d3fe8a6-95ac-445d-b8c3-77be0fed0c30'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:18.166447 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-4d3fe8a6-95ac-445d-b8c3-77be0fed0c30 admin admin] The token cache is being invalidate because project b18ce23826594ef2a366ca57b3b147aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:30:18.166742 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-4d3fe8a6-95ac-445d-b8c3-77be0fed0c30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:18.167392 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-4d3fe8a6-95ac-445d-b8c3-77be0fed0c30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:18.168871 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1120/2261] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:30:17 2022] DELETE /identity/v3/projects/b18ce23826594ef2a366ca57b3b147aa => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:18.173820 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fbe72-350b-44c9-8189-041c1b0ea1fe None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:18.174280 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fbe72-350b-44c9-8189-041c1b0ea1fe None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:18.174372 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fbe72-350b-44c9-8189-041c1b0ea1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:18.194387 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-e91fbe72-350b-44c9-8189-041c1b0ea1fe None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:18.199582 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-e91fbe72-350b-44c9-8189-041c1b0ea1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:18.262086 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1142/2262] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:30:18.269495 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b36312-422b-47fe-ba0d-83e18e1603e9 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:18.269788 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b36312-422b-47fe-ba0d-83e18e1603e9 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:18.270071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b36312-422b-47fe-ba0d-83e18e1603e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:18.289988 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-d5b36312-422b-47fe-ba0d-83e18e1603e9 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:18.291279 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-d5b36312-422b-47fe-ba0d-83e18e1603e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:18.299066 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1121/2263] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:30:18.303469 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fbe72-350b-44c9-8189-041c1b0ea1fe None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:18.313580 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fbe72-350b-44c9-8189-041c1b0ea1fe None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:18.318205 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f015cd-eb90-463f-b713-fc85ad510386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:18.318802 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f015cd-eb90-463f-b713-fc85ad510386 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:18.319087 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f015cd-eb90-463f-b713-fc85ad510386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:18.319387 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f015cd-eb90-463f-b713-fc85ad510386 admin admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:18.320036 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f015cd-eb90-463f-b713-fc85ad510386 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:30:18.320343 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f015cd-eb90-463f-b713-fc85ad510386 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:18.321935 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f015cd-eb90-463f-b713-fc85ad510386 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:18.334435 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1143/2264] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:30:18.339143 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b36312-422b-47fe-ba0d-83e18e1603e9 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:18.348627 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b36312-422b-47fe-ba0d-83e18e1603e9 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:18.353450 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b1631-1303-46be-8390-255c75d53fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:18.354082 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b1631-1303-46be-8390-255c75d53fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:18.354361 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b1631-1303-46be-8390-255c75d53fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:18.354636 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b1631-1303-46be-8390-255c75d53fd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:18.355400 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90b1631-1303-46be-8390-255c75d53fd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:18.357320 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90b1631-1303-46be-8390-255c75d53fd4 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:18.492044 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1122/2265] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:30:18 2022] POST /identity/v3/projects => generated 365 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:30:18.492916 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f015cd-eb90-463f-b713-fc85ad510386 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:18.503341 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f015cd-eb90-463f-b713-fc85ad510386 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:18.556660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:18.570191 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab227a-8b60-4dc4-80ea-2d1898b3181e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:18.570803 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab227a-8b60-4dc4-80ea-2d1898b3181e admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:18.577845 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab227a-8b60-4dc4-80ea-2d1898b3181e admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:18.577845 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab227a-8b60-4dc4-80ea-2d1898b3181e admin admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:18.577845 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab227a-8b60-4dc4-80ea-2d1898b3181e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:18.577845 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab227a-8b60-4dc4-80ea-2d1898b3181e admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:18.738502 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1144/2266] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:30:18 2022] POST /identity/v3/users => generated 283 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:30:18.742434 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b1631-1303-46be-8390-255c75d53fd4 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:18.753664 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b1631-1303-46be-8390-255c75d53fd4 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:18.758373 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a252186-9db5-4e55-8a6f-5c2ead47150e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:18.758985 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a252186-9db5-4e55-8a6f-5c2ead47150e admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:18.759270 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a252186-9db5-4e55-8a6f-5c2ead47150e admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:18.759581 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a252186-9db5-4e55-8a6f-5c2ead47150e admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:18.760229 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a252186-9db5-4e55-8a6f-5c2ead47150e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:18.761815 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a252186-9db5-4e55-8a6f-5c2ead47150e admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:18.771863 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1123/2267] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:30:18.786865 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab227a-8b60-4dc4-80ea-2d1898b3181e admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:18.797101 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab227a-8b60-4dc4-80ea-2d1898b3181e admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:18.801659 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517ce1c-d7bb-40fd-bdb0-5e79508c3a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:18.802256 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517ce1c-d7bb-40fd-bdb0-5e79508c3a86 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:18.802536 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517ce1c-d7bb-40fd-bdb0-5e79508c3a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:18.802807 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517ce1c-d7bb-40fd-bdb0-5e79508c3a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:18.803467 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8517ce1c-d7bb-40fd-bdb0-5e79508c3a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:18.805048 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8517ce1c-d7bb-40fd-bdb0-5e79508c3a86 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:18.818011 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1145/2268] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:30:18.832904 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a252186-9db5-4e55-8a6f-5c2ead47150e admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:18.842977 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a252186-9db5-4e55-8a6f-5c2ead47150e admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:18.847756 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5719c-5576-4b50-9e07-c20f7270e611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:18.848405 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5719c-5576-4b50-9e07-c20f7270e611 admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:18.848684 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5719c-5576-4b50-9e07-c20f7270e611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:18.848956 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5719c-5576-4b50-9e07-c20f7270e611 admin admin] PATH_INFO: `/v3/projects/84399314b38e4ece8bf3eb64d13afcc2/users/6d09c884eefb464da4b75f785b490f84/roles/5691bce246d6452990f13933e19f2825` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:18.864408 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee5719c-5576-4b50-9e07-c20f7270e611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84399314b38e4ece8bf3eb64d13afcc2, user_id=6d09c884eefb464da4b75f785b490f84, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:18.867067 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee5719c-5576-4b50-9e07-c20f7270e611 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:19.001267 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1124/2269] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:30:18 2022] PUT /identity/v3/projects/84399314b38e4ece8bf3eb64d13afcc2/users/6d09c884eefb464da4b75f785b490f84/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:19.011388 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01845958-72a6-44b4-8416-0de52603f0ce None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:19.011773 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01845958-72a6-44b4-8416-0de52603f0ce None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:19.012028 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01845958-72a6-44b4-8416-0de52603f0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:19.038745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-01845958-72a6-44b4-8416-0de52603f0ce None None] MFA Rules not processed for user `6d09c884eefb464da4b75f785b490f84`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:19.039992 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-01845958-72a6-44b4-8416-0de52603f0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:19.102534 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1146/2270] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:30:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:30:19.114058 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5719c-5576-4b50-9e07-c20f7270e611 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:19.115924 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-4ee5719c-5576-4b50-9e07-c20f7270e611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:19.178660 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5719c-5576-4b50-9e07-c20f7270e611 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:19.182591 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f6861-de75-4306-b3d6-07e68c6f9914 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:19.183283 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f6861-de75-4306-b3d6-07e68c6f9914 service cinder] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:19.183579 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f6861-de75-4306-b3d6-07e68c6f9914 service cinder] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:19.183987 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f6861-de75-4306-b3d6-07e68c6f9914 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:19.193101 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f6861-de75-4306-b3d6-07e68c6f9914 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:19.194607 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f6861-de75-4306-b3d6-07e68c6f9914 service cinder] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:19.203911 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1125/2271] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:30:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:30:28.727083 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008134d-c434-4006-ae36-f3bb4ba435de None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:28.727610 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008134d-c434-4006-ae36-f3bb4ba435de None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:28.727705 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008134d-c434-4006-ae36-f3bb4ba435de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:28.748171 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-5008134d-c434-4006-ae36-f3bb4ba435de None None] MFA Rules not processed for user `1d39439278814d4faac4cfb1e71aa4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:28.752440 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-5008134d-c434-4006-ae36-f3bb4ba435de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:28.810872 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1147/2272] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 8 02:30:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:30:28.965601 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f6861-de75-4306-b3d6-07e68c6f9914 service cinder] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:28.967558 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-404f6861-de75-4306-b3d6-07e68c6f9914 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:28.974067 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:29.045289 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f6861-de75-4306-b3d6-07e68c6f9914 service cinder] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:29.050999 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa070f-c5a9-4b5e-92d2-e45b623316df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c212009b6a44e1bad92769630116408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:29.051642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa070f-c5a9-4b5e-92d2-e45b623316df service swift] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:29.051923 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa070f-c5a9-4b5e-92d2-e45b623316df service swift] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:29.052204 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa070f-c5a9-4b5e-92d2-e45b623316df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:29.061602 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa070f-c5a9-4b5e-92d2-e45b623316df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:29.063255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa070f-c5a9-4b5e-92d2-e45b623316df service swift] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:29.073421 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1126/2273] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 8 02:30:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:30:29.424453 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008134d-c434-4006-ae36-f3bb4ba435de None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:29.536597 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008134d-c434-4006-ae36-f3bb4ba435de None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:29.542344 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4874e15-940b-4e51-b836-7826afc7c656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:29.543301 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4874e15-940b-4e51-b836-7826afc7c656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:29.543623 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4874e15-940b-4e51-b836-7826afc7c656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:29.543901 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4874e15-940b-4e51-b836-7826afc7c656 admin admin] PATH_INFO: `/v3/users/6d09c884eefb464da4b75f785b490f84` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:29.546541 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4874e15-940b-4e51-b836-7826afc7c656 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d09c884eefb464da4b75f785b490f84)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:29.548530 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4874e15-940b-4e51-b836-7826afc7c656 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:29.550491 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:29.752195 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c4874e15-940b-4e51-b836-7826afc7c656 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d09c884eefb464da4b75f785b490f84'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:29.835409 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c4874e15-940b-4e51-b836-7826afc7c656 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d09c884eefb464da4b75f785b490f84'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:29.836446 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c4874e15-940b-4e51-b836-7826afc7c656 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d09c884eefb464da4b75f785b490f84'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:29.857274 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c4874e15-940b-4e51-b836-7826afc7c656 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d09c884eefb464da4b75f785b490f84'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:29.871394 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c4874e15-940b-4e51-b836-7826afc7c656 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d09c884eefb464da4b75f785b490f84'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:29.878038 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1148/2274] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:30:29 2022] DELETE /identity/v3/users/6d09c884eefb464da4b75f785b490f84 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:29.882652 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9abb92-af56-4cbe-abf3-8399f682d66b None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:29.883011 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9abb92-af56-4cbe-abf3-8399f682d66b None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:29.883406 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9abb92-af56-4cbe-abf3-8399f682d66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:29.908645 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-7b9abb92-af56-4cbe-abf3-8399f682d66b None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:29.910202 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-7b9abb92-af56-4cbe-abf3-8399f682d66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:30.001887 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1127/2275] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:30:30.012918 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4874e15-940b-4e51-b836-7826afc7c656 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:30.016748 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-c4874e15-940b-4e51-b836-7826afc7c656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:30.097685 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4874e15-940b-4e51-b836-7826afc7c656 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:30.101520 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738dba3-fd96-4b16-b349-e806c94cf44a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:30.102145 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738dba3-fd96-4b16-b349-e806c94cf44a service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:30.102430 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738dba3-fd96-4b16-b349-e806c94cf44a service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:30.102835 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738dba3-fd96-4b16-b349-e806c94cf44a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:30.119604 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0738dba3-fd96-4b16-b349-e806c94cf44a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:30.122408 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0738dba3-fd96-4b16-b349-e806c94cf44a service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:30.142091 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1149/2276] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:30:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:30:30.181897 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9abb92-af56-4cbe-abf3-8399f682d66b None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:30.183718 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-7b9abb92-af56-4cbe-abf3-8399f682d66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:30.313024 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9abb92-af56-4cbe-abf3-8399f682d66b None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:30.320505 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f44c5-8407-4ac1-a842-81bf0c98cc49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:30.321132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f44c5-8407-4ac1-a842-81bf0c98cc49 service nova] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:30.321437 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f44c5-8407-4ac1-a842-81bf0c98cc49 service nova] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:30.321730 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f44c5-8407-4ac1-a842-81bf0c98cc49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:30.324351 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-8c5f44c5-8407-4ac1-a842-81bf0c98cc49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:30.367924 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:30.405733 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f44c5-8407-4ac1-a842-81bf0c98cc49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:30.407707 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f44c5-8407-4ac1-a842-81bf0c98cc49 service nova] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:30.420682 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1128/2277] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:30:30 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:30:30.752157 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738dba3-fd96-4b16-b349-e806c94cf44a service neutron] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:30.753792 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-0738dba3-fd96-4b16-b349-e806c94cf44a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:30.771457 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738dba3-fd96-4b16-b349-e806c94cf44a service neutron] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:30.779244 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a13fd3-529b-4df3-8d7a-a4a787015fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:30.781037 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a13fd3-529b-4df3-8d7a-a4a787015fc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:30.781396 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a13fd3-529b-4df3-8d7a-a4a787015fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:30.781782 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a13fd3-529b-4df3-8d7a-a4a787015fc4 admin admin] PATH_INFO: `/v3/projects/84399314b38e4ece8bf3eb64d13afcc2` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:30.783136 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a13fd3-529b-4df3-8d7a-a4a787015fc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84399314b38e4ece8bf3eb64d13afcc2)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:30.785866 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a13fd3-529b-4df3-8d7a-a4a787015fc4 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:30.923018 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c9a13fd3-529b-4df3-8d7a-a4a787015fc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84399314b38e4ece8bf3eb64d13afcc2', 'request_id': 'req-c9a13fd3-529b-4df3-8d7a-a4a787015fc4'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:30.938404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c9a13fd3-529b-4df3-8d7a-a4a787015fc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84399314b38e4ece8bf3eb64d13afcc2', 'request_id': 'req-c9a13fd3-529b-4df3-8d7a-a4a787015fc4'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:30.950782 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c9a13fd3-529b-4df3-8d7a-a4a787015fc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84399314b38e4ece8bf3eb64d13afcc2', 'request_id': 'req-c9a13fd3-529b-4df3-8d7a-a4a787015fc4'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:31.064765 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c9a13fd3-529b-4df3-8d7a-a4a787015fc4 admin admin] The token cache is being invalidate because project 84399314b38e4ece8bf3eb64d13afcc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:30:31.065409 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c9a13fd3-529b-4df3-8d7a-a4a787015fc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:31.066295 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c9a13fd3-529b-4df3-8d7a-a4a787015fc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:31.068124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1150/2278] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:30:30 2022] DELETE /identity/v3/projects/84399314b38e4ece8bf3eb64d13afcc2 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:31.073479 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2d262-26af-4a7b-bf83-1fcb03ffd6d3 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:31.074549 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2d262-26af-4a7b-bf83-1fcb03ffd6d3 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:31.074690 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2d262-26af-4a7b-bf83-1fcb03ffd6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:31.104313 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-ebb2d262-26af-4a7b-bf83-1fcb03ffd6d3 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:31.105969 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-ebb2d262-26af-4a7b-bf83-1fcb03ffd6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:31.187554 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1129/2279] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:30:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:30:31.193030 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a13fd3-529b-4df3-8d7a-a4a787015fc4 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:31.196482 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-c9a13fd3-529b-4df3-8d7a-a4a787015fc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:31.202323 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e440851-ff2a-4ad4-9cfd-87a16f3f7238 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:31.202323 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e440851-ff2a-4ad4-9cfd-87a16f3f7238 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:31.202323 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e440851-ff2a-4ad4-9cfd-87a16f3f7238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:31.208670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:31.228395 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-2e440851-ff2a-4ad4-9cfd-87a16f3f7238 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:31.230114 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-2e440851-ff2a-4ad4-9cfd-87a16f3f7238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:31.243837 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1130/2280] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:30:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:30:31.249113 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e440851-ff2a-4ad4-9cfd-87a16f3f7238 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:31.259480 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e440851-ff2a-4ad4-9cfd-87a16f3f7238 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:31.265751 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e298694f-fb8e-4fdd-9021-0a748002014c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:31.266263 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298694f-fb8e-4fdd-9021-0a748002014c admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:31.266549 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298694f-fb8e-4fdd-9021-0a748002014c admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:31.266830 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298694f-fb8e-4fdd-9021-0a748002014c admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:31.267700 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e298694f-fb8e-4fdd-9021-0a748002014c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:30:31.268798 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e298694f-fb8e-4fdd-9021-0a748002014c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:31.270578 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e298694f-fb8e-4fdd-9021-0a748002014c admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:31.280023 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a13fd3-529b-4df3-8d7a-a4a787015fc4 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:31.284144 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3cc313-3e55-4a29-b583-79101cbfb1d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:31.287474 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1131/2281] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:30:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:30:31.287652 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cc313-3e55-4a29-b583-79101cbfb1d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:31.287652 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cc313-3e55-4a29-b583-79101cbfb1d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:31.287652 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cc313-3e55-4a29-b583-79101cbfb1d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:31.289470 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e298694f-fb8e-4fdd-9021-0a748002014c admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:31.294314 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-cb3cc313-3e55-4a29-b583-79101cbfb1d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:31.318593 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e298694f-fb8e-4fdd-9021-0a748002014c admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:31.323847 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d5e81-44cc-477e-8b80-6d12a48f768d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:31.324669 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d5e81-44cc-477e-8b80-6d12a48f768d admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:31.324949 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d5e81-44cc-477e-8b80-6d12a48f768d admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:31.325288 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d5e81-44cc-477e-8b80-6d12a48f768d admin admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:31.326027 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d5e81-44cc-477e-8b80-6d12a48f768d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:31.328080 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d5e81-44cc-477e-8b80-6d12a48f768d admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:31.381454 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3cc313-3e55-4a29-b583-79101cbfb1d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:31.382911 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3cc313-3e55-4a29-b583-79101cbfb1d4 service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:31.394488 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1151/2282] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:30:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:30:31.426503 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1132/2283] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:30:31 2022] POST /identity/v3/projects => generated 387 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:30:31.427570 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3cc313-3e55-4a29-b583-79101cbfb1d4 service cinder] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:31.441329 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3cc313-3e55-4a29-b583-79101cbfb1d4 service cinder] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:31.537452 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45502bc-e883-4d61-a98d-7be4dd2c0884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:31.538226 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45502bc-e883-4d61-a98d-7be4dd2c0884 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:31.538596 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45502bc-e883-4d61-a98d-7be4dd2c0884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:31.538933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45502bc-e883-4d61-a98d-7be4dd2c0884 admin admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:31.539737 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45502bc-e883-4d61-a98d-7be4dd2c0884 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:31.541946 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45502bc-e883-4d61-a98d-7be4dd2c0884 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:31.660837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1152/2284] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:30:31 2022] POST /identity/v3/users => generated 294 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:30:31.665252 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d5e81-44cc-477e-8b80-6d12a48f768d admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:31.688238 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d5e81-44cc-477e-8b80-6d12a48f768d admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:31.693684 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b5e0b-f30f-4f15-a1d3-857a20b66ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:31.694382 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b5e0b-f30f-4f15-a1d3-857a20b66ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:31.694773 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b5e0b-f30f-4f15-a1d3-857a20b66ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:31.695127 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b5e0b-f30f-4f15-a1d3-857a20b66ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:31.696673 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b5e0b-f30f-4f15-a1d3-857a20b66ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:31.698484 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b5e0b-f30f-4f15-a1d3-857a20b66ae5 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:31.716595 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1133/2285] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:30:31.719485 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45502bc-e883-4d61-a98d-7be4dd2c0884 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:31.736812 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45502bc-e883-4d61-a98d-7be4dd2c0884 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:31.742240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3bc1a-f3d3-453b-a23d-360275fdb902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:31.742866 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3bc1a-f3d3-453b-a23d-360275fdb902 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:31.743205 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3bc1a-f3d3-453b-a23d-360275fdb902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:31.743531 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3bc1a-f3d3-453b-a23d-360275fdb902 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:31.744186 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3bc1a-f3d3-453b-a23d-360275fdb902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:31.746164 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3bc1a-f3d3-453b-a23d-360275fdb902 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:31.765889 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1153/2286] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:30:31.767238 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b5e0b-f30f-4f15-a1d3-857a20b66ae5 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:31.785724 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b5e0b-f30f-4f15-a1d3-857a20b66ae5 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:31.790733 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab879602-512d-479d-b03c-3c432954cb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:31.791502 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab879602-512d-479d-b03c-3c432954cb60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:31.791849 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab879602-512d-479d-b03c-3c432954cb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:31.792196 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab879602-512d-479d-b03c-3c432954cb60 admin admin] PATH_INFO: `/v3/projects/c14d1b8071a34a1586878d44c7b0aa0f/users/79909a830627438a8ebd558c08e24c62/roles/5691bce246d6452990f13933e19f2825` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:31.808719 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab879602-512d-479d-b03c-3c432954cb60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c14d1b8071a34a1586878d44c7b0aa0f, user_id=79909a830627438a8ebd558c08e24c62, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:31.810921 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab879602-512d-479d-b03c-3c432954cb60 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:32.019725 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1134/2287] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:30:31 2022] PUT /identity/v3/projects/c14d1b8071a34a1586878d44c7b0aa0f/users/79909a830627438a8ebd558c08e24c62/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:32.030278 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897c665-5177-43f2-9e34-d941f6958fba None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:32.030569 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897c665-5177-43f2-9e34-d941f6958fba None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:32.030848 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897c665-5177-43f2-9e34-d941f6958fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:32.075556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-2897c665-5177-43f2-9e34-d941f6958fba None None] MFA Rules not processed for user `79909a830627438a8ebd558c08e24c62`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:32.077487 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-2897c665-5177-43f2-9e34-d941f6958fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:32.116671 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:32.166599 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1154/2288] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:30:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:30:32.172104 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab879602-512d-479d-b03c-3c432954cb60 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:32.257102 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:32.262497 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab879602-512d-479d-b03c-3c432954cb60 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:32.275514 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd88183-2033-4bd0-8251-94b1ba470368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:32.276118 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd88183-2033-4bd0-8251-94b1ba470368 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:32.276403 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd88183-2033-4bd0-8251-94b1ba470368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:32.276790 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd88183-2033-4bd0-8251-94b1ba470368 admin admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:32.277423 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd88183-2033-4bd0-8251-94b1ba470368 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:32.280121 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd88183-2033-4bd0-8251-94b1ba470368 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:32.637880 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1135/2289] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:30:32 2022] POST /identity/v3/projects => generated 387 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:30:32.641914 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2897c665-5177-43f2-9e34-d941f6958fba None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:32.654975 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2897c665-5177-43f2-9e34-d941f6958fba None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:32.727477 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202679b-ef4a-420b-8ff2-9275c8c06368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:32.728250 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202679b-ef4a-420b-8ff2-9275c8c06368 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:32.728538 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202679b-ef4a-420b-8ff2-9275c8c06368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:32.728820 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202679b-ef4a-420b-8ff2-9275c8c06368 admin admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:32.729494 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202679b-ef4a-420b-8ff2-9275c8c06368 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:32.732131 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202679b-ef4a-420b-8ff2-9275c8c06368 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:32.882666 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1155/2290] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:30:32 2022] POST /identity/v3/users => generated 300 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:30:32.887472 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd88183-2033-4bd0-8251-94b1ba470368 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:32.898753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd88183-2033-4bd0-8251-94b1ba470368 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:32.918513 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219405fd-7af1-492f-be83-1d990b1a55ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:32.918513 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219405fd-7af1-492f-be83-1d990b1a55ad admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:32.918513 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219405fd-7af1-492f-be83-1d990b1a55ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:32.918513 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219405fd-7af1-492f-be83-1d990b1a55ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:32.918906 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219405fd-7af1-492f-be83-1d990b1a55ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:32.920226 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219405fd-7af1-492f-be83-1d990b1a55ad admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:32.935566 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1136/2291] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:30:32.940122 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202679b-ef4a-420b-8ff2-9275c8c06368 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:32.953159 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202679b-ef4a-420b-8ff2-9275c8c06368 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:32.959340 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60fa4f1-a25f-4ce1-8ed4-99472312bee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:32.959945 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60fa4f1-a25f-4ce1-8ed4-99472312bee9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:32.960274 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60fa4f1-a25f-4ce1-8ed4-99472312bee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:32.960796 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60fa4f1-a25f-4ce1-8ed4-99472312bee9 admin admin] PATH_INFO: `/v3/projects/c22f4e999a904f72a5c49cf79502ef3f/users/964afdfc95e5457ea03ba2cfd47a81ac/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:32.993049 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60fa4f1-a25f-4ce1-8ed4-99472312bee9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c22f4e999a904f72a5c49cf79502ef3f, user_id=964afdfc95e5457ea03ba2cfd47a81ac, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:32.997702 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60fa4f1-a25f-4ce1-8ed4-99472312bee9 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:33.149400 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1156/2292] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:30:32 2022] PUT /identity/v3/projects/c22f4e999a904f72a5c49cf79502ef3f/users/964afdfc95e5457ea03ba2cfd47a81ac/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:30:33.154515 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219405fd-7af1-492f-be83-1d990b1a55ad admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:33.174959 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219405fd-7af1-492f-be83-1d990b1a55ad admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:33.312885 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8fdd3f-7bac-48bf-9981-9242dce46937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:33.313797 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fdd3f-7bac-48bf-9981-9242dce46937 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:33.317236 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fdd3f-7bac-48bf-9981-9242dce46937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:33.317236 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fdd3f-7bac-48bf-9981-9242dce46937 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:33.317236 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8fdd3f-7bac-48bf-9981-9242dce46937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:33.319562 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8fdd3f-7bac-48bf-9981-9242dce46937 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:33.342252 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1137/2293] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:30:33.343887 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60fa4f1-a25f-4ce1-8ed4-99472312bee9 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:33.367175 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60fa4f1-a25f-4ce1-8ed4-99472312bee9 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:33.388631 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0304959-163f-4df9-9951-c226a2c88a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:33.392435 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0304959-163f-4df9-9951-c226a2c88a57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:33.392942 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0304959-163f-4df9-9951-c226a2c88a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:33.393305 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0304959-163f-4df9-9951-c226a2c88a57 admin admin] PATH_INFO: `/v3/projects/c22f4e999a904f72a5c49cf79502ef3f/users/964afdfc95e5457ea03ba2cfd47a81ac/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:33.396607 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0304959-163f-4df9-9951-c226a2c88a57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c22f4e999a904f72a5c49cf79502ef3f, user_id=964afdfc95e5457ea03ba2cfd47a81ac, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:33.398415 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0304959-163f-4df9-9951-c226a2c88a57 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:33.419731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1157/2294] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:30:33 2022] PUT /identity/v3/projects/c22f4e999a904f72a5c49cf79502ef3f/users/964afdfc95e5457ea03ba2cfd47a81ac/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:30:33.435231 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb958c-82a3-42f7-933c-5ac16b41ca6b None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:33.435642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb958c-82a3-42f7-933c-5ac16b41ca6b None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:33.435927 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb958c-82a3-42f7-933c-5ac16b41ca6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:33.507281 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-cafb958c-82a3-42f7-933c-5ac16b41ca6b None None] MFA Rules not processed for user `964afdfc95e5457ea03ba2cfd47a81ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:33.509282 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-cafb958c-82a3-42f7-933c-5ac16b41ca6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:33.623495 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1138/2295] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:30:33 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:30:33.635942 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0304959-163f-4df9-9951-c226a2c88a57 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:33.638316 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-a0304959-163f-4df9-9951-c226a2c88a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:33.754250 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0304959-163f-4df9-9951-c226a2c88a57 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:33.761055 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bcaf25-463f-4bb3-b8d7-8943d4a67aa0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:33.762042 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bcaf25-463f-4bb3-b8d7-8943d4a67aa0 service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:33.762492 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bcaf25-463f-4bb3-b8d7-8943d4a67aa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:33.762770 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bcaf25-463f-4bb3-b8d7-8943d4a67aa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:33.780822 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bcaf25-463f-4bb3-b8d7-8943d4a67aa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:33.786144 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bcaf25-463f-4bb3-b8d7-8943d4a67aa0 service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:33.805861 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1158/2296] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:30:33 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:30:33.854668 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb958c-82a3-42f7-933c-5ac16b41ca6b None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:33.940236 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:33.960873 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb958c-82a3-42f7-933c-5ac16b41ca6b None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:33.971978 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f93bc-7635-4c5b-8548-986be072bb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:33.972979 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f93bc-7635-4c5b-8548-986be072bb12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:33.973320 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f93bc-7635-4c5b-8548-986be072bb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:33.973607 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f93bc-7635-4c5b-8548-986be072bb12 admin admin] PATH_INFO: `/v3/users/79909a830627438a8ebd558c08e24c62` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:33.974805 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f93bc-7635-4c5b-8548-986be072bb12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79909a830627438a8ebd558c08e24c62)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:33.976936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f93bc-7635-4c5b-8548-986be072bb12 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:34.439011 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-0d2f93bc-7635-4c5b-8548-986be072bb12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79909a830627438a8ebd558c08e24c62'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:34.618302 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-0d2f93bc-7635-4c5b-8548-986be072bb12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79909a830627438a8ebd558c08e24c62'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:34.619069 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-0d2f93bc-7635-4c5b-8548-986be072bb12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79909a830627438a8ebd558c08e24c62'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:34.619868 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-0d2f93bc-7635-4c5b-8548-986be072bb12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79909a830627438a8ebd558c08e24c62'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:34.649734 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-0d2f93bc-7635-4c5b-8548-986be072bb12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79909a830627438a8ebd558c08e24c62'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:34.677756 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1139/2297] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:30:33 2022] DELETE /identity/v3/users/79909a830627438a8ebd558c08e24c62 => generated 0 bytes in 824 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:34.682851 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265441b-ae97-47a3-8ec7-6707c99f65a3 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:34.684026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265441b-ae97-47a3-8ec7-6707c99f65a3 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:34.684369 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265441b-ae97-47a3-8ec7-6707c99f65a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:34.707413 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-2265441b-ae97-47a3-8ec7-6707c99f65a3 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:34.708911 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-2265441b-ae97-47a3-8ec7-6707c99f65a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:34.734280 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:34.818487 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1159/2298] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:30:34.819348 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f93bc-7635-4c5b-8548-986be072bb12 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:34.821760 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-0d2f93bc-7635-4c5b-8548-986be072bb12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:34.929499 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f93bc-7635-4c5b-8548-986be072bb12 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:34.934350 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fdf954-7d85-4419-8f19-4fcdd3a621c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:34.935100 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fdf954-7d85-4419-8f19-4fcdd3a621c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:34.935752 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fdf954-7d85-4419-8f19-4fcdd3a621c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:34.936135 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fdf954-7d85-4419-8f19-4fcdd3a621c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:34.953147 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fdf954-7d85-4419-8f19-4fcdd3a621c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:34.954894 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fdf954-7d85-4419-8f19-4fcdd3a621c8 service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:34.969719 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1140/2299] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:30:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:30:35.640293 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265441b-ae97-47a3-8ec7-6707c99f65a3 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:35.646316 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-2265441b-ae97-47a3-8ec7-6707c99f65a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:35.680518 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265441b-ae97-47a3-8ec7-6707c99f65a3 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:35.709753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c433494-d97f-4b67-8b13-1cfb82d6139b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:35.710427 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c433494-d97f-4b67-8b13-1cfb82d6139b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:35.710988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c433494-d97f-4b67-8b13-1cfb82d6139b admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:35.711401 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c433494-d97f-4b67-8b13-1cfb82d6139b admin admin] PATH_INFO: `/v3/projects/c14d1b8071a34a1586878d44c7b0aa0f` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:35.712744 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c433494-d97f-4b67-8b13-1cfb82d6139b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c14d1b8071a34a1586878d44c7b0aa0f)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:35.717589 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c433494-d97f-4b67-8b13-1cfb82d6139b admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:35.878677 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-8c433494-d97f-4b67-8b13-1cfb82d6139b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c14d1b8071a34a1586878d44c7b0aa0f', 'request_id': 'req-8c433494-d97f-4b67-8b13-1cfb82d6139b'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:35.886998 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-8c433494-d97f-4b67-8b13-1cfb82d6139b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c14d1b8071a34a1586878d44c7b0aa0f', 'request_id': 'req-8c433494-d97f-4b67-8b13-1cfb82d6139b'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:35.929092 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-8c433494-d97f-4b67-8b13-1cfb82d6139b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c14d1b8071a34a1586878d44c7b0aa0f', 'request_id': 'req-8c433494-d97f-4b67-8b13-1cfb82d6139b'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:36.053079 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-8c433494-d97f-4b67-8b13-1cfb82d6139b admin admin] The token cache is being invalidate because project c14d1b8071a34a1586878d44c7b0aa0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:30:36.054679 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-8c433494-d97f-4b67-8b13-1cfb82d6139b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:36.057109 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-8c433494-d97f-4b67-8b13-1cfb82d6139b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:36.060689 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1160/2300] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:30:35 2022] DELETE /identity/v3/projects/c14d1b8071a34a1586878d44c7b0aa0f => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:36.065833 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fdf954-7d85-4419-8f19-4fcdd3a621c8 service neutron] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:36.080601 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fdf954-7d85-4419-8f19-4fcdd3a621c8 service neutron] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:36.166175 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c857a-9459-4281-ac03-3d9c9ee6bbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:36.167048 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c857a-9459-4281-ac03-3d9c9ee6bbe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:36.167513 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c857a-9459-4281-ac03-3d9c9ee6bbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:36.167737 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c857a-9459-4281-ac03-3d9c9ee6bbe7 admin admin] PATH_INFO: `/v3/users/964afdfc95e5457ea03ba2cfd47a81ac` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:36.172459 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1c857a-9459-4281-ac03-3d9c9ee6bbe7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=964afdfc95e5457ea03ba2cfd47a81ac)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:36.176457 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1c857a-9459-4281-ac03-3d9c9ee6bbe7 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:36.199753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:36.818431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-1c1c857a-9459-4281-ac03-3d9c9ee6bbe7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '964afdfc95e5457ea03ba2cfd47a81ac'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:36.967390 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-1c1c857a-9459-4281-ac03-3d9c9ee6bbe7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '964afdfc95e5457ea03ba2cfd47a81ac'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:36.974326 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-1c1c857a-9459-4281-ac03-3d9c9ee6bbe7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '964afdfc95e5457ea03ba2cfd47a81ac'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:36.977192 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-1c1c857a-9459-4281-ac03-3d9c9ee6bbe7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '964afdfc95e5457ea03ba2cfd47a81ac'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:37.009350 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-1c1c857a-9459-4281-ac03-3d9c9ee6bbe7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '964afdfc95e5457ea03ba2cfd47a81ac'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:37.047057 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1141/2301] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:30:36 2022] DELETE /identity/v3/users/964afdfc95e5457ea03ba2cfd47a81ac => generated 0 bytes in 983 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:37.787896 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c433494-d97f-4b67-8b13-1cfb82d6139b admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:37.791713 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-8c433494-d97f-4b67-8b13-1cfb82d6139b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:37.851304 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c433494-d97f-4b67-8b13-1cfb82d6139b admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:38.019868 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97618bec-254e-48de-860e-0341fc26cb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:38.021217 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97618bec-254e-48de-860e-0341fc26cb38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:38.022571 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97618bec-254e-48de-860e-0341fc26cb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:38.023536 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97618bec-254e-48de-860e-0341fc26cb38 admin admin] PATH_INFO: `/v3/projects/c22f4e999a904f72a5c49cf79502ef3f` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:38.026401 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97618bec-254e-48de-860e-0341fc26cb38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c22f4e999a904f72a5c49cf79502ef3f)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:38.028111 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97618bec-254e-48de-860e-0341fc26cb38 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:38.306623 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:38.311803 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-97618bec-254e-48de-860e-0341fc26cb38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c22f4e999a904f72a5c49cf79502ef3f', 'request_id': 'req-97618bec-254e-48de-860e-0341fc26cb38'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:38.326935 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-97618bec-254e-48de-860e-0341fc26cb38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c22f4e999a904f72a5c49cf79502ef3f', 'request_id': 'req-97618bec-254e-48de-860e-0341fc26cb38'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:38.343290 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-97618bec-254e-48de-860e-0341fc26cb38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c22f4e999a904f72a5c49cf79502ef3f', 'request_id': 'req-97618bec-254e-48de-860e-0341fc26cb38'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:38.539603 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-97618bec-254e-48de-860e-0341fc26cb38 admin admin] The token cache is being invalidate because project c22f4e999a904f72a5c49cf79502ef3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:30:38.539603 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-97618bec-254e-48de-860e-0341fc26cb38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:38.539603 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-97618bec-254e-48de-860e-0341fc26cb38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:38.539603 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1161/2302] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:30:37 2022] DELETE /identity/v3/projects/c22f4e999a904f72a5c49cf79502ef3f => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:38.541292 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073c57c-a922-490e-9c46-5c736fba8439 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:38.541292 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073c57c-a922-490e-9c46-5c736fba8439 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:38.541292 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073c57c-a922-490e-9c46-5c736fba8439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:38.583261 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-6073c57c-a922-490e-9c46-5c736fba8439 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:38.584498 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-6073c57c-a922-490e-9c46-5c736fba8439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:38.740120 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1142/2303] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:30:38.748842 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ccce2-afa7-4169-9dff-1d3bde6fa656 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:38.751498 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ccce2-afa7-4169-9dff-1d3bde6fa656 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:38.751498 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ccce2-afa7-4169-9dff-1d3bde6fa656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:38.775750 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-a36ccce2-afa7-4169-9dff-1d3bde6fa656 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:38.778141 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-a36ccce2-afa7-4169-9dff-1d3bde6fa656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:38.800044 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073c57c-a922-490e-9c46-5c736fba8439 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:38.809090 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1162/2304] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:30:38.812999 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073c57c-a922-490e-9c46-5c736fba8439 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:38.823291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008c995-7342-46bf-96c3-9f351cc1cb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:38.824554 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008c995-7342-46bf-96c3-9f351cc1cb80 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:38.825689 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008c995-7342-46bf-96c3-9f351cc1cb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:38.826070 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008c995-7342-46bf-96c3-9f351cc1cb80 admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:38.826677 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4008c995-7342-46bf-96c3-9f351cc1cb80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:30:38.830430 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4008c995-7342-46bf-96c3-9f351cc1cb80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:38.832598 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4008c995-7342-46bf-96c3-9f351cc1cb80 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:38.854686 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ccce2-afa7-4169-9dff-1d3bde6fa656 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:38.863729 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1143/2305] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:30:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:30:38.867723 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ccce2-afa7-4169-9dff-1d3bde6fa656 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:38.874085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b6e03-4ce8-48c3-8cda-84622accbac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:38.875415 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b6e03-4ce8-48c3-8cda-84622accbac6 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:38.875710 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b6e03-4ce8-48c3-8cda-84622accbac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:38.876026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b6e03-4ce8-48c3-8cda-84622accbac6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:38.877046 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b6e03-4ce8-48c3-8cda-84622accbac6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:38.879449 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b6e03-4ce8-48c3-8cda-84622accbac6 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:39.060297 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008c995-7342-46bf-96c3-9f351cc1cb80 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:39.072381 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1163/2306] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:30:38 2022] POST /identity/v3/projects => generated 383 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:30:39.074467 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008c995-7342-46bf-96c3-9f351cc1cb80 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:39.221370 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab08753-5959-4cf8-9c7f-0c4cc40bef79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:39.221994 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab08753-5959-4cf8-9c7f-0c4cc40bef79 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:39.222274 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab08753-5959-4cf8-9c7f-0c4cc40bef79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:39.222546 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab08753-5959-4cf8-9c7f-0c4cc40bef79 admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:39.223182 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab08753-5959-4cf8-9c7f-0c4cc40bef79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:39.225376 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab08753-5959-4cf8-9c7f-0c4cc40bef79 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:39.328459 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1144/2307] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:30:39 2022] POST /identity/v3/users => generated 292 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:30:39.331736 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b6e03-4ce8-48c3-8cda-84622accbac6 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:39.346574 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b6e03-4ce8-48c3-8cda-84622accbac6 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:39.351065 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ee0f8-295f-49d3-906b-e5eab78b815f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:39.352002 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ee0f8-295f-49d3-906b-e5eab78b815f admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:39.352287 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ee0f8-295f-49d3-906b-e5eab78b815f admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:39.353177 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ee0f8-295f-49d3-906b-e5eab78b815f admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:39.353658 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ee0f8-295f-49d3-906b-e5eab78b815f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:39.355327 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ee0f8-295f-49d3-906b-e5eab78b815f admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:39.374639 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1164/2308] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:30:39.381403 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab08753-5959-4cf8-9c7f-0c4cc40bef79 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:39.415304 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab08753-5959-4cf8-9c7f-0c4cc40bef79 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:39.436471 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d120fe4-6dd7-4da8-a841-60f4dd0a69db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:39.439099 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d120fe4-6dd7-4da8-a841-60f4dd0a69db admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:39.439435 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d120fe4-6dd7-4da8-a841-60f4dd0a69db admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:39.439769 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d120fe4-6dd7-4da8-a841-60f4dd0a69db admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:39.443698 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d120fe4-6dd7-4da8-a841-60f4dd0a69db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:39.447702 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d120fe4-6dd7-4da8-a841-60f4dd0a69db admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:39.452507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:39.487924 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1145/2309] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:30:39.492419 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ee0f8-295f-49d3-906b-e5eab78b815f admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:39.506527 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ee0f8-295f-49d3-906b-e5eab78b815f admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:39.513187 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ba8e1-1229-47a0-b3da-cea2d56844e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:39.513951 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ba8e1-1229-47a0-b3da-cea2d56844e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:39.514229 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ba8e1-1229-47a0-b3da-cea2d56844e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:39.514773 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ba8e1-1229-47a0-b3da-cea2d56844e7 admin admin] PATH_INFO: `/v3/projects/e1694c32993048c2808cd0af17f0b898/users/c8c858a0b34841d884ee46a38d31aeed/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:39.550274 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ba8e1-1229-47a0-b3da-cea2d56844e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1694c32993048c2808cd0af17f0b898, user_id=c8c858a0b34841d884ee46a38d31aeed, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:39.553038 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ba8e1-1229-47a0-b3da-cea2d56844e7 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:39.799058 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1165/2310] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:30:39 2022] PUT /identity/v3/projects/e1694c32993048c2808cd0af17f0b898/users/c8c858a0b34841d884ee46a38d31aeed/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:30:39.812790 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762cc5f-f14a-44a2-ae46-4385f081f823 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:39.815713 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762cc5f-f14a-44a2-ae46-4385f081f823 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:39.816261 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762cc5f-f14a-44a2-ae46-4385f081f823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:39.866308 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-3762cc5f-f14a-44a2-ae46-4385f081f823 None None] MFA Rules not processed for user `c8c858a0b34841d884ee46a38d31aeed`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:39.868268 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-3762cc5f-f14a-44a2-ae46-4385f081f823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:40.024155 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1146/2311] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:30:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:30:40.025204 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ba8e1-1229-47a0-b3da-cea2d56844e7 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:40.136129 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ba8e1-1229-47a0-b3da-cea2d56844e7 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:40.145524 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ebfae8-35d5-412b-8a33-5ace94673cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:40.146159 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebfae8-35d5-412b-8a33-5ace94673cde admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:40.146450 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebfae8-35d5-412b-8a33-5ace94673cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:40.146825 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebfae8-35d5-412b-8a33-5ace94673cde admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:40.147546 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ebfae8-35d5-412b-8a33-5ace94673cde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:40.149582 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ebfae8-35d5-412b-8a33-5ace94673cde admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:40.273523 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1166/2312] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:30:40 2022] POST /identity/v3/projects => generated 381 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:30:40.281652 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762cc5f-f14a-44a2-ae46-4385f081f823 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:40.317448 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762cc5f-f14a-44a2-ae46-4385f081f823 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:40.425586 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ec563-31d0-4296-b87d-80fe201b236b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:40.425586 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ec563-31d0-4296-b87d-80fe201b236b admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:40.425908 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ec563-31d0-4296-b87d-80fe201b236b admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:40.426373 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ec563-31d0-4296-b87d-80fe201b236b admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:40.427035 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ec563-31d0-4296-b87d-80fe201b236b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:40.431104 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ec563-31d0-4296-b87d-80fe201b236b admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:40.590928 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1147/2313] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:30:40 2022] POST /identity/v3/users => generated 297 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:30:40.595492 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ebfae8-35d5-412b-8a33-5ace94673cde admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:40.606641 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ebfae8-35d5-412b-8a33-5ace94673cde admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:40.619957 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde18d6-f718-4dfb-8c5f-e0e5cf2b3c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:40.620679 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde18d6-f718-4dfb-8c5f-e0e5cf2b3c09 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:40.620964 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde18d6-f718-4dfb-8c5f-e0e5cf2b3c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:40.621279 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde18d6-f718-4dfb-8c5f-e0e5cf2b3c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:40.621916 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde18d6-f718-4dfb-8c5f-e0e5cf2b3c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:40.626365 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde18d6-f718-4dfb-8c5f-e0e5cf2b3c09 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:40.653032 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1167/2314] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:30:40.658852 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ec563-31d0-4296-b87d-80fe201b236b admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:40.672986 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ec563-31d0-4296-b87d-80fe201b236b admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:40.688704 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e8785-b6e5-4cc9-99fb-380800e17cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:40.689410 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e8785-b6e5-4cc9-99fb-380800e17cf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:40.689676 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e8785-b6e5-4cc9-99fb-380800e17cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:40.689952 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e8785-b6e5-4cc9-99fb-380800e17cf3 admin admin] PATH_INFO: `/v3/projects/94e42fc06ee341768abd27fa3f42d6e0/users/e94397a825cb46cfbee0abc28e1ac968/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:40.717898 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e8785-b6e5-4cc9-99fb-380800e17cf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94e42fc06ee341768abd27fa3f42d6e0, user_id=e94397a825cb46cfbee0abc28e1ac968, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:40.722630 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e8785-b6e5-4cc9-99fb-380800e17cf3 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:40.826929 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1148/2315] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:30:40 2022] PUT /identity/v3/projects/94e42fc06ee341768abd27fa3f42d6e0/users/e94397a825cb46cfbee0abc28e1ac968/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:40.830933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde18d6-f718-4dfb-8c5f-e0e5cf2b3c09 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:40.847658 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde18d6-f718-4dfb-8c5f-e0e5cf2b3c09 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:41.125704 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:41.137985 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff05238-8119-4c82-8485-43b2eaa64845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:41.138596 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff05238-8119-4c82-8485-43b2eaa64845 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:41.138880 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff05238-8119-4c82-8485-43b2eaa64845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:41.162686 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff05238-8119-4c82-8485-43b2eaa64845 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:41.162686 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff05238-8119-4c82-8485-43b2eaa64845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:41.162686 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff05238-8119-4c82-8485-43b2eaa64845 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:41.162686 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1168/2316] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:30:41.165830 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e8785-b6e5-4cc9-99fb-380800e17cf3 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:41.180493 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e8785-b6e5-4cc9-99fb-380800e17cf3 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:41.187944 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c4a41-aa0e-4563-ba51-872ec05eaf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:41.188620 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c4a41-aa0e-4563-ba51-872ec05eaf8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:41.188901 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c4a41-aa0e-4563-ba51-872ec05eaf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:41.189187 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c4a41-aa0e-4563-ba51-872ec05eaf8d admin admin] PATH_INFO: `/v3/projects/94e42fc06ee341768abd27fa3f42d6e0/users/e94397a825cb46cfbee0abc28e1ac968/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:41.191106 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c4a41-aa0e-4563-ba51-872ec05eaf8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=94e42fc06ee341768abd27fa3f42d6e0, user_id=e94397a825cb46cfbee0abc28e1ac968, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:41.193960 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c4a41-aa0e-4563-ba51-872ec05eaf8d admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:41.205352 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1149/2317] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:30:41 2022] PUT /identity/v3/projects/94e42fc06ee341768abd27fa3f42d6e0/users/e94397a825cb46cfbee0abc28e1ac968/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:41.217466 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68643c-9043-4ef1-b4db-fb30a4cf2887 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:41.217695 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68643c-9043-4ef1-b4db-fb30a4cf2887 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:41.217975 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68643c-9043-4ef1-b4db-fb30a4cf2887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:41.249077 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-4b68643c-9043-4ef1-b4db-fb30a4cf2887 None None] MFA Rules not processed for user `e94397a825cb46cfbee0abc28e1ac968`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:41.250366 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-4b68643c-9043-4ef1-b4db-fb30a4cf2887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:41.332507 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1169/2318] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:30:41 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:30:41.349250 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c4a41-aa0e-4563-ba51-872ec05eaf8d admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:41.351005 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-1d7c4a41-aa0e-4563-ba51-872ec05eaf8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:41.409277 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:41.432124 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c4a41-aa0e-4563-ba51-872ec05eaf8d admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:41.435954 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5729c-098a-493d-b6bb-91bdc7369c82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:41.436562 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5729c-098a-493d-b6bb-91bdc7369c82 service cinder] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:41.436848 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5729c-098a-493d-b6bb-91bdc7369c82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:41.437128 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5729c-098a-493d-b6bb-91bdc7369c82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:41.459753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5729c-098a-493d-b6bb-91bdc7369c82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:41.459753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5729c-098a-493d-b6bb-91bdc7369c82 service cinder] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:41.459753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1150/2319] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:30:41 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:30:41.584256 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68643c-9043-4ef1-b4db-fb30a4cf2887 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:41.585729 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-4b68643c-9043-4ef1-b4db-fb30a4cf2887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:41.598206 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68643c-9043-4ef1-b4db-fb30a4cf2887 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:41.601755 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e43324-06b4-4da2-a0e7-5efe12d4eea3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:41.602344 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e43324-06b4-4da2-a0e7-5efe12d4eea3 service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:41.602669 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e43324-06b4-4da2-a0e7-5efe12d4eea3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:41.602941 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e43324-06b4-4da2-a0e7-5efe12d4eea3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:41.666836 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e43324-06b4-4da2-a0e7-5efe12d4eea3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:41.668972 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e43324-06b4-4da2-a0e7-5efe12d4eea3 service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:41.678814 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1170/2320] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:30:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:30:43.835390 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5729c-098a-493d-b6bb-91bdc7369c82 service cinder] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:43.837223 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-83c5729c-098a-493d-b6bb-91bdc7369c82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:43.901019 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5729c-098a-493d-b6bb-91bdc7369c82 service cinder] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:43.905235 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1982ac-b469-4caf-a0d0-835424724e1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:43.905841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1982ac-b469-4caf-a0d0-835424724e1c service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:43.906120 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1982ac-b469-4caf-a0d0-835424724e1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:43.906399 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1982ac-b469-4caf-a0d0-835424724e1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:43.908162 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-4d1982ac-b469-4caf-a0d0-835424724e1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:43.918327 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1982ac-b469-4caf-a0d0-835424724e1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:43.919559 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1982ac-b469-4caf-a0d0-835424724e1c service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:43.928329 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1151/2321] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:30:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:30:45.001996 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e43324-06b4-4da2-a0e7-5efe12d4eea3 service cinder] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:45.003517 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-a9e43324-06b4-4da2-a0e7-5efe12d4eea3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:45.075095 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:45.079489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e43324-06b4-4da2-a0e7-5efe12d4eea3 service cinder] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:45.084835 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834d09f-c749-4538-a704-57a5f74ac09f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:45.085433 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834d09f-c749-4538-a704-57a5f74ac09f service nova] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:45.085713 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834d09f-c749-4538-a704-57a5f74ac09f service nova] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:45.086243 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834d09f-c749-4538-a704-57a5f74ac09f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:45.087974 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-5834d09f-c749-4538-a704-57a5f74ac09f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:45.142944 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834d09f-c749-4538-a704-57a5f74ac09f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:45.144470 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834d09f-c749-4538-a704-57a5f74ac09f service nova] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:45.153723 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1171/2322] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:30:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:30:45.507164 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1982ac-b469-4caf-a0d0-835424724e1c service neutron] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:45.574991 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834d09f-c749-4538-a704-57a5f74ac09f service nova] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:45.580187 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1982ac-b469-4caf-a0d0-835424724e1c service neutron] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:45.584838 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2fff8-dae0-45cc-8ec3-d68bb5394e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:45.588753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834d09f-c749-4538-a704-57a5f74ac09f service nova] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:45.588864 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2fff8-dae0-45cc-8ec3-d68bb5394e54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:45.588864 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2fff8-dae0-45cc-8ec3-d68bb5394e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:45.588864 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2fff8-dae0-45cc-8ec3-d68bb5394e54 admin admin] PATH_INFO: `/v3/users/c8c858a0b34841d884ee46a38d31aeed` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:45.588864 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2fff8-dae0-45cc-8ec3-d68bb5394e54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8c858a0b34841d884ee46a38d31aeed)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:45.589227 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab07cf2-faa0-49b1-8240-18e1a01b9fa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:45.589337 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2fff8-dae0-45cc-8ec3-d68bb5394e54 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:45.589796 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab07cf2-faa0-49b1-8240-18e1a01b9fa7 service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:45.590074 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab07cf2-faa0-49b1-8240-18e1a01b9fa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:45.590346 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab07cf2-faa0-49b1-8240-18e1a01b9fa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:45.592229 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-bab07cf2-faa0-49b1-8240-18e1a01b9fa7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:45.604098 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab07cf2-faa0-49b1-8240-18e1a01b9fa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:45.606102 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab07cf2-faa0-49b1-8240-18e1a01b9fa7 service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:45.615953 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1172/2323] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:30:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:30:45.774686 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-cea2fff8-dae0-45cc-8ec3-d68bb5394e54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8c858a0b34841d884ee46a38d31aeed'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:45.841649 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-cea2fff8-dae0-45cc-8ec3-d68bb5394e54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8c858a0b34841d884ee46a38d31aeed'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:45.842508 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-cea2fff8-dae0-45cc-8ec3-d68bb5394e54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8c858a0b34841d884ee46a38d31aeed'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:45.843118 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-cea2fff8-dae0-45cc-8ec3-d68bb5394e54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8c858a0b34841d884ee46a38d31aeed'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:45.859296 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-cea2fff8-dae0-45cc-8ec3-d68bb5394e54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8c858a0b34841d884ee46a38d31aeed'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:45.874942 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1152/2324] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:30:45 2022] DELETE /identity/v3/users/c8c858a0b34841d884ee46a38d31aeed => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:45.879718 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d3cc6-f956-4963-b6c3-67ad67e967dd None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:45.880128 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d3cc6-f956-4963-b6c3-67ad67e967dd None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:45.880497 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d3cc6-f956-4963-b6c3-67ad67e967dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:45.899595 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-0d2d3cc6-f956-4963-b6c3-67ad67e967dd None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:45.900791 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-0d2d3cc6-f956-4963-b6c3-67ad67e967dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:45.963012 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1173/2325] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:30:45.973544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2fff8-dae0-45cc-8ec3-d68bb5394e54 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:45.979452 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-cea2fff8-dae0-45cc-8ec3-d68bb5394e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:45.982514 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:46.033069 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2fff8-dae0-45cc-8ec3-d68bb5394e54 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:46.036820 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e64f5-8999-4a94-b764-ef8a009faf45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:46.037419 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e64f5-8999-4a94-b764-ef8a009faf45 service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:46.039438 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e64f5-8999-4a94-b764-ef8a009faf45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:46.039438 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e64f5-8999-4a94-b764-ef8a009faf45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:46.047585 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e64f5-8999-4a94-b764-ef8a009faf45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:46.049008 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e64f5-8999-4a94-b764-ef8a009faf45 service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:46.071583 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1153/2326] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:30:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:30:46.569076 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d3cc6-f956-4963-b6c3-67ad67e967dd None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:46.570525 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-0d2d3cc6-f956-4963-b6c3-67ad67e967dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:46.582945 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d3cc6-f956-4963-b6c3-67ad67e967dd None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:46.588494 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012187a0-f184-4be5-9d98-6121958a5bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:46.589981 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012187a0-f184-4be5-9d98-6121958a5bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:46.594136 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012187a0-f184-4be5-9d98-6121958a5bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:46.594136 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012187a0-f184-4be5-9d98-6121958a5bbf admin admin] PATH_INFO: `/v3/projects/e1694c32993048c2808cd0af17f0b898` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:46.594136 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012187a0-f184-4be5-9d98-6121958a5bbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1694c32993048c2808cd0af17f0b898)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:46.594947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012187a0-f184-4be5-9d98-6121958a5bbf admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:46.741903 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-012187a0-f184-4be5-9d98-6121958a5bbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1694c32993048c2808cd0af17f0b898', 'request_id': 'req-012187a0-f184-4be5-9d98-6121958a5bbf'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:46.748691 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-012187a0-f184-4be5-9d98-6121958a5bbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1694c32993048c2808cd0af17f0b898', 'request_id': 'req-012187a0-f184-4be5-9d98-6121958a5bbf'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:46.755664 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-012187a0-f184-4be5-9d98-6121958a5bbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1694c32993048c2808cd0af17f0b898', 'request_id': 'req-012187a0-f184-4be5-9d98-6121958a5bbf'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:46.828973 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-012187a0-f184-4be5-9d98-6121958a5bbf admin admin] The token cache is being invalidate because project e1694c32993048c2808cd0af17f0b898 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:30:46.829418 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-012187a0-f184-4be5-9d98-6121958a5bbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:46.830332 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-012187a0-f184-4be5-9d98-6121958a5bbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:46.834752 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1174/2327] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:30:46 2022] DELETE /identity/v3/projects/e1694c32993048c2808cd0af17f0b898 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:46.839231 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e64f5-8999-4a94-b764-ef8a009faf45 service neutron] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:46.850766 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e64f5-8999-4a94-b764-ef8a009faf45 service neutron] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:46.924966 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e9b88-abf5-4b63-ba8d-9514630cb820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:46.925692 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e9b88-abf5-4b63-ba8d-9514630cb820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:46.926126 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e9b88-abf5-4b63-ba8d-9514630cb820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:46.926766 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e9b88-abf5-4b63-ba8d-9514630cb820 admin admin] PATH_INFO: `/v3/users/e94397a825cb46cfbee0abc28e1ac968` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:46.928747 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e9b88-abf5-4b63-ba8d-9514630cb820 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e94397a825cb46cfbee0abc28e1ac968)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:46.930135 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e9b88-abf5-4b63-ba8d-9514630cb820 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:47.131146 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-b54e9b88-abf5-4b63-ba8d-9514630cb820 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e94397a825cb46cfbee0abc28e1ac968'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:47.216024 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-b54e9b88-abf5-4b63-ba8d-9514630cb820 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e94397a825cb46cfbee0abc28e1ac968'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:47.216720 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-b54e9b88-abf5-4b63-ba8d-9514630cb820 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e94397a825cb46cfbee0abc28e1ac968'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:47.217356 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-b54e9b88-abf5-4b63-ba8d-9514630cb820 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e94397a825cb46cfbee0abc28e1ac968'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:47.238688 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-b54e9b88-abf5-4b63-ba8d-9514630cb820 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e94397a825cb46cfbee0abc28e1ac968'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:47.263458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1154/2328] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:30:46 2022] DELETE /identity/v3/users/e94397a825cb46cfbee0abc28e1ac968 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:47.820997 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012187a0-f184-4be5-9d98-6121958a5bbf admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:47.820997 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-012187a0-f184-4be5-9d98-6121958a5bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:47.837192 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012187a0-f184-4be5-9d98-6121958a5bbf admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:47.858561 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:47.979386 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad012b94-1fd0-4b76-b3b9-e03d70b70c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:47.981976 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad012b94-1fd0-4b76-b3b9-e03d70b70c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:47.981976 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad012b94-1fd0-4b76-b3b9-e03d70b70c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:47.981976 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad012b94-1fd0-4b76-b3b9-e03d70b70c5f admin admin] PATH_INFO: `/v3/projects/94e42fc06ee341768abd27fa3f42d6e0` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:47.981976 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad012b94-1fd0-4b76-b3b9-e03d70b70c5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=94e42fc06ee341768abd27fa3f42d6e0)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:47.983907 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad012b94-1fd0-4b76-b3b9-e03d70b70c5f admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:48.130549 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-ad012b94-1fd0-4b76-b3b9-e03d70b70c5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94e42fc06ee341768abd27fa3f42d6e0', 'request_id': 'req-ad012b94-1fd0-4b76-b3b9-e03d70b70c5f'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:48.136797 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-ad012b94-1fd0-4b76-b3b9-e03d70b70c5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94e42fc06ee341768abd27fa3f42d6e0', 'request_id': 'req-ad012b94-1fd0-4b76-b3b9-e03d70b70c5f'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:48.143273 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-ad012b94-1fd0-4b76-b3b9-e03d70b70c5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94e42fc06ee341768abd27fa3f42d6e0', 'request_id': 'req-ad012b94-1fd0-4b76-b3b9-e03d70b70c5f'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:48.242248 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-ad012b94-1fd0-4b76-b3b9-e03d70b70c5f admin admin] The token cache is being invalidate because project 94e42fc06ee341768abd27fa3f42d6e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:30:48.242542 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-ad012b94-1fd0-4b76-b3b9-e03d70b70c5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:48.243403 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-ad012b94-1fd0-4b76-b3b9-e03d70b70c5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:48.245907 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1175/2329] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:30:47 2022] DELETE /identity/v3/projects/94e42fc06ee341768abd27fa3f42d6e0 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:48.250746 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4756053-ca25-4873-ab4b-876447285808 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:48.251232 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4756053-ca25-4873-ab4b-876447285808 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:48.251569 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4756053-ca25-4873-ab4b-876447285808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:48.273809 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-a4756053-ca25-4873-ab4b-876447285808 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:48.275151 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-a4756053-ca25-4873-ab4b-876447285808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:48.296778 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:48.338547 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1155/2330] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:30:48.345744 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa4844-ce8d-4c4a-b2db-691e20d43775 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:48.346061 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa4844-ce8d-4c4a-b2db-691e20d43775 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:48.346383 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa4844-ce8d-4c4a-b2db-691e20d43775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:48.366319 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-6ffa4844-ce8d-4c4a-b2db-691e20d43775 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:48.367649 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-6ffa4844-ce8d-4c4a-b2db-691e20d43775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:48.378237 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1176/2331] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:30:48.382229 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4756053-ca25-4873-ab4b-876447285808 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:48.393309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4756053-ca25-4873-ab4b-876447285808 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:48.397983 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece2b49-9565-4d2e-8f4f-f75c4110571a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:48.398622 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece2b49-9565-4d2e-8f4f-f75c4110571a admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:48.398902 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece2b49-9565-4d2e-8f4f-f75c4110571a admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:48.399177 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece2b49-9565-4d2e-8f4f-f75c4110571a admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:48.399863 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece2b49-9565-4d2e-8f4f-f75c4110571a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:30:48.405649 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece2b49-9565-4d2e-8f4f-f75c4110571a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:48.405649 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece2b49-9565-4d2e-8f4f-f75c4110571a admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:48.413797 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1156/2332] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:30:48.418258 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa4844-ce8d-4c4a-b2db-691e20d43775 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:48.427952 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa4844-ce8d-4c4a-b2db-691e20d43775 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:48.440158 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1978367-bca2-4666-9986-d1bc5dce2152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:48.440158 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1978367-bca2-4666-9986-d1bc5dce2152 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:48.440158 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1978367-bca2-4666-9986-d1bc5dce2152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:48.440158 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1978367-bca2-4666-9986-d1bc5dce2152 admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:48.440648 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1978367-bca2-4666-9986-d1bc5dce2152 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:48.440648 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1978367-bca2-4666-9986-d1bc5dce2152 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:48.534577 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1177/2333] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:30:48 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:30:48.538534 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece2b49-9565-4d2e-8f4f-f75c4110571a admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:48.553905 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece2b49-9565-4d2e-8f4f-f75c4110571a admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:48.611561 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcd3e5-ff92-4e68-bd55-bddce5b12039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:48.612613 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcd3e5-ff92-4e68-bd55-bddce5b12039 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:48.612902 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcd3e5-ff92-4e68-bd55-bddce5b12039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:48.613178 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcd3e5-ff92-4e68-bd55-bddce5b12039 admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:48.613818 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bcd3e5-ff92-4e68-bd55-bddce5b12039 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:48.615876 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bcd3e5-ff92-4e68-bd55-bddce5b12039 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:48.721340 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1157/2334] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:30:48 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:30:48.725361 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1978367-bca2-4666-9986-d1bc5dce2152 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:48.736373 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1978367-bca2-4666-9986-d1bc5dce2152 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:48.741058 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84f007-533d-4680-8d77-1a48ecb6807d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:48.741648 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84f007-533d-4680-8d77-1a48ecb6807d admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:48.741934 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84f007-533d-4680-8d77-1a48ecb6807d admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:48.742210 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84f007-533d-4680-8d77-1a48ecb6807d admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:48.742847 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a84f007-533d-4680-8d77-1a48ecb6807d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:48.745476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a84f007-533d-4680-8d77-1a48ecb6807d admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:48.759845 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1178/2335] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:30:48.762010 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcd3e5-ff92-4e68-bd55-bddce5b12039 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:48.774028 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcd3e5-ff92-4e68-bd55-bddce5b12039 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:48.781138 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442cefe-48b1-4d0c-b0a5-6e5889541519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:48.781845 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442cefe-48b1-4d0c-b0a5-6e5889541519 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:48.782134 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442cefe-48b1-4d0c-b0a5-6e5889541519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:48.782466 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442cefe-48b1-4d0c-b0a5-6e5889541519 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:48.783131 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442cefe-48b1-4d0c-b0a5-6e5889541519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:48.784910 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442cefe-48b1-4d0c-b0a5-6e5889541519 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:48.804253 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84f007-533d-4680-8d77-1a48ecb6807d admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:48.804893 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1158/2336] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:30:48.835782 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84f007-533d-4680-8d77-1a48ecb6807d admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:48.842924 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f146a6-7da9-49d0-a043-ee372560bbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:48.843623 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f146a6-7da9-49d0-a043-ee372560bbc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:48.843957 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f146a6-7da9-49d0-a043-ee372560bbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:48.844239 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f146a6-7da9-49d0-a043-ee372560bbc9 admin admin] PATH_INFO: `/v3/projects/8bbf29779b4f42e8ab29aa39199738eb/users/0a6a84fc7d5641d9a66cf33aeaf4a6e3/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:48.863066 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f146a6-7da9-49d0-a043-ee372560bbc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bbf29779b4f42e8ab29aa39199738eb, user_id=0a6a84fc7d5641d9a66cf33aeaf4a6e3, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:48.865864 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f146a6-7da9-49d0-a043-ee372560bbc9 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:48.956618 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1179/2337] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:30:48 2022] PUT /identity/v3/projects/8bbf29779b4f42e8ab29aa39199738eb/users/0a6a84fc7d5641d9a66cf33aeaf4a6e3/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:48.968040 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a4540-a56f-47a1-bc80-9fe53b3f84d2 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:48.968330 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a4540-a56f-47a1-bc80-9fe53b3f84d2 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:48.968611 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a4540-a56f-47a1-bc80-9fe53b3f84d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:49.029596 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-af8a4540-a56f-47a1-bc80-9fe53b3f84d2 None None] MFA Rules not processed for user `0a6a84fc7d5641d9a66cf33aeaf4a6e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:49.031417 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-af8a4540-a56f-47a1-bc80-9fe53b3f84d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:49.155931 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1159/2338] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:30:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:30:49.157216 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f146a6-7da9-49d0-a043-ee372560bbc9 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:49.227614 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:49.253818 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f146a6-7da9-49d0-a043-ee372560bbc9 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:49.258763 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205cb1d2-1b48-4887-808c-63a16e9f5310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:49.259476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205cb1d2-1b48-4887-808c-63a16e9f5310 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:49.259838 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205cb1d2-1b48-4887-808c-63a16e9f5310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:49.260284 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205cb1d2-1b48-4887-808c-63a16e9f5310 admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:49.261001 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205cb1d2-1b48-4887-808c-63a16e9f5310 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:49.262949 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205cb1d2-1b48-4887-808c-63a16e9f5310 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:49.407805 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1180/2339] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:30:49 2022] POST /identity/v3/projects => generated 381 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:30:49.411939 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a4540-a56f-47a1-bc80-9fe53b3f84d2 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:49.432720 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a4540-a56f-47a1-bc80-9fe53b3f84d2 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:49.513888 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bcf573-f058-4e48-ab47-de4727137398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:49.518262 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bcf573-f058-4e48-ab47-de4727137398 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:49.518262 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bcf573-f058-4e48-ab47-de4727137398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:49.518262 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bcf573-f058-4e48-ab47-de4727137398 admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:49.518262 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bcf573-f058-4e48-ab47-de4727137398 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:49.518262 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bcf573-f058-4e48-ab47-de4727137398 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:49.675334 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1160/2340] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:30:49 2022] POST /identity/v3/users => generated 297 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:30:49.679695 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205cb1d2-1b48-4887-808c-63a16e9f5310 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:49.697610 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205cb1d2-1b48-4887-808c-63a16e9f5310 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:49.702793 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962cb98-8fe8-457d-ad9e-021e4d2df65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:49.708837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962cb98-8fe8-457d-ad9e-021e4d2df65d admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:49.708837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962cb98-8fe8-457d-ad9e-021e4d2df65d admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:49.708837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962cb98-8fe8-457d-ad9e-021e4d2df65d admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:49.708837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962cb98-8fe8-457d-ad9e-021e4d2df65d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:49.708837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962cb98-8fe8-457d-ad9e-021e4d2df65d admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:49.716999 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1181/2341] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:30:49.721381 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bcf573-f058-4e48-ab47-de4727137398 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:49.731557 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bcf573-f058-4e48-ab47-de4727137398 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:49.743712 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb16ca-2a04-4964-b634-7bbf67c507f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:49.743712 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb16ca-2a04-4964-b634-7bbf67c507f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:49.743712 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb16ca-2a04-4964-b634-7bbf67c507f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:49.743712 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb16ca-2a04-4964-b634-7bbf67c507f6 admin admin] PATH_INFO: `/v3/projects/7bea5aa502144727ad3115edd2c1b794/users/814a1b9542c249f594c53d9b8a574e2c/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:49.747595 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962cb98-8fe8-457d-ad9e-021e4d2df65d admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:49.749656 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-8962cb98-8fe8-457d-ad9e-021e4d2df65d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:49.753291 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb16ca-2a04-4964-b634-7bbf67c507f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bea5aa502144727ad3115edd2c1b794, user_id=814a1b9542c249f594c53d9b8a574e2c, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:49.756012 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb16ca-2a04-4964-b634-7bbf67c507f6 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:49.763730 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962cb98-8fe8-457d-ad9e-021e4d2df65d admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:49.766903 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:49.768368 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf446e-13db-400e-a55a-8818d9244b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:49.768984 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf446e-13db-400e-a55a-8818d9244b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:49.769267 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf446e-13db-400e-a55a-8818d9244b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:49.769540 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf446e-13db-400e-a55a-8818d9244b07 admin admin] PATH_INFO: `/v3/users/9222455cb9e047ab8b667b156c6f1f73` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:49.770641 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf446e-13db-400e-a55a-8818d9244b07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9222455cb9e047ab8b667b156c6f1f73)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:49.772575 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf446e-13db-400e-a55a-8818d9244b07 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:49.864009 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1161/2342] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:30:49 2022] PUT /identity/v3/projects/7bea5aa502144727ad3115edd2c1b794/users/814a1b9542c249f594c53d9b8a574e2c/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:49.867801 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb16ca-2a04-4964-b634-7bbf67c507f6 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:49.927101 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb16ca-2a04-4964-b634-7bbf67c507f6 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:49.931739 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0f11f-a357-4fbb-82dd-e8b7e1c57d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:49.932358 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0f11f-a357-4fbb-82dd-e8b7e1c57d68 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:49.932638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0f11f-a357-4fbb-82dd-e8b7e1c57d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:49.933428 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0f11f-a357-4fbb-82dd-e8b7e1c57d68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:49.934056 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac0f11f-a357-4fbb-82dd-e8b7e1c57d68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:49.935638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac0f11f-a357-4fbb-82dd-e8b7e1c57d68 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:49.945436 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1162/2343] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:30:49.949961 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0f11f-a357-4fbb-82dd-e8b7e1c57d68 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:49.960880 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0f11f-a357-4fbb-82dd-e8b7e1c57d68 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:49.965841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d5684-8c32-4ff4-84c9-cb2a46ba82ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:49.966494 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d5684-8c32-4ff4-84c9-cb2a46ba82ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:49.966780 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d5684-8c32-4ff4-84c9-cb2a46ba82ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:49.967057 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d5684-8c32-4ff4-84c9-cb2a46ba82ef admin admin] PATH_INFO: `/v3/projects/7bea5aa502144727ad3115edd2c1b794/users/814a1b9542c249f594c53d9b8a574e2c/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:49.969592 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d5684-8c32-4ff4-84c9-cb2a46ba82ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bea5aa502144727ad3115edd2c1b794, user_id=814a1b9542c249f594c53d9b8a574e2c, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:49.972469 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d5684-8c32-4ff4-84c9-cb2a46ba82ef admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:49.984255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1163/2344] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:30:49 2022] PUT /identity/v3/projects/7bea5aa502144727ad3115edd2c1b794/users/814a1b9542c249f594c53d9b8a574e2c/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:30:49.996495 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08045bb-8bee-4d36-9a7d-442fdfe02082 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:49.996778 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08045bb-8bee-4d36-9a7d-442fdfe02082 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:49.997059 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08045bb-8bee-4d36-9a7d-442fdfe02082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:50.022843 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-83cf446e-13db-400e-a55a-8818d9244b07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9222455cb9e047ab8b667b156c6f1f73'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:50.029469 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-e08045bb-8bee-4d36-9a7d-442fdfe02082 None None] MFA Rules not processed for user `814a1b9542c249f594c53d9b8a574e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:50.030675 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-e08045bb-8bee-4d36-9a7d-442fdfe02082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:50.100100 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1164/2345] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:30:49 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:30:50.104506 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08045bb-8bee-4d36-9a7d-442fdfe02082 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:50.106409 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-e08045bb-8bee-4d36-9a7d-442fdfe02082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:50.122010 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-83cf446e-13db-400e-a55a-8818d9244b07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9222455cb9e047ab8b667b156c6f1f73'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:50.123743 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-83cf446e-13db-400e-a55a-8818d9244b07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9222455cb9e047ab8b667b156c6f1f73'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:50.143076 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-83cf446e-13db-400e-a55a-8818d9244b07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9222455cb9e047ab8b667b156c6f1f73'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:50.150217 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-83cf446e-13db-400e-a55a-8818d9244b07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9222455cb9e047ab8b667b156c6f1f73'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:50.156446 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1182/2346] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:30:49 2022] DELETE /identity/v3/users/9222455cb9e047ab8b667b156c6f1f73 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:30:50.157435 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf446e-13db-400e-a55a-8818d9244b07 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:50.158747 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-83cf446e-13db-400e-a55a-8818d9244b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:50.194248 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08045bb-8bee-4d36-9a7d-442fdfe02082 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:50.259453 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872fb26f-a3ac-4472-984d-25e24196c5b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:50.259805 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf446e-13db-400e-a55a-8818d9244b07 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:50.260402 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fb26f-a3ac-4472-984d-25e24196c5b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:50.260899 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fb26f-a3ac-4472-984d-25e24196c5b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:50.261326 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fb26f-a3ac-4472-984d-25e24196c5b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:50.263580 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-872fb26f-a3ac-4472-984d-25e24196c5b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:50.268337 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a53dda-d6ab-4dd8-ab65-f560008bbdd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:50.269009 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a53dda-d6ab-4dd8-ab65-f560008bbdd0 service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:50.269442 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a53dda-d6ab-4dd8-ab65-f560008bbdd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:50.269886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a53dda-d6ab-4dd8-ab65-f560008bbdd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:50.273821 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-35a53dda-d6ab-4dd8-ab65-f560008bbdd0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:50.274367 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872fb26f-a3ac-4472-984d-25e24196c5b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:50.276016 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872fb26f-a3ac-4472-984d-25e24196c5b6 service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:50.285826 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1165/2347] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:30:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:30:50.363994 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a53dda-d6ab-4dd8-ab65-f560008bbdd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:50.365307 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a53dda-d6ab-4dd8-ab65-f560008bbdd0 service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:50.375704 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1183/2348] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:30:50 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:30:50.445837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:50.453028 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872fb26f-a3ac-4472-984d-25e24196c5b6 service neutron] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:50.454781 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-872fb26f-a3ac-4472-984d-25e24196c5b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:50.530565 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872fb26f-a3ac-4472-984d-25e24196c5b6 service neutron] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:50.543245 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd5e5e-dda7-44c3-a3b9-116729af5edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:50.544056 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd5e5e-dda7-44c3-a3b9-116729af5edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:50.544403 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd5e5e-dda7-44c3-a3b9-116729af5edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:50.544753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd5e5e-dda7-44c3-a3b9-116729af5edc admin admin] PATH_INFO: `/v3/projects/4ce20c1e75b64e41a8c5234a3a83f66c` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:50.545960 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd5e5e-dda7-44c3-a3b9-116729af5edc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ce20c1e75b64e41a8c5234a3a83f66c)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:50.548202 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd5e5e-dda7-44c3-a3b9-116729af5edc admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:50.550425 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a53dda-d6ab-4dd8-ab65-f560008bbdd0 service cinder] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:50.557206 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:50.571693 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a53dda-d6ab-4dd8-ab65-f560008bbdd0 service cinder] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:50.575342 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74142892-f7c8-401f-87bb-4fe196118b56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:50.576196 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74142892-f7c8-401f-87bb-4fe196118b56 service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:50.576478 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74142892-f7c8-401f-87bb-4fe196118b56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:50.576750 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74142892-f7c8-401f-87bb-4fe196118b56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:50.578525 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-74142892-f7c8-401f-87bb-4fe196118b56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:50.639487 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74142892-f7c8-401f-87bb-4fe196118b56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:50.640893 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74142892-f7c8-401f-87bb-4fe196118b56 service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:50.649642 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1184/2349] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:30:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:30:50.714015 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-71cd5e5e-dda7-44c3-a3b9-116729af5edc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ce20c1e75b64e41a8c5234a3a83f66c', 'request_id': 'req-71cd5e5e-dda7-44c3-a3b9-116729af5edc'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:50.721066 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-71cd5e5e-dda7-44c3-a3b9-116729af5edc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ce20c1e75b64e41a8c5234a3a83f66c', 'request_id': 'req-71cd5e5e-dda7-44c3-a3b9-116729af5edc'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:50.729312 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-71cd5e5e-dda7-44c3-a3b9-116729af5edc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ce20c1e75b64e41a8c5234a3a83f66c', 'request_id': 'req-71cd5e5e-dda7-44c3-a3b9-116729af5edc'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:50.807743 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-71cd5e5e-dda7-44c3-a3b9-116729af5edc admin admin] The token cache is being invalidate because project 4ce20c1e75b64e41a8c5234a3a83f66c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:30:50.807743 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-71cd5e5e-dda7-44c3-a3b9-116729af5edc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:50.807743 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-71cd5e5e-dda7-44c3-a3b9-116729af5edc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:50.807743 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1166/2350] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:30:50 2022] DELETE /identity/v3/projects/4ce20c1e75b64e41a8c5234a3a83f66c => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:50.808265 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fd2a0-ebb5-4b72-a82c-16c4429e9035 None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:50.808638 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fd2a0-ebb5-4b72-a82c-16c4429e9035 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:50.809123 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fd2a0-ebb5-4b72-a82c-16c4429e9035 None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:50.811572 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4dff8-028e-4ebd-8400-1ee4cb1e3e35 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:50.811764 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1185/2351] 10.222.0.23 () {54 vars in 921 bytes} [Mon Aug 8 02:30:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:30:50.812293 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4dff8-028e-4ebd-8400-1ee4cb1e3e35 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:50.812634 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4dff8-028e-4ebd-8400-1ee4cb1e3e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:50.818047 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4a6ad-f8ec-4c95-bcfc-52130dbfa73a None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:50.818402 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4a6ad-f8ec-4c95-bcfc-52130dbfa73a None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:50.818743 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4a6ad-f8ec-4c95-bcfc-52130dbfa73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:50.834840 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-67c4dff8-028e-4ebd-8400-1ee4cb1e3e35 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:50.836680 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-67c4dff8-028e-4ebd-8400-1ee4cb1e3e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:50.843114 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-2cd4a6ad-f8ec-4c95-bcfc-52130dbfa73a None None] MFA Rules not processed for user `5d89e0c7d62444e4b75d3f4da49b2bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:50.844653 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-2cd4a6ad-f8ec-4c95-bcfc-52130dbfa73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:50.918519 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1167/2352] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:30:50.924962 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2e74e-5ca6-4b31-bfb7-57c6d9390b7b None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:50.925278 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2e74e-5ca6-4b31-bfb7-57c6d9390b7b None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:50.925699 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2e74e-5ca6-4b31-bfb7-57c6d9390b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:50.936402 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:50.943570 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1186/2353] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Aug 8 02:30:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:30:50.949940 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-eea2e74e-5ca6-4b31-bfb7-57c6d9390b7b None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:50.951018 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-eea2e74e-5ca6-4b31-bfb7-57c6d9390b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:50.956459 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4a6ad-f8ec-4c95-bcfc-52130dbfa73a None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:50.958020 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-2cd4a6ad-f8ec-4c95-bcfc-52130dbfa73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:50.960578 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1168/2354] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:30:50.964655 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea2e74e-5ca6-4b31-bfb7-57c6d9390b7b None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:50.973620 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea2e74e-5ca6-4b31-bfb7-57c6d9390b7b None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:50.978270 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275f4eb0-faff-4f5d-8fa6-3c49540e63f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:50.978932 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f4eb0-faff-4f5d-8fa6-3c49540e63f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:50.979301 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f4eb0-faff-4f5d-8fa6-3c49540e63f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:50.980221 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f4eb0-faff-4f5d-8fa6-3c49540e63f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:50.980903 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275f4eb0-faff-4f5d-8fa6-3c49540e63f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:30:50.981279 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275f4eb0-faff-4f5d-8fa6-3c49540e63f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:50.982961 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275f4eb0-faff-4f5d-8fa6-3c49540e63f2 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:50.994586 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1169/2355] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:30:51.000179 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275f4eb0-faff-4f5d-8fa6-3c49540e63f2 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:51.009234 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275f4eb0-faff-4f5d-8fa6-3c49540e63f2 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:51.014012 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755af716-562e-495e-8e29-eca109a7b49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:51.014592 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755af716-562e-495e-8e29-eca109a7b49e admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:51.014876 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755af716-562e-495e-8e29-eca109a7b49e admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:51.015203 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755af716-562e-495e-8e29-eca109a7b49e admin admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:51.015858 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755af716-562e-495e-8e29-eca109a7b49e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:51.017735 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755af716-562e-495e-8e29-eca109a7b49e admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:51.021875 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4a6ad-f8ec-4c95-bcfc-52130dbfa73a None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:51.025591 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ab41b-0306-49e6-8968-7c981ab560ba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aae574170d6f4eb8ab70805d8b5f4f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:51.026171 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ab41b-0306-49e6-8968-7c981ab560ba service glance] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:51.026461 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ab41b-0306-49e6-8968-7c981ab560ba service glance] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:51.026762 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ab41b-0306-49e6-8968-7c981ab560ba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:51.037015 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ab41b-0306-49e6-8968-7c981ab560ba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:51.038422 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ab41b-0306-49e6-8968-7c981ab560ba service glance] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:51.049627 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1187/2356] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:30:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:30:51.170077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1170/2357] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:30:50 2022] POST /identity/v3/projects => generated 365 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:30:51.173900 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ab41b-0306-49e6-8968-7c981ab560ba service glance] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:51.184567 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ab41b-0306-49e6-8968-7c981ab560ba service glance] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:51.189801 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:51.242285 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2c5cf-7218-4eba-aeef-e3461c65443e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:51.242815 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2c5cf-7218-4eba-aeef-e3461c65443e admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:51.243100 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2c5cf-7218-4eba-aeef-e3461c65443e admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:51.243398 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2c5cf-7218-4eba-aeef-e3461c65443e admin admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:51.244020 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2c5cf-7218-4eba-aeef-e3461c65443e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:51.245932 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2c5cf-7218-4eba-aeef-e3461c65443e admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:51.272673 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755af716-562e-495e-8e29-eca109a7b49e admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:51.274492 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-755af716-562e-495e-8e29-eca109a7b49e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:51.287327 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755af716-562e-495e-8e29-eca109a7b49e admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:51.291996 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b060a4-e967-4ce6-9213-21f09b409cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:51.292654 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b060a4-e967-4ce6-9213-21f09b409cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:51.292929 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b060a4-e967-4ce6-9213-21f09b409cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:51.293198 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b060a4-e967-4ce6-9213-21f09b409cd7 admin admin] PATH_INFO: `/v3/users/0a6a84fc7d5641d9a66cf33aeaf4a6e3` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:51.294304 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b060a4-e967-4ce6-9213-21f09b409cd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a6a84fc7d5641d9a66cf33aeaf4a6e3)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:51.296491 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b060a4-e967-4ce6-9213-21f09b409cd7 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:51.395928 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1188/2358] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:30:51 2022] POST /identity/v3/users => generated 283 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:30:51.397202 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1f965-13c7-4d88-b032-c7cc76857d7a None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:51.398037 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1f965-13c7-4d88-b032-c7cc76857d7a None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:51.398037 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1f965-13c7-4d88-b032-c7cc76857d7a None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:51.399023 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1189/2359] 10.222.0.23 () {54 vars in 921 bytes} [Mon Aug 8 02:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:30:51.400366 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1f965-13c7-4d88-b032-c7cc76857d7a None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:51.415596 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1f965-13c7-4d88-b032-c7cc76857d7a None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:51.423040 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce954b6-2fb5-40d4-8ae4-ff0e5a73689e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:51.423753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce954b6-2fb5-40d4-8ae4-ff0e5a73689e admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:51.424038 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce954b6-2fb5-40d4-8ae4-ff0e5a73689e admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:51.424320 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce954b6-2fb5-40d4-8ae4-ff0e5a73689e admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:51.424964 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce954b6-2fb5-40d4-8ae4-ff0e5a73689e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:51.427738 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce954b6-2fb5-40d4-8ae4-ff0e5a73689e admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:51.441261 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1190/2360] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:30:51.443007 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d1aaa-efa1-4b9e-8190-8675f770be77 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:51.443300 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d1aaa-efa1-4b9e-8190-8675f770be77 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:51.443600 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d1aaa-efa1-4b9e-8190-8675f770be77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:51.463514 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-040d1aaa-efa1-4b9e-8190-8675f770be77 None None] MFA Rules not processed for user `fa4c5732acb844369140e8d970577f94`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:51.464733 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-040d1aaa-efa1-4b9e-8190-8675f770be77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:51.517641 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1191/2361] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Aug 8 02:30:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:30:51.519533 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d1aaa-efa1-4b9e-8190-8675f770be77 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:51.530435 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d1aaa-efa1-4b9e-8190-8675f770be77 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:51.535136 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af84eb-c5d8-46f3-9d22-0e6a8d68f5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:51.535761 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af84eb-c5d8-46f3-9d22-0e6a8d68f5d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:51.536056 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af84eb-c5d8-46f3-9d22-0e6a8d68f5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:51.536312 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af84eb-c5d8-46f3-9d22-0e6a8d68f5d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:51.536995 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af84eb-c5d8-46f3-9d22-0e6a8d68f5d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:51.538988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af84eb-c5d8-46f3-9d22-0e6a8d68f5d0 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:51.550144 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1192/2362] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:30:51.550911 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af84eb-c5d8-46f3-9d22-0e6a8d68f5d0 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:51.552538 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-62af84eb-c5d8-46f3-9d22-0e6a8d68f5d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:51.564427 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af84eb-c5d8-46f3-9d22-0e6a8d68f5d0 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:51.567948 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791e1ad-20cb-4276-80f2-9c1edab6163e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:51.568499 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791e1ad-20cb-4276-80f2-9c1edab6163e service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:51.568777 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791e1ad-20cb-4276-80f2-9c1edab6163e service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:51.569048 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791e1ad-20cb-4276-80f2-9c1edab6163e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:51.576132 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7791e1ad-20cb-4276-80f2-9c1edab6163e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:51.583482 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7791e1ad-20cb-4276-80f2-9c1edab6163e service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:51.585472 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1193/2363] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:30:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:30:51.588272 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791e1ad-20cb-4276-80f2-9c1edab6163e service neutron] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:51.601773 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791e1ad-20cb-4276-80f2-9c1edab6163e service neutron] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:51.606600 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd02f9f6-a445-48f3-93d5-98a600af711a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:51.607339 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02f9f6-a445-48f3-93d5-98a600af711a admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:51.607727 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02f9f6-a445-48f3-93d5-98a600af711a admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:51.608075 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02f9f6-a445-48f3-93d5-98a600af711a admin admin] PATH_INFO: `/v3/projects/2aa5c3da89944ac5adb2d5a96bf1eda8/users/8c0db05585764413b5cacb7fb4830611/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:51.628914 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd02f9f6-a445-48f3-93d5-98a600af711a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aa5c3da89944ac5adb2d5a96bf1eda8, user_id=8c0db05585764413b5cacb7fb4830611, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:51.631761 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd02f9f6-a445-48f3-93d5-98a600af711a admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:51.634916 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-b2b060a4-e967-4ce6-9213-21f09b409cd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a6a84fc7d5641d9a66cf33aeaf4a6e3'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:51.746830 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-b2b060a4-e967-4ce6-9213-21f09b409cd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a6a84fc7d5641d9a66cf33aeaf4a6e3'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:51.747642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-b2b060a4-e967-4ce6-9213-21f09b409cd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a6a84fc7d5641d9a66cf33aeaf4a6e3'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:51.748441 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-b2b060a4-e967-4ce6-9213-21f09b409cd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a6a84fc7d5641d9a66cf33aeaf4a6e3'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:51.751371 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1194/2364] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:30:51 2022] PUT /identity/v3/projects/2aa5c3da89944ac5adb2d5a96bf1eda8/users/8c0db05585764413b5cacb7fb4830611/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:51.760355 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ca82c-c869-4cc5-b6d9-5a52e1f913cb None None] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:51.760355 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ca82c-c869-4cc5-b6d9-5a52e1f913cb None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:51.760355 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ca82c-c869-4cc5-b6d9-5a52e1f913cb None None] PATH_INFO: `/` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:51.760355 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1195/2365] 10.222.0.23 () {54 vars in 921 bytes} [Mon Aug 8 02:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 02:30:51.762139 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558741b1-f8db-42c5-867b-2f36cb1e90cd None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:51.762429 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558741b1-f8db-42c5-867b-2f36cb1e90cd None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:51.762703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558741b1-f8db-42c5-867b-2f36cb1e90cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:51.773241 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-b2b060a4-e967-4ce6-9213-21f09b409cd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a6a84fc7d5641d9a66cf33aeaf4a6e3'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:51.783526 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1171/2366] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:30:51 2022] DELETE /identity/v3/users/0a6a84fc7d5641d9a66cf33aeaf4a6e3 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:51.787899 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ef199-6847-43a7-b39d-92f199bb2c87 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:51.788300 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ef199-6847-43a7-b39d-92f199bb2c87 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:51.788528 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ef199-6847-43a7-b39d-92f199bb2c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:51.795255 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-558741b1-f8db-42c5-867b-2f36cb1e90cd None None] MFA Rules not processed for user `8c0db05585764413b5cacb7fb4830611`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:51.796543 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-558741b1-f8db-42c5-867b-2f36cb1e90cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:51.811719 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-eb8ef199-6847-43a7-b39d-92f199bb2c87 None None] MFA Rules not processed for user `5d89e0c7d62444e4b75d3f4da49b2bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:51.818191 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-eb8ef199-6847-43a7-b39d-92f199bb2c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:51.829361 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=11 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:51.842618 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:51.876079 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1196/2367] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:30:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:30:51.877325 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3d3e8-63fd-460e-9a9d-bd277f8c456a None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:51.877649 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3d3e8-63fd-460e-9a9d-bd277f8c456a None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:51.877889 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3d3e8-63fd-460e-9a9d-bd277f8c456a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:51.896773 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-d2c3d3e8-63fd-460e-9a9d-bd277f8c456a None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:51.898209 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-d2c3d3e8-63fd-460e-9a9d-bd277f8c456a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:51.935753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1172/2368] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Aug 8 02:30:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:30:51.936692 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ef199-6847-43a7-b39d-92f199bb2c87 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:51.938107 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-eb8ef199-6847-43a7-b39d-92f199bb2c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:51.985907 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1197/2369] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:30:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:30:51.986982 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3d3e8-63fd-460e-9a9d-bd277f8c456a None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:51.988868 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-d2c3d3e8-63fd-460e-9a9d-bd277f8c456a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:52.016180 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ef199-6847-43a7-b39d-92f199bb2c87 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:52.022230 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931c593-70eb-4193-bd87-62ef8664ef4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:52.023650 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931c593-70eb-4193-bd87-62ef8664ef4a admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:52.023974 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931c593-70eb-4193-bd87-62ef8664ef4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:52.024337 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931c593-70eb-4193-bd87-62ef8664ef4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:52.025039 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931c593-70eb-4193-bd87-62ef8664ef4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:52.027544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931c593-70eb-4193-bd87-62ef8664ef4a admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:52.058924 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3d3e8-63fd-460e-9a9d-bd277f8c456a None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:52.062658 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59604b2-2f20-4155-a957-d9f6d38c66a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:52.063263 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59604b2-2f20-4155-a957-d9f6d38c66a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:52.063576 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59604b2-2f20-4155-a957-d9f6d38c66a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:52.063855 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59604b2-2f20-4155-a957-d9f6d38c66a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:52.073946 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59604b2-2f20-4155-a957-d9f6d38c66a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:52.075384 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59604b2-2f20-4155-a957-d9f6d38c66a9 service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:52.085963 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1198/2370] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:30:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:30:52.086995 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59604b2-2f20-4155-a957-d9f6d38c66a9 service neutron] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:52.095168 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59604b2-2f20-4155-a957-d9f6d38c66a9 service neutron] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:52.098861 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888a535-c0ed-4643-87ce-5c4dc6a231fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:52.099469 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888a535-c0ed-4643-87ce-5c4dc6a231fc service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:52.099826 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888a535-c0ed-4643-87ce-5c4dc6a231fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:52.100029 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888a535-c0ed-4643-87ce-5c4dc6a231fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:52.109741 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888a535-c0ed-4643-87ce-5c4dc6a231fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:52.111142 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888a535-c0ed-4643-87ce-5c4dc6a231fc service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:52.120857 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1199/2371] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:30:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:30:52.134613 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1173/2372] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:30:51 2022] POST /identity/v3/projects => generated 363 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:30:52.138554 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888a535-c0ed-4643-87ce-5c4dc6a231fc service neutron] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:52.148483 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888a535-c0ed-4643-87ce-5c4dc6a231fc service neutron] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:52.163816 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931c593-70eb-4193-bd87-62ef8664ef4a admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:52.168232 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-7931c593-70eb-4193-bd87-62ef8664ef4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:52.219048 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93447ed5-1ab8-4a3c-a4ac-14638d1f6c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:52.219715 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93447ed5-1ab8-4a3c-a4ac-14638d1f6c0f admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:52.219998 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93447ed5-1ab8-4a3c-a4ac-14638d1f6c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:52.220272 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93447ed5-1ab8-4a3c-a4ac-14638d1f6c0f admin admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:52.220900 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93447ed5-1ab8-4a3c-a4ac-14638d1f6c0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:52.222828 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93447ed5-1ab8-4a3c-a4ac-14638d1f6c0f admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:52.254278 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931c593-70eb-4193-bd87-62ef8664ef4a admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:52.259917 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc544c12-c419-43d6-966e-59eeef8563f2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43a39dd539974180a8165e34de57b552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:52.260617 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc544c12-c419-43d6-966e-59eeef8563f2 service placement] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:52.261007 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc544c12-c419-43d6-966e-59eeef8563f2 service placement] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:52.261351 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc544c12-c419-43d6-966e-59eeef8563f2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:52.263378 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-bc544c12-c419-43d6-966e-59eeef8563f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:52.275151 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc544c12-c419-43d6-966e-59eeef8563f2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:52.277394 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc544c12-c419-43d6-966e-59eeef8563f2 service placement] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:52.287285 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1174/2373] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:30:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:30:52.303110 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:52.312688 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1200/2374] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:30:52 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:30:52.313851 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc544c12-c419-43d6-966e-59eeef8563f2 service placement] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:52.325344 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc544c12-c419-43d6-966e-59eeef8563f2 service placement] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:52.332787 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98df81-5c89-42c4-a21a-c312939613ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:52.334936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98df81-5c89-42c4-a21a-c312939613ed admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:52.335239 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98df81-5c89-42c4-a21a-c312939613ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:52.335719 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98df81-5c89-42c4-a21a-c312939613ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:52.339928 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98df81-5c89-42c4-a21a-c312939613ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:52.339928 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98df81-5c89-42c4-a21a-c312939613ed admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:52.350972 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1175/2375] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:30:52.355344 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93447ed5-1ab8-4a3c-a4ac-14638d1f6c0f admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:52.368162 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93447ed5-1ab8-4a3c-a4ac-14638d1f6c0f admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:52.376813 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fb1a5-dcc5-4bf7-8cbb-74075c92eb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:52.376813 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fb1a5-dcc5-4bf7-8cbb-74075c92eb56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:52.376813 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fb1a5-dcc5-4bf7-8cbb-74075c92eb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:52.376813 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fb1a5-dcc5-4bf7-8cbb-74075c92eb56 admin admin] PATH_INFO: `/v3/projects/dee879f7cb10446d8035d93281c076c6/users/16b145b41b9d4b268a564e1c0b89d0ec/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:52.419238 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5fb1a5-dcc5-4bf7-8cbb-74075c92eb56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dee879f7cb10446d8035d93281c076c6, user_id=16b145b41b9d4b268a564e1c0b89d0ec, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:52.422339 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5fb1a5-dcc5-4bf7-8cbb-74075c92eb56 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:52.504711 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1201/2376] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:30:52 2022] PUT /identity/v3/projects/dee879f7cb10446d8035d93281c076c6/users/16b145b41b9d4b268a564e1c0b89d0ec/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:52.508813 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98df81-5c89-42c4-a21a-c312939613ed admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:52.519212 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98df81-5c89-42c4-a21a-c312939613ed admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:52.529730 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:52.579616 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924d8bb-94a0-419b-88e5-c71c22b28b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:52.580222 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924d8bb-94a0-419b-88e5-c71c22b28b71 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:52.580506 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924d8bb-94a0-419b-88e5-c71c22b28b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:52.580789 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924d8bb-94a0-419b-88e5-c71c22b28b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:52.581430 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924d8bb-94a0-419b-88e5-c71c22b28b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:52.583053 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924d8bb-94a0-419b-88e5-c71c22b28b71 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:52.593060 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1176/2377] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:30:52.597408 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fb1a5-dcc5-4bf7-8cbb-74075c92eb56 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:52.608186 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fb1a5-dcc5-4bf7-8cbb-74075c92eb56 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:52.613042 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c7b8e-c7fa-4271-8a56-799f78b95f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:52.613692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c7b8e-c7fa-4271-8a56-799f78b95f96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:52.614005 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c7b8e-c7fa-4271-8a56-799f78b95f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:52.614283 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c7b8e-c7fa-4271-8a56-799f78b95f96 admin admin] PATH_INFO: `/v3/projects/dee879f7cb10446d8035d93281c076c6/users/16b145b41b9d4b268a564e1c0b89d0ec/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:52.616226 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698c7b8e-c7fa-4271-8a56-799f78b95f96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dee879f7cb10446d8035d93281c076c6, user_id=16b145b41b9d4b268a564e1c0b89d0ec, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:52.618891 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698c7b8e-c7fa-4271-8a56-799f78b95f96 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:52.629735 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1202/2378] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:30:52 2022] PUT /identity/v3/projects/dee879f7cb10446d8035d93281c076c6/users/16b145b41b9d4b268a564e1c0b89d0ec/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:52.641354 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648aa36-af70-40d0-b68b-e8cef45984c6 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:52.641849 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648aa36-af70-40d0-b68b-e8cef45984c6 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:52.641945 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648aa36-af70-40d0-b68b-e8cef45984c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:52.661828 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c7b8e-c7fa-4271-8a56-799f78b95f96 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:52.675726 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-c648aa36-af70-40d0-b68b-e8cef45984c6 None None] MFA Rules not processed for user `16b145b41b9d4b268a564e1c0b89d0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:52.677440 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-c648aa36-af70-40d0-b68b-e8cef45984c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:52.679444 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-698c7b8e-c7fa-4271-8a56-799f78b95f96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:52.753005 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1177/2379] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:30:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:30:52.762832 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c7b8e-c7fa-4271-8a56-799f78b95f96 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:52.766487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648aa36-af70-40d0-b68b-e8cef45984c6 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:52.771759 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4daf652-6e41-45d2-9abd-e507957b167c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:52.771898 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-c648aa36-af70-40d0-b68b-e8cef45984c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:52.771997 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4daf652-6e41-45d2-9abd-e507957b167c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:52.771997 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4daf652-6e41-45d2-9abd-e507957b167c admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:52.771997 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4daf652-6e41-45d2-9abd-e507957b167c admin admin] PATH_INFO: `/v3/projects/8bbf29779b4f42e8ab29aa39199738eb` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:52.771997 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4daf652-6e41-45d2-9abd-e507957b167c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bbf29779b4f42e8ab29aa39199738eb)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:52.773307 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4daf652-6e41-45d2-9abd-e507957b167c admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:52.829686 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648aa36-af70-40d0-b68b-e8cef45984c6 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:52.833244 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c8dd4-c651-46b2-9fdf-88d194f2f7f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:52.833906 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c8dd4-c651-46b2-9fdf-88d194f2f7f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:52.834187 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c8dd4-c651-46b2-9fdf-88d194f2f7f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:52.834462 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c8dd4-c651-46b2-9fdf-88d194f2f7f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:52.844115 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c8dd4-c651-46b2-9fdf-88d194f2f7f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:52.845651 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c8dd4-c651-46b2-9fdf-88d194f2f7f3 service cinder] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:52.855627 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1178/2380] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:30:52 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:30:52.898386 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-b4daf652-6e41-45d2-9abd-e507957b167c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bbf29779b4f42e8ab29aa39199738eb', 'request_id': 'req-b4daf652-6e41-45d2-9abd-e507957b167c'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:52.904495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-b4daf652-6e41-45d2-9abd-e507957b167c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bbf29779b4f42e8ab29aa39199738eb', 'request_id': 'req-b4daf652-6e41-45d2-9abd-e507957b167c'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:52.910681 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-b4daf652-6e41-45d2-9abd-e507957b167c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bbf29779b4f42e8ab29aa39199738eb', 'request_id': 'req-b4daf652-6e41-45d2-9abd-e507957b167c'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:53.034996 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-b4daf652-6e41-45d2-9abd-e507957b167c admin admin] The token cache is being invalidate because project 8bbf29779b4f42e8ab29aa39199738eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:30:53.035315 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-b4daf652-6e41-45d2-9abd-e507957b167c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:53.036067 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-b4daf652-6e41-45d2-9abd-e507957b167c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:53.037559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1203/2381] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:30:52 2022] DELETE /identity/v3/projects/8bbf29779b4f42e8ab29aa39199738eb => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:53.041499 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c8dd4-c651-46b2-9fdf-88d194f2f7f3 service cinder] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:53.053958 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c8dd4-c651-46b2-9fdf-88d194f2f7f3 service cinder] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:53.092692 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:53.117920 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3d85c-091d-411b-9669-3a2413451aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:53.118574 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3d85c-091d-411b-9669-3a2413451aa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:53.118858 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3d85c-091d-411b-9669-3a2413451aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:53.119137 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3d85c-091d-411b-9669-3a2413451aa4 admin admin] PATH_INFO: `/v3/users/814a1b9542c249f594c53d9b8a574e2c` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:53.120327 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3d85c-091d-411b-9669-3a2413451aa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=814a1b9542c249f594c53d9b8a574e2c)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:53.122555 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3d85c-091d-411b-9669-3a2413451aa4 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:53.392671 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c1f3d85c-091d-411b-9669-3a2413451aa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '814a1b9542c249f594c53d9b8a574e2c'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:53.555611 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c1f3d85c-091d-411b-9669-3a2413451aa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '814a1b9542c249f594c53d9b8a574e2c'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:53.556558 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c1f3d85c-091d-411b-9669-3a2413451aa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '814a1b9542c249f594c53d9b8a574e2c'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:53.557505 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c1f3d85c-091d-411b-9669-3a2413451aa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '814a1b9542c249f594c53d9b8a574e2c'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:53.574967 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c1f3d85c-091d-411b-9669-3a2413451aa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '814a1b9542c249f594c53d9b8a574e2c'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:53.587886 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1179/2382] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:30:53 2022] DELETE /identity/v3/users/814a1b9542c249f594c53d9b8a574e2c => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:54.019318 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4daf652-6e41-45d2-9abd-e507957b167c admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:54.020817 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-b4daf652-6e41-45d2-9abd-e507957b167c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:54.036003 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4daf652-6e41-45d2-9abd-e507957b167c admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:54.037842 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3d85c-091d-411b-9669-3a2413451aa4 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:54.041768 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-c1f3d85c-091d-411b-9669-3a2413451aa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:54.106945 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:54.117144 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541b6c4-607a-4ad0-9608-ad56c9413490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:54.117780 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541b6c4-607a-4ad0-9608-ad56c9413490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:54.118065 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541b6c4-607a-4ad0-9608-ad56c9413490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:54.118339 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541b6c4-607a-4ad0-9608-ad56c9413490 admin admin] PATH_INFO: `/v3/users/8c0db05585764413b5cacb7fb4830611` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:54.119720 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b541b6c4-607a-4ad0-9608-ad56c9413490 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c0db05585764413b5cacb7fb4830611)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:54.121826 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b541b6c4-607a-4ad0-9608-ad56c9413490 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:54.133999 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3d85c-091d-411b-9669-3a2413451aa4 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:54.142098 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856dcc41-40c2-4ad3-9be6-ca5ddc16d21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:54.142098 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856dcc41-40c2-4ad3-9be6-ca5ddc16d21d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:54.142098 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856dcc41-40c2-4ad3-9be6-ca5ddc16d21d admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:54.142098 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856dcc41-40c2-4ad3-9be6-ca5ddc16d21d admin admin] PATH_INFO: `/v3/projects/7bea5aa502144727ad3115edd2c1b794` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:54.143229 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856dcc41-40c2-4ad3-9be6-ca5ddc16d21d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bea5aa502144727ad3115edd2c1b794)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:54.145408 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856dcc41-40c2-4ad3-9be6-ca5ddc16d21d admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:54.369220 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-856dcc41-40c2-4ad3-9be6-ca5ddc16d21d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bea5aa502144727ad3115edd2c1b794', 'request_id': 'req-856dcc41-40c2-4ad3-9be6-ca5ddc16d21d'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:54.377297 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-856dcc41-40c2-4ad3-9be6-ca5ddc16d21d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bea5aa502144727ad3115edd2c1b794', 'request_id': 'req-856dcc41-40c2-4ad3-9be6-ca5ddc16d21d'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:54.381234 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:54.394556 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-856dcc41-40c2-4ad3-9be6-ca5ddc16d21d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bea5aa502144727ad3115edd2c1b794', 'request_id': 'req-856dcc41-40c2-4ad3-9be6-ca5ddc16d21d'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:54.396515 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-b541b6c4-607a-4ad0-9608-ad56c9413490 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c0db05585764413b5cacb7fb4830611'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:54.464643 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-856dcc41-40c2-4ad3-9be6-ca5ddc16d21d admin admin] The token cache is being invalidate because project 7bea5aa502144727ad3115edd2c1b794 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:30:54.465206 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-856dcc41-40c2-4ad3-9be6-ca5ddc16d21d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:54.465838 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-856dcc41-40c2-4ad3-9be6-ca5ddc16d21d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:54.467345 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1180/2383] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:30:54 2022] DELETE /identity/v3/projects/7bea5aa502144727ad3115edd2c1b794 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:54.472256 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d89dc3-f4a9-4a28-8b70-906c4e27f0a3 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:54.472256 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d89dc3-f4a9-4a28-8b70-906c4e27f0a3 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:54.472467 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d89dc3-f4a9-4a28-8b70-906c4e27f0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:54.497269 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-39d89dc3-f4a9-4a28-8b70-906c4e27f0a3 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:54.498522 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-39d89dc3-f4a9-4a28-8b70-906c4e27f0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:54.565234 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-b541b6c4-607a-4ad0-9608-ad56c9413490 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c0db05585764413b5cacb7fb4830611'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:54.566293 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-b541b6c4-607a-4ad0-9608-ad56c9413490 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c0db05585764413b5cacb7fb4830611'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:54.575379 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1181/2384] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:30:54.583053 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef39339-0f3d-477a-9b20-007020eccfda None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:54.583346 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef39339-0f3d-477a-9b20-007020eccfda None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:54.583673 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef39339-0f3d-477a-9b20-007020eccfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:54.588290 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-b541b6c4-607a-4ad0-9608-ad56c9413490 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c0db05585764413b5cacb7fb4830611'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:54.596694 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-b541b6c4-607a-4ad0-9608-ad56c9413490 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c0db05585764413b5cacb7fb4830611'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:54.603671 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1204/2385] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:30:54 2022] DELETE /identity/v3/users/8c0db05585764413b5cacb7fb4830611 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:54.606046 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-0ef39339-0f3d-477a-9b20-007020eccfda None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:54.609299 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-0ef39339-0f3d-477a-9b20-007020eccfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:54.609444 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f4d83-35e9-4a90-8e06-86ec9e27f059 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:54.609444 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f4d83-35e9-4a90-8e06-86ec9e27f059 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:54.609615 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f4d83-35e9-4a90-8e06-86ec9e27f059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:54.630048 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-ae4f4d83-35e9-4a90-8e06-86ec9e27f059 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:54.631191 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-ae4f4d83-35e9-4a90-8e06-86ec9e27f059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:54.704923 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1182/2386] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:30:54.710240 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef39339-0f3d-477a-9b20-007020eccfda None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:54.712790 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1205/2387] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:30:54.722152 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef39339-0f3d-477a-9b20-007020eccfda None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:54.725644 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f4d83-35e9-4a90-8e06-86ec9e27f059 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:54.727269 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-ae4f4d83-35e9-4a90-8e06-86ec9e27f059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:54.732474 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7903d-f78d-41fb-8f83-d056c56f4a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:54.733111 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7903d-f78d-41fb-8f83-d056c56f4a9a admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:54.733555 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7903d-f78d-41fb-8f83-d056c56f4a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:54.733833 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7903d-f78d-41fb-8f83-d056c56f4a9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:54.734671 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7903d-f78d-41fb-8f83-d056c56f4a9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:30:54.734994 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7903d-f78d-41fb-8f83-d056c56f4a9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:54.736681 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7903d-f78d-41fb-8f83-d056c56f4a9a admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:54.752101 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1183/2388] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:30:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:30:54.756401 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7903d-f78d-41fb-8f83-d056c56f4a9a admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:54.767677 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7903d-f78d-41fb-8f83-d056c56f4a9a admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:54.773178 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb17f7-8970-47c6-8c4a-0f76d06a9f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:54.773877 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb17f7-8970-47c6-8c4a-0f76d06a9f44 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:54.774346 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb17f7-8970-47c6-8c4a-0f76d06a9f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:54.774685 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb17f7-8970-47c6-8c4a-0f76d06a9f44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:54.775835 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb17f7-8970-47c6-8c4a-0f76d06a9f44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:54.777767 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb17f7-8970-47c6-8c4a-0f76d06a9f44 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:54.806022 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f4d83-35e9-4a90-8e06-86ec9e27f059 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:54.810605 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619d454-d0e4-48c7-a9f7-26db814cc41e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:54.812184 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619d454-d0e4-48c7-a9f7-26db814cc41e service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:54.812545 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619d454-d0e4-48c7-a9f7-26db814cc41e service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:54.812895 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619d454-d0e4-48c7-a9f7-26db814cc41e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:54.823532 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5619d454-d0e4-48c7-a9f7-26db814cc41e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:54.825573 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5619d454-d0e4-48c7-a9f7-26db814cc41e service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:54.835840 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1206/2389] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:30:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:30:54.960095 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1184/2390] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:30:54 2022] POST /identity/v3/projects => generated 385 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:30:54.964101 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619d454-d0e4-48c7-a9f7-26db814cc41e service neutron] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:54.974630 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619d454-d0e4-48c7-a9f7-26db814cc41e service neutron] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:54.987688 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:55.061210 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625798f5-4d45-48dd-9201-feb776a2f352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:55.061890 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625798f5-4d45-48dd-9201-feb776a2f352 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:55.062178 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625798f5-4d45-48dd-9201-feb776a2f352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:55.062458 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625798f5-4d45-48dd-9201-feb776a2f352 admin admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:55.063092 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625798f5-4d45-48dd-9201-feb776a2f352 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:55.065035 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625798f5-4d45-48dd-9201-feb776a2f352 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:55.240128 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1207/2391] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:30:54 2022] POST /identity/v3/users => generated 293 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:30:55.241292 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb17f7-8970-47c6-8c4a-0f76d06a9f44 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:55.253465 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb17f7-8970-47c6-8c4a-0f76d06a9f44 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:55.258459 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021e6e7-3389-467f-b7d9-e6131a54c168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:55.259063 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021e6e7-3389-467f-b7d9-e6131a54c168 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:55.259381 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021e6e7-3389-467f-b7d9-e6131a54c168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:55.259679 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021e6e7-3389-467f-b7d9-e6131a54c168 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:55.260342 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021e6e7-3389-467f-b7d9-e6131a54c168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:55.263039 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021e6e7-3389-467f-b7d9-e6131a54c168 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:55.274330 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1185/2392] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:30:55.278986 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625798f5-4d45-48dd-9201-feb776a2f352 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:55.290389 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625798f5-4d45-48dd-9201-feb776a2f352 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:55.297568 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8404c7d-7066-46d0-8ed2-66aadd6dee0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:55.301649 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8404c7d-7066-46d0-8ed2-66aadd6dee0b admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:55.301649 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8404c7d-7066-46d0-8ed2-66aadd6dee0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:55.301649 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8404c7d-7066-46d0-8ed2-66aadd6dee0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:55.301649 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8404c7d-7066-46d0-8ed2-66aadd6dee0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:55.301649 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8404c7d-7066-46d0-8ed2-66aadd6dee0b admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:55.313032 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1208/2393] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:30:55.317180 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021e6e7-3389-467f-b7d9-e6131a54c168 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:55.329881 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021e6e7-3389-467f-b7d9-e6131a54c168 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:55.339505 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71a1b2-995a-432e-a7c7-cb72231c445d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:55.340191 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71a1b2-995a-432e-a7c7-cb72231c445d admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:55.340746 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71a1b2-995a-432e-a7c7-cb72231c445d admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:55.340746 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71a1b2-995a-432e-a7c7-cb72231c445d admin admin] PATH_INFO: `/v3/projects/71509c8bd0e34182935933409963adb5/users/655961875e40495c919c1447ef627e68/roles/5691bce246d6452990f13933e19f2825` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:55.356874 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c71a1b2-995a-432e-a7c7-cb72231c445d admin admin] RBAC: Authorizing `identity:create_grant(project_id=71509c8bd0e34182935933409963adb5, user_id=655961875e40495c919c1447ef627e68, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:55.359551 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c71a1b2-995a-432e-a7c7-cb72231c445d admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:55.447445 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1186/2394] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:30:55 2022] PUT /identity/v3/projects/71509c8bd0e34182935933409963adb5/users/655961875e40495c919c1447ef627e68/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:55.449824 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b211c-a285-4fe0-a894-a5c9a1868b69 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:55.450188 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b211c-a285-4fe0-a894-a5c9a1868b69 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:55.450531 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b211c-a285-4fe0-a894-a5c9a1868b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:55.490122 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-5a4b211c-a285-4fe0-a894-a5c9a1868b69 None None] MFA Rules not processed for user `655961875e40495c919c1447ef627e68`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:55.492600 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-5a4b211c-a285-4fe0-a894-a5c9a1868b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:55.527174 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71a1b2-995a-432e-a7c7-cb72231c445d admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:55.530076 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-6c71a1b2-995a-432e-a7c7-cb72231c445d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:55.564623 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:55.646226 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1209/2395] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:30:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:30:55.648123 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b211c-a285-4fe0-a894-a5c9a1868b69 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:55.650401 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-5a4b211c-a285-4fe0-a894-a5c9a1868b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:55.676677 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71a1b2-995a-432e-a7c7-cb72231c445d admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:55.683894 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0292ed-c75f-4506-a1ed-0986b1a2402d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:55.684521 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0292ed-c75f-4506-a1ed-0986b1a2402d service nova] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:55.684807 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0292ed-c75f-4506-a1ed-0986b1a2402d service nova] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:55.685270 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0292ed-c75f-4506-a1ed-0986b1a2402d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:55.687431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-1e0292ed-c75f-4506-a1ed-0986b1a2402d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:55.703019 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0292ed-c75f-4506-a1ed-0986b1a2402d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:55.704567 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0292ed-c75f-4506-a1ed-0986b1a2402d service nova] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:55.723855 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1187/2396] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:30:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:30:55.723855 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0292ed-c75f-4506-a1ed-0986b1a2402d service nova] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:55.770528 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b211c-a285-4fe0-a894-a5c9a1868b69 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:55.777487 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e124e-256b-41f1-9fcf-db7d97216098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:55.778207 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e124e-256b-41f1-9fcf-db7d97216098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:55.778886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e124e-256b-41f1-9fcf-db7d97216098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:55.779231 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e124e-256b-41f1-9fcf-db7d97216098 admin admin] PATH_INFO: `/v3/projects/2aa5c3da89944ac5adb2d5a96bf1eda8` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:55.794978 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e124e-256b-41f1-9fcf-db7d97216098 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aa5c3da89944ac5adb2d5a96bf1eda8)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:55.797416 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e124e-256b-41f1-9fcf-db7d97216098 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:55.806140 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0292ed-c75f-4506-a1ed-0986b1a2402d service nova] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:55.812395 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239a136-58d8-4420-93f4-c6b3a3969fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:55.813232 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239a136-58d8-4420-93f4-c6b3a3969fc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:55.813718 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239a136-58d8-4420-93f4-c6b3a3969fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:55.814102 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239a136-58d8-4420-93f4-c6b3a3969fc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:55.814896 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a239a136-58d8-4420-93f4-c6b3a3969fc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:55.816971 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a239a136-58d8-4420-93f4-c6b3a3969fc3 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:55.834691 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:55.941497 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-f74e124e-256b-41f1-9fcf-db7d97216098 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aa5c3da89944ac5adb2d5a96bf1eda8', 'request_id': 'req-f74e124e-256b-41f1-9fcf-db7d97216098'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:55.943010 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1188/2397] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:30:55 2022] POST /identity/v3/projects => generated 383 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:30:55.944409 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335d152-3509-438b-b798-1c1f77af2a6b None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:55.944704 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335d152-3509-438b-b798-1c1f77af2a6b None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:55.944983 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335d152-3509-438b-b798-1c1f77af2a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:55.950273 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-f74e124e-256b-41f1-9fcf-db7d97216098 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aa5c3da89944ac5adb2d5a96bf1eda8', 'request_id': 'req-f74e124e-256b-41f1-9fcf-db7d97216098'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:55.958451 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-f74e124e-256b-41f1-9fcf-db7d97216098 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aa5c3da89944ac5adb2d5a96bf1eda8', 'request_id': 'req-f74e124e-256b-41f1-9fcf-db7d97216098'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:55.969882 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-8335d152-3509-438b-b798-1c1f77af2a6b None None] MFA Rules not processed for user `1d39439278814d4faac4cfb1e71aa4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:55.971147 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-8335d152-3509-438b-b798-1c1f77af2a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:56.031116 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1189/2398] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 8 02:30:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:30:56.032017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335d152-3509-438b-b798-1c1f77af2a6b None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:56.032721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-f74e124e-256b-41f1-9fcf-db7d97216098 admin admin] The token cache is being invalidate because project 2aa5c3da89944ac5adb2d5a96bf1eda8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:30:56.033093 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-f74e124e-256b-41f1-9fcf-db7d97216098 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:56.034080 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-f74e124e-256b-41f1-9fcf-db7d97216098 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:56.039153 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1210/2399] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:30:55 2022] DELETE /identity/v3/projects/2aa5c3da89944ac5adb2d5a96bf1eda8 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:56.040441 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e124e-256b-41f1-9fcf-db7d97216098 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:56.043039 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-f74e124e-256b-41f1-9fcf-db7d97216098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:56.086022 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:56.134130 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e124e-256b-41f1-9fcf-db7d97216098 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:56.148558 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335d152-3509-438b-b798-1c1f77af2a6b None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:56.148698 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c05de1-2dfd-405d-8b4f-897f5b95bc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:56.148698 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c05de1-2dfd-405d-8b4f-897f5b95bc90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:56.148698 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c05de1-2dfd-405d-8b4f-897f5b95bc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:56.148698 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c05de1-2dfd-405d-8b4f-897f5b95bc90 admin admin] PATH_INFO: `/v3/users/16b145b41b9d4b268a564e1c0b89d0ec` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:56.149053 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c05de1-2dfd-405d-8b4f-897f5b95bc90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16b145b41b9d4b268a564e1c0b89d0ec)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:56.149160 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba9028-8995-4e52-8b9c-56feb8a254db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:56.152659 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c05de1-2dfd-405d-8b4f-897f5b95bc90 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:56.152791 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba9028-8995-4e52-8b9c-56feb8a254db admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:56.152791 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba9028-8995-4e52-8b9c-56feb8a254db admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:56.152791 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba9028-8995-4e52-8b9c-56feb8a254db admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:56.152791 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba9028-8995-4e52-8b9c-56feb8a254db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:56.154768 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba9028-8995-4e52-8b9c-56feb8a254db admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:56.365535 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1190/2400] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:30:56 2022] POST /identity/v3/users => generated 298 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:30:56.365535 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba9028-8995-4e52-8b9c-56feb8a254db admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:56.365535 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-3fba9028-8995-4e52-8b9c-56feb8a254db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:56.448084 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba9028-8995-4e52-8b9c-56feb8a254db admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:56.452193 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-f5c05de1-2dfd-405d-8b4f-897f5b95bc90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16b145b41b9d4b268a564e1c0b89d0ec'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:56.453708 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bac86c-700e-4687-9a1f-9a7ee6e23fbb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c212009b6a44e1bad92769630116408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:56.454321 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bac86c-700e-4687-9a1f-9a7ee6e23fbb service swift] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:56.454601 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bac86c-700e-4687-9a1f-9a7ee6e23fbb service swift] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:56.454877 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bac86c-700e-4687-9a1f-9a7ee6e23fbb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:56.456684 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-13bac86c-700e-4687-9a1f-9a7ee6e23fbb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:56.467419 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bac86c-700e-4687-9a1f-9a7ee6e23fbb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:56.469069 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bac86c-700e-4687-9a1f-9a7ee6e23fbb service swift] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:56.477769 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1191/2401] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 8 02:30:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:30:56.478590 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bac86c-700e-4687-9a1f-9a7ee6e23fbb service swift] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:56.487657 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-13bac86c-700e-4687-9a1f-9a7ee6e23fbb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:56.493646 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bac86c-700e-4687-9a1f-9a7ee6e23fbb service swift] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:56.498956 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e1f38-35b3-4460-9778-cdab83e6187f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:56.499801 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e1f38-35b3-4460-9778-cdab83e6187f admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:56.500091 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e1f38-35b3-4460-9778-cdab83e6187f admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:56.500435 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e1f38-35b3-4460-9778-cdab83e6187f admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:56.501155 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e1f38-35b3-4460-9778-cdab83e6187f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:56.502888 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e1f38-35b3-4460-9778-cdab83e6187f admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:56.517629 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1192/2402] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:30:56.522305 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e1f38-35b3-4460-9778-cdab83e6187f admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:56.536546 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e1f38-35b3-4460-9778-cdab83e6187f admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:56.541341 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c93ae-85e2-47ec-9ac7-d4611b14da2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:56.542010 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c93ae-85e2-47ec-9ac7-d4611b14da2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:56.542319 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c93ae-85e2-47ec-9ac7-d4611b14da2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:56.542598 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c93ae-85e2-47ec-9ac7-d4611b14da2d admin admin] PATH_INFO: `/v3/projects/9c08be5fc86047faa0cedec27703d178/users/8afb2bfea65b428992837d6452e71da0/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:56.559834 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293c93ae-85e2-47ec-9ac7-d4611b14da2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c08be5fc86047faa0cedec27703d178, user_id=8afb2bfea65b428992837d6452e71da0, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:56.562612 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293c93ae-85e2-47ec-9ac7-d4611b14da2d admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:56.585693 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-f5c05de1-2dfd-405d-8b4f-897f5b95bc90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16b145b41b9d4b268a564e1c0b89d0ec'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:56.587126 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-f5c05de1-2dfd-405d-8b4f-897f5b95bc90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16b145b41b9d4b268a564e1c0b89d0ec'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:56.602157 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-f5c05de1-2dfd-405d-8b4f-897f5b95bc90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16b145b41b9d4b268a564e1c0b89d0ec'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:56.609863 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-f5c05de1-2dfd-405d-8b4f-897f5b95bc90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16b145b41b9d4b268a564e1c0b89d0ec'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:56.616004 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1211/2403] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:30:56 2022] DELETE /identity/v3/users/16b145b41b9d4b268a564e1c0b89d0ec => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:56.749151 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1193/2404] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:30:56 2022] PUT /identity/v3/projects/9c08be5fc86047faa0cedec27703d178/users/8afb2bfea65b428992837d6452e71da0/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:30:56.754459 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c05de1-2dfd-405d-8b4f-897f5b95bc90 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:56.756519 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-f5c05de1-2dfd-405d-8b4f-897f5b95bc90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:56.800492 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:56.838160 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c05de1-2dfd-405d-8b4f-897f5b95bc90 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:56.986793 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba93c2b-451a-4aac-95c9-807d6eecb77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:56.987583 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba93c2b-451a-4aac-95c9-807d6eecb77f admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:56.991536 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba93c2b-451a-4aac-95c9-807d6eecb77f admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:56.991814 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba93c2b-451a-4aac-95c9-807d6eecb77f admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:56.992622 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba93c2b-451a-4aac-95c9-807d6eecb77f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:56.994382 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba93c2b-451a-4aac-95c9-807d6eecb77f admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:57.010945 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c93ae-85e2-47ec-9ac7-d4611b14da2d admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:57.012443 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1212/2405] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:30:57.034362 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c93ae-85e2-47ec-9ac7-d4611b14da2d admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:57.039691 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6d654-a804-4ef8-901a-4b10a5c3e405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:57.040499 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6d654-a804-4ef8-901a-4b10a5c3e405 admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:57.040888 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6d654-a804-4ef8-901a-4b10a5c3e405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:57.041270 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6d654-a804-4ef8-901a-4b10a5c3e405 admin admin] PATH_INFO: `/v3/projects/9c08be5fc86047faa0cedec27703d178/users/8afb2bfea65b428992837d6452e71da0/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:57.044106 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da6d654-a804-4ef8-901a-4b10a5c3e405 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c08be5fc86047faa0cedec27703d178, user_id=8afb2bfea65b428992837d6452e71da0, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:57.047058 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da6d654-a804-4ef8-901a-4b10a5c3e405 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:57.068797 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1194/2406] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:30:57 2022] PUT /identity/v3/projects/9c08be5fc86047faa0cedec27703d178/users/8afb2bfea65b428992837d6452e71da0/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:57.070441 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7b78c-ff03-4d5d-a57b-4cc284d4c70e None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:57.070847 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7b78c-ff03-4d5d-a57b-4cc284d4c70e None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:57.071253 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7b78c-ff03-4d5d-a57b-4cc284d4c70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:57.106665 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-d4c7b78c-ff03-4d5d-a57b-4cc284d4c70e None None] MFA Rules not processed for user `8afb2bfea65b428992837d6452e71da0`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:57.112833 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-d4c7b78c-ff03-4d5d-a57b-4cc284d4c70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:57.247854 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1213/2407] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:30:57 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:30:57.259430 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6d654-a804-4ef8-901a-4b10a5c3e405 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:57.261490 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-3da6d654-a804-4ef8-901a-4b10a5c3e405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:57.334205 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6d654-a804-4ef8-901a-4b10a5c3e405 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:57.338945 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae113f3d-02f7-4983-bcff-7294ac1933e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:57.340124 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae113f3d-02f7-4983-bcff-7294ac1933e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:57.340409 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae113f3d-02f7-4983-bcff-7294ac1933e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:57.340689 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae113f3d-02f7-4983-bcff-7294ac1933e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:57.342458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-ae113f3d-02f7-4983-bcff-7294ac1933e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:57.374056 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7b78c-ff03-4d5d-a57b-4cc284d4c70e None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:57.374328 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:57.375597 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-d4c7b78c-ff03-4d5d-a57b-4cc284d4c70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:57.468163 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae113f3d-02f7-4983-bcff-7294ac1933e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:57.471284 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae113f3d-02f7-4983-bcff-7294ac1933e5 service cinder] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:57.499369 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1195/2408] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:30:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:30:57.507767 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7b78c-ff03-4d5d-a57b-4cc284d4c70e None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:57.513585 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63efec-62e6-4ca3-a6fd-a587e7959ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:57.514388 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63efec-62e6-4ca3-a6fd-a587e7959ccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:57.514632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63efec-62e6-4ca3-a6fd-a587e7959ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:57.514903 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63efec-62e6-4ca3-a6fd-a587e7959ccf admin admin] PATH_INFO: `/v3/projects/dee879f7cb10446d8035d93281c076c6` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:57.516300 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63efec-62e6-4ca3-a6fd-a587e7959ccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=dee879f7cb10446d8035d93281c076c6)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:57.519290 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63efec-62e6-4ca3-a6fd-a587e7959ccf admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:57.522800 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:57.673310 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-6e63efec-62e6-4ca3-a6fd-a587e7959ccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dee879f7cb10446d8035d93281c076c6', 'request_id': 'req-6e63efec-62e6-4ca3-a6fd-a587e7959ccf'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:57.679765 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-6e63efec-62e6-4ca3-a6fd-a587e7959ccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dee879f7cb10446d8035d93281c076c6', 'request_id': 'req-6e63efec-62e6-4ca3-a6fd-a587e7959ccf'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:57.701701 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-6e63efec-62e6-4ca3-a6fd-a587e7959ccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dee879f7cb10446d8035d93281c076c6', 'request_id': 'req-6e63efec-62e6-4ca3-a6fd-a587e7959ccf'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:57.818899 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-6e63efec-62e6-4ca3-a6fd-a587e7959ccf admin admin] The token cache is being invalidate because project dee879f7cb10446d8035d93281c076c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:30:57.819199 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-6e63efec-62e6-4ca3-a6fd-a587e7959ccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:57.820044 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-6e63efec-62e6-4ca3-a6fd-a587e7959ccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:57.826780 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1214/2409] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:30:57 2022] DELETE /identity/v3/projects/dee879f7cb10446d8035d93281c076c6 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:57.829162 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8090d3-5f7b-40cb-9f0a-87e9e9ebf833 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:57.829913 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8090d3-5f7b-40cb-9f0a-87e9e9ebf833 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:57.830711 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8090d3-5f7b-40cb-9f0a-87e9e9ebf833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:57.887230 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-fb8090d3-5f7b-40cb-9f0a-87e9e9ebf833 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:57.890107 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-fb8090d3-5f7b-40cb-9f0a-87e9e9ebf833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:58.025296 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1196/2410] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:30:58.032834 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c90deb-ac82-42e0-b0c8-d4a73924437c None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:58.033126 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c90deb-ac82-42e0-b0c8-d4a73924437c None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:58.033408 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c90deb-ac82-42e0-b0c8-d4a73924437c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:58.089751 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-d2c90deb-ac82-42e0-b0c8-d4a73924437c None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:58.091021 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-d2c90deb-ac82-42e0-b0c8-d4a73924437c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:58.116808 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1215/2411] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:30:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:30:58.122526 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8090d3-5f7b-40cb-9f0a-87e9e9ebf833 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:58.142873 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8090d3-5f7b-40cb-9f0a-87e9e9ebf833 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:58.149626 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77272125-62cc-47bf-9814-a75f7dcd5723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:58.150415 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77272125-62cc-47bf-9814-a75f7dcd5723 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:58.150900 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77272125-62cc-47bf-9814-a75f7dcd5723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:58.152204 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77272125-62cc-47bf-9814-a75f7dcd5723 admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:58.153115 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77272125-62cc-47bf-9814-a75f7dcd5723 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:30:58.153568 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77272125-62cc-47bf-9814-a75f7dcd5723 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:58.156623 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77272125-62cc-47bf-9814-a75f7dcd5723 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:58.174192 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1197/2412] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:30:58.178809 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c90deb-ac82-42e0-b0c8-d4a73924437c None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:58.196403 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c90deb-ac82-42e0-b0c8-d4a73924437c None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:58.210652 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ea141-03b2-4287-8e25-882de9f5fd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:58.211695 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ea141-03b2-4287-8e25-882de9f5fd30 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:58.211992 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ea141-03b2-4287-8e25-882de9f5fd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:58.212265 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ea141-03b2-4287-8e25-882de9f5fd30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:58.216996 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ea141-03b2-4287-8e25-882de9f5fd30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:58.221913 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ea141-03b2-4287-8e25-882de9f5fd30 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:58.360129 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77272125-62cc-47bf-9814-a75f7dcd5723 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:58.360353 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1216/2413] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:30:58 2022] POST /identity/v3/projects => generated 373 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:30:58.394973 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77272125-62cc-47bf-9814-a75f7dcd5723 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:58.536193 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d23fb-2922-423f-8f51-4cdf5baf818b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:58.536999 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d23fb-2922-423f-8f51-4cdf5baf818b admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:58.537268 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d23fb-2922-423f-8f51-4cdf5baf818b admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:58.537587 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d23fb-2922-423f-8f51-4cdf5baf818b admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:58.538211 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d23fb-2922-423f-8f51-4cdf5baf818b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:58.540188 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d23fb-2922-423f-8f51-4cdf5baf818b admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:58.670444 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1198/2414] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:30:58 2022] POST /identity/v3/users => generated 287 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:30:58.674161 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ea141-03b2-4287-8e25-882de9f5fd30 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:58.695623 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ea141-03b2-4287-8e25-882de9f5fd30 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:58.701847 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd13c7-cf7a-447d-81ff-0a7db177f6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:58.702935 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd13c7-cf7a-447d-81ff-0a7db177f6da admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:58.703446 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd13c7-cf7a-447d-81ff-0a7db177f6da admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:58.703912 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd13c7-cf7a-447d-81ff-0a7db177f6da admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:58.704944 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd13c7-cf7a-447d-81ff-0a7db177f6da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:58.706798 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd13c7-cf7a-447d-81ff-0a7db177f6da admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:58.722987 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1217/2415] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:30:58.725224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d23fb-2922-423f-8f51-4cdf5baf818b admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:58.737661 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d23fb-2922-423f-8f51-4cdf5baf818b admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:58.744042 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf0fec-de0d-4ca9-a2dc-5c349a2a693a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:58.744042 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf0fec-de0d-4ca9-a2dc-5c349a2a693a admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:58.744042 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf0fec-de0d-4ca9-a2dc-5c349a2a693a admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:58.744042 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf0fec-de0d-4ca9-a2dc-5c349a2a693a admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:58.744586 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf0fec-de0d-4ca9-a2dc-5c349a2a693a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:58.746778 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf0fec-de0d-4ca9-a2dc-5c349a2a693a admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:58.760122 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1199/2416] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:30:58.764747 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd13c7-cf7a-447d-81ff-0a7db177f6da admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:58.775710 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd13c7-cf7a-447d-81ff-0a7db177f6da admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:58.780711 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5e706-a91f-464a-9d37-05e988c2b3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:58.781404 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5e706-a91f-464a-9d37-05e988c2b3b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:58.781690 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5e706-a91f-464a-9d37-05e988c2b3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:58.782103 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5e706-a91f-464a-9d37-05e988c2b3b5 admin admin] PATH_INFO: `/v3/projects/cda593701337409885095e9c207ce499/users/7034565e8c754671909ff88fd794553b/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:58.800213 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5e706-a91f-464a-9d37-05e988c2b3b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cda593701337409885095e9c207ce499, user_id=7034565e8c754671909ff88fd794553b, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:58.803222 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5e706-a91f-464a-9d37-05e988c2b3b5 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:58.902118 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1218/2417] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:30:58 2022] PUT /identity/v3/projects/cda593701337409885095e9c207ce499/users/7034565e8c754671909ff88fd794553b/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:58.912787 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873664a-b1a2-4cce-b8b9-45a46a1815fa None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:58.913384 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873664a-b1a2-4cce-b8b9-45a46a1815fa None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:58.913855 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873664a-b1a2-4cce-b8b9-45a46a1815fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:58.964642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-a873664a-b1a2-4cce-b8b9-45a46a1815fa None None] MFA Rules not processed for user `7034565e8c754671909ff88fd794553b`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:58.965851 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-a873664a-b1a2-4cce-b8b9-45a46a1815fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:58.985203 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:59.079426 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1200/2418] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:30:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:30:59.088023 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5e706-a91f-464a-9d37-05e988c2b3b5 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:59.090089 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-d9e5e706-a91f-464a-9d37-05e988c2b3b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:59.188690 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5e706-a91f-464a-9d37-05e988c2b3b5 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:59.193303 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78b662-74de-4e13-ae44-6902c0fbad42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:59.193951 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78b662-74de-4e13-ae44-6902c0fbad42 service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:59.196168 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78b662-74de-4e13-ae44-6902c0fbad42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:59.196168 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78b662-74de-4e13-ae44-6902c0fbad42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:59.205319 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78b662-74de-4e13-ae44-6902c0fbad42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:59.206790 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78b662-74de-4e13-ae44-6902c0fbad42 service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:59.217954 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1219/2419] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:30:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:30:59.249119 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873664a-b1a2-4cce-b8b9-45a46a1815fa None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:59.352674 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873664a-b1a2-4cce-b8b9-45a46a1815fa None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:59.358523 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d9310-185a-4510-b437-dee16238d0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:59.359249 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d9310-185a-4510-b437-dee16238d0eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:59.359783 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d9310-185a-4510-b437-dee16238d0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:59.360036 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d9310-185a-4510-b437-dee16238d0eb admin admin] PATH_INFO: `/v3/users/7034565e8c754671909ff88fd794553b` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:59.361113 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d9310-185a-4510-b437-dee16238d0eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7034565e8c754671909ff88fd794553b)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:59.363053 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d9310-185a-4510-b437-dee16238d0eb admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:59.579336 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-4c9d9310-185a-4510-b437-dee16238d0eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7034565e8c754671909ff88fd794553b'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:59.664732 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-4c9d9310-185a-4510-b437-dee16238d0eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7034565e8c754671909ff88fd794553b'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:59.664732 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-4c9d9310-185a-4510-b437-dee16238d0eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7034565e8c754671909ff88fd794553b'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:59.664732 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-4c9d9310-185a-4510-b437-dee16238d0eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7034565e8c754671909ff88fd794553b'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:59.681533 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-4c9d9310-185a-4510-b437-dee16238d0eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7034565e8c754671909ff88fd794553b'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:30:59.699102 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1201/2420] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:30:59 2022] DELETE /identity/v3/users/7034565e8c754671909ff88fd794553b => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:30:59.701884 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b33d5-d640-4527-b13c-1bd6c90c9c31 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:59.702720 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b33d5-d640-4527-b13c-1bd6c90c9c31 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:59.703003 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b33d5-d640-4527-b13c-1bd6c90c9c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:59.730323 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-ca5b33d5-d640-4527-b13c-1bd6c90c9c31 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:30:59.732066 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-ca5b33d5-d640-4527-b13c-1bd6c90c9c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:59.763585 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:59.811033 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1220/2421] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:30:59.818098 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d9310-185a-4510-b437-dee16238d0eb admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:30:59.819745 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-4c9d9310-185a-4510-b437-dee16238d0eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:30:59.880647 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:59.912155 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d9310-185a-4510-b437-dee16238d0eb admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:30:59.918841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b7066-a200-4255-9079-3ce1a4669fe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:30:59.923068 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b7066-a200-4255-9079-3ce1a4669fe9 service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:30:59.924249 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b7066-a200-4255-9079-3ce1a4669fe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:30:59.925601 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b7066-a200-4255-9079-3ce1a4669fe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:30:59.942459 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1b7066-a200-4255-9079-3ce1a4669fe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:30:59.945060 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1b7066-a200-4255-9079-3ce1a4669fe9 service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:30:59.957301 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1202/2422] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:30:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:00.498874 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b33d5-d640-4527-b13c-1bd6c90c9c31 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:00.498874 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-ca5b33d5-d640-4527-b13c-1bd6c90c9c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:00.514267 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b33d5-d640-4527-b13c-1bd6c90c9c31 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:00.521026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6d000-ec49-48d8-b47e-070362c384a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:00.521815 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6d000-ec49-48d8-b47e-070362c384a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:00.522564 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6d000-ec49-48d8-b47e-070362c384a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:00.523198 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6d000-ec49-48d8-b47e-070362c384a6 admin admin] PATH_INFO: `/v3/projects/cda593701337409885095e9c207ce499` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:00.527933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6d000-ec49-48d8-b47e-070362c384a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cda593701337409885095e9c207ce499)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:00.528071 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6d000-ec49-48d8-b47e-070362c384a6 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:00.741991 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-25e6d000-ec49-48d8-b47e-070362c384a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cda593701337409885095e9c207ce499', 'request_id': 'req-25e6d000-ec49-48d8-b47e-070362c384a6'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:00.746616 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-25e6d000-ec49-48d8-b47e-070362c384a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cda593701337409885095e9c207ce499', 'request_id': 'req-25e6d000-ec49-48d8-b47e-070362c384a6'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:00.754641 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-25e6d000-ec49-48d8-b47e-070362c384a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cda593701337409885095e9c207ce499', 'request_id': 'req-25e6d000-ec49-48d8-b47e-070362c384a6'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:00.921317 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-25e6d000-ec49-48d8-b47e-070362c384a6 admin admin] The token cache is being invalidate because project cda593701337409885095e9c207ce499 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:31:00.921613 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-25e6d000-ec49-48d8-b47e-070362c384a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:00.922262 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-25e6d000-ec49-48d8-b47e-070362c384a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:00.923802 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1221/2423] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:31:00 2022] DELETE /identity/v3/projects/cda593701337409885095e9c207ce499 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:00.929105 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c06301-b2a9-42f4-ad27-8155a6e749f2 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:00.929644 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c06301-b2a9-42f4-ad27-8155a6e749f2 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:00.929765 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c06301-b2a9-42f4-ad27-8155a6e749f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:00.952972 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-44c06301-b2a9-42f4-ad27-8155a6e749f2 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:00.956166 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-44c06301-b2a9-42f4-ad27-8155a6e749f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:01.036507 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1203/2424] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:31:01.038458 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780eb602-11ad-406d-b97c-b865a3f222b9 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:01.038752 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780eb602-11ad-406d-b97c-b865a3f222b9 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:01.039060 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780eb602-11ad-406d-b97c-b865a3f222b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:01.059327 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-780eb602-11ad-406d-b97c-b865a3f222b9 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:01.060684 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-780eb602-11ad-406d-b97c-b865a3f222b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:01.069554 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1222/2425] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:01.074585 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c06301-b2a9-42f4-ad27-8155a6e749f2 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:01.088631 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c06301-b2a9-42f4-ad27-8155a6e749f2 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:01.095673 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c109d0-9adf-41d0-92d9-4170bdd80517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:01.096697 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c109d0-9adf-41d0-92d9-4170bdd80517 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:01.097269 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c109d0-9adf-41d0-92d9-4170bdd80517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:01.097760 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c109d0-9adf-41d0-92d9-4170bdd80517 admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:01.098881 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c109d0-9adf-41d0-92d9-4170bdd80517 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:31:01.099556 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c109d0-9adf-41d0-92d9-4170bdd80517 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:01.101531 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c109d0-9adf-41d0-92d9-4170bdd80517 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:01.115747 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1204/2426] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:31:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:31:01.121140 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780eb602-11ad-406d-b97c-b865a3f222b9 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:01.133044 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780eb602-11ad-406d-b97c-b865a3f222b9 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:01.139186 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3a9aa-a7b2-4514-9ba5-8480497a28b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:01.139826 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3a9aa-a7b2-4514-9ba5-8480497a28b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:01.140104 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3a9aa-a7b2-4514-9ba5-8480497a28b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:01.140377 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3a9aa-a7b2-4514-9ba5-8480497a28b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:01.141143 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b3a9aa-a7b2-4514-9ba5-8480497a28b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:01.143261 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b3a9aa-a7b2-4514-9ba5-8480497a28b1 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:01.319417 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1223/2427] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:31:01 2022] POST /identity/v3/projects => generated 359 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:31:01.323565 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c109d0-9adf-41d0-92d9-4170bdd80517 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:01.334087 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c109d0-9adf-41d0-92d9-4170bdd80517 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:01.416779 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0360fd-dbf4-4d3d-85d2-0d7cc096423e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:01.418139 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0360fd-dbf4-4d3d-85d2-0d7cc096423e admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:01.418508 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0360fd-dbf4-4d3d-85d2-0d7cc096423e admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:01.418793 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0360fd-dbf4-4d3d-85d2-0d7cc096423e admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:01.419469 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0360fd-dbf4-4d3d-85d2-0d7cc096423e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:01.421400 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0360fd-dbf4-4d3d-85d2-0d7cc096423e admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:01.555430 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1205/2428] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:31:01 2022] POST /identity/v3/users => generated 280 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:31:01.563113 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3a9aa-a7b2-4514-9ba5-8480497a28b1 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:01.573713 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3a9aa-a7b2-4514-9ba5-8480497a28b1 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:01.591230 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a146de-ef58-4f33-973c-a59e00ececa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:01.591886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a146de-ef58-4f33-973c-a59e00ececa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:01.592171 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a146de-ef58-4f33-973c-a59e00ececa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:01.592444 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a146de-ef58-4f33-973c-a59e00ececa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:01.593273 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a146de-ef58-4f33-973c-a59e00ececa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:01.595042 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a146de-ef58-4f33-973c-a59e00ececa0 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:01.634695 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1224/2429] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:01.640348 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0360fd-dbf4-4d3d-85d2-0d7cc096423e admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:01.657106 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0360fd-dbf4-4d3d-85d2-0d7cc096423e admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:01.663168 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace796d-3db3-4243-957f-280eec4e0a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:01.664238 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace796d-3db3-4243-957f-280eec4e0a49 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:01.664691 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace796d-3db3-4243-957f-280eec4e0a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:01.665062 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace796d-3db3-4243-957f-280eec4e0a49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:01.666241 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace796d-3db3-4243-957f-280eec4e0a49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:01.669080 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace796d-3db3-4243-957f-280eec4e0a49 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:01.696783 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1206/2430] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:01.699639 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a146de-ef58-4f33-973c-a59e00ececa0 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:01.712986 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a146de-ef58-4f33-973c-a59e00ececa0 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:01.725740 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0a3de-e60d-447e-b1e9-459cb07b5b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:01.726877 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0a3de-e60d-447e-b1e9-459cb07b5b32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:01.731118 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0a3de-e60d-447e-b1e9-459cb07b5b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:01.731118 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0a3de-e60d-447e-b1e9-459cb07b5b32 admin admin] PATH_INFO: `/v3/projects/8f1e31a2f4fe4222befdd4587ca8b2b1/users/9619dbec02b74a788931d415c05979a8/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:01.764109 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0a3de-e60d-447e-b1e9-459cb07b5b32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f1e31a2f4fe4222befdd4587ca8b2b1, user_id=9619dbec02b74a788931d415c05979a8, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:01.767607 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0a3de-e60d-447e-b1e9-459cb07b5b32 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:01.843441 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1225/2431] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:01 2022] PUT /identity/v3/projects/8f1e31a2f4fe4222befdd4587ca8b2b1/users/9619dbec02b74a788931d415c05979a8/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:01.857308 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d67ef-a05e-49d2-88cd-3179534a4f0d None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:01.857940 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d67ef-a05e-49d2-88cd-3179534a4f0d None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:01.858310 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d67ef-a05e-49d2-88cd-3179534a4f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:02.134466 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-477d67ef-a05e-49d2-88cd-3179534a4f0d None None] MFA Rules not processed for user `9619dbec02b74a788931d415c05979a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:02.136672 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-477d67ef-a05e-49d2-88cd-3179534a4f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:02.182676 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:02.249707 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1207/2432] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:01 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:03.296561 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0a3de-e60d-447e-b1e9-459cb07b5b32 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:03.298623 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-97c0a3de-e60d-447e-b1e9-459cb07b5b32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:03.380600 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:03.397961 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0a3de-e60d-447e-b1e9-459cb07b5b32 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:03.403189 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967dcf2-4b40-4a89-813f-bebb5e1d2542 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:03.409031 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967dcf2-4b40-4a89-813f-bebb5e1d2542 service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:03.409031 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967dcf2-4b40-4a89-813f-bebb5e1d2542 service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:03.409031 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967dcf2-4b40-4a89-813f-bebb5e1d2542 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:03.416808 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967dcf2-4b40-4a89-813f-bebb5e1d2542 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:03.418737 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967dcf2-4b40-4a89-813f-bebb5e1d2542 service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:03.430188 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1226/2433] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:03 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:03.460173 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d67ef-a05e-49d2-88cd-3179534a4f0d None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:03.601036 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d67ef-a05e-49d2-88cd-3179534a4f0d None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:03.614142 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d2878-ca18-4549-8ff5-24f49c91bde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:03.614445 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d2878-ca18-4549-8ff5-24f49c91bde7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:03.614703 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d2878-ca18-4549-8ff5-24f49c91bde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:03.615017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d2878-ca18-4549-8ff5-24f49c91bde7 admin admin] PATH_INFO: `/v3/users/9619dbec02b74a788931d415c05979a8` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:03.616543 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d2878-ca18-4549-8ff5-24f49c91bde7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9619dbec02b74a788931d415c05979a8)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:03.618587 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d2878-ca18-4549-8ff5-24f49c91bde7 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:03.900077 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-948d2878-ca18-4549-8ff5-24f49c91bde7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9619dbec02b74a788931d415c05979a8'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:04.007813 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-948d2878-ca18-4549-8ff5-24f49c91bde7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9619dbec02b74a788931d415c05979a8'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:04.009196 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-948d2878-ca18-4549-8ff5-24f49c91bde7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9619dbec02b74a788931d415c05979a8'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:04.010093 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-948d2878-ca18-4549-8ff5-24f49c91bde7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9619dbec02b74a788931d415c05979a8'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:04.031828 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-948d2878-ca18-4549-8ff5-24f49c91bde7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9619dbec02b74a788931d415c05979a8'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:04.046792 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1208/2434] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:31:03 2022] DELETE /identity/v3/users/9619dbec02b74a788931d415c05979a8 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:04.051206 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6fe0c-a5e8-46db-8408-b24855e14f71 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:04.051545 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6fe0c-a5e8-46db-8408-b24855e14f71 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:04.051820 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6fe0c-a5e8-46db-8408-b24855e14f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:04.072694 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-cda6fe0c-a5e8-46db-8408-b24855e14f71 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:04.074073 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-cda6fe0c-a5e8-46db-8408-b24855e14f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:04.155317 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1227/2435] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:04.165572 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d2878-ca18-4549-8ff5-24f49c91bde7 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:04.167107 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-948d2878-ca18-4549-8ff5-24f49c91bde7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:04.233203 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:04.244262 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d2878-ca18-4549-8ff5-24f49c91bde7 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:04.249213 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b7ef4-8d98-4eb8-a6f3-07150765c658 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:04.249896 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b7ef4-8d98-4eb8-a6f3-07150765c658 service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:04.250315 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b7ef4-8d98-4eb8-a6f3-07150765c658 service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:04.250530 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b7ef4-8d98-4eb8-a6f3-07150765c658 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:04.260492 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b7ef4-8d98-4eb8-a6f3-07150765c658 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:04.261996 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b7ef4-8d98-4eb8-a6f3-07150765c658 service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:04.272624 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1209/2436] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:04.404184 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6fe0c-a5e8-46db-8408-b24855e14f71 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:04.405654 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-cda6fe0c-a5e8-46db-8408-b24855e14f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:04.419119 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6fe0c-a5e8-46db-8408-b24855e14f71 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:04.422812 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e71a7-5cb8-4de2-83f8-955ec2f15242 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:04.423462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e71a7-5cb8-4de2-83f8-955ec2f15242 service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:04.423748 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e71a7-5cb8-4de2-83f8-955ec2f15242 service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:04.424040 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e71a7-5cb8-4de2-83f8-955ec2f15242 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:04.425782 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-d56e71a7-5cb8-4de2-83f8-955ec2f15242 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:04.439613 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e71a7-5cb8-4de2-83f8-955ec2f15242 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:04.441149 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e71a7-5cb8-4de2-83f8-955ec2f15242 service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:04.454072 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1228/2437] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:04.702799 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b7ef4-8d98-4eb8-a6f3-07150765c658 service neutron] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:04.705686 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-e30b7ef4-8d98-4eb8-a6f3-07150765c658 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:04.805603 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b7ef4-8d98-4eb8-a6f3-07150765c658 service neutron] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:04.810720 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852040a-8886-44e1-8812-c85757b4eb01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:04.811611 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852040a-8886-44e1-8812-c85757b4eb01 service cinder] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:04.812022 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852040a-8886-44e1-8812-c85757b4eb01 service cinder] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:04.812300 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852040a-8886-44e1-8812-c85757b4eb01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:04.814106 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-7852040a-8886-44e1-8812-c85757b4eb01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:04.869209 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e71a7-5cb8-4de2-83f8-955ec2f15242 service neutron] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:04.869209 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-d56e71a7-5cb8-4de2-83f8-955ec2f15242 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:04.885969 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e71a7-5cb8-4de2-83f8-955ec2f15242 service neutron] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:04.893969 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1f14b-875b-48eb-90a7-7e43b9df6dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:04.908990 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1f14b-875b-48eb-90a7-7e43b9df6dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:04.921274 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1f14b-875b-48eb-90a7-7e43b9df6dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:04.923293 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1f14b-875b-48eb-90a7-7e43b9df6dc7 admin admin] PATH_INFO: `/v3/projects/8f1e31a2f4fe4222befdd4587ca8b2b1` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:04.925772 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1f14b-875b-48eb-90a7-7e43b9df6dc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f1e31a2f4fe4222befdd4587ca8b2b1)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:04.929611 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1f14b-875b-48eb-90a7-7e43b9df6dc7 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:04.953441 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852040a-8886-44e1-8812-c85757b4eb01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:04.955115 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852040a-8886-44e1-8812-c85757b4eb01 service cinder] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:04.972713 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1210/2438] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:04 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:05.088021 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c1d1f14b-875b-48eb-90a7-7e43b9df6dc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f1e31a2f4fe4222befdd4587ca8b2b1', 'request_id': 'req-c1d1f14b-875b-48eb-90a7-7e43b9df6dc7'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:05.101289 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c1d1f14b-875b-48eb-90a7-7e43b9df6dc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f1e31a2f4fe4222befdd4587ca8b2b1', 'request_id': 'req-c1d1f14b-875b-48eb-90a7-7e43b9df6dc7'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:05.112758 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c1d1f14b-875b-48eb-90a7-7e43b9df6dc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f1e31a2f4fe4222befdd4587ca8b2b1', 'request_id': 'req-c1d1f14b-875b-48eb-90a7-7e43b9df6dc7'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:05.189923 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c1d1f14b-875b-48eb-90a7-7e43b9df6dc7 admin admin] The token cache is being invalidate because project 8f1e31a2f4fe4222befdd4587ca8b2b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:31:05.190138 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c1d1f14b-875b-48eb-90a7-7e43b9df6dc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:05.190847 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c1d1f14b-875b-48eb-90a7-7e43b9df6dc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:05.192423 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1229/2439] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:31:04 2022] DELETE /identity/v3/projects/8f1e31a2f4fe4222befdd4587ca8b2b1 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:05.197531 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e367c-dd8d-4898-9a25-a80c1cb4de0f None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:05.198157 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e367c-dd8d-4898-9a25-a80c1cb4de0f None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:05.198541 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e367c-dd8d-4898-9a25-a80c1cb4de0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:05.235076 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-cc2e367c-dd8d-4898-9a25-a80c1cb4de0f None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:05.236766 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-cc2e367c-dd8d-4898-9a25-a80c1cb4de0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:05.312476 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1211/2440] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:31:05.317568 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb36450-43be-4ad4-9e3d-ba39260bb1a3 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:05.317982 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb36450-43be-4ad4-9e3d-ba39260bb1a3 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:05.318267 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb36450-43be-4ad4-9e3d-ba39260bb1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:05.338489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-2fb36450-43be-4ad4-9e3d-ba39260bb1a3 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:05.339752 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-2fb36450-43be-4ad4-9e3d-ba39260bb1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:05.347923 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1230/2441] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:05.352222 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e367c-dd8d-4898-9a25-a80c1cb4de0f None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:05.362146 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e367c-dd8d-4898-9a25-a80c1cb4de0f None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:05.366988 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acf602-5b31-4603-a193-cfde1a9e5863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:05.367526 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acf602-5b31-4603-a193-cfde1a9e5863 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:05.373283 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acf602-5b31-4603-a193-cfde1a9e5863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:05.373283 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acf602-5b31-4603-a193-cfde1a9e5863 admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:05.373283 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16acf602-5b31-4603-a193-cfde1a9e5863 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:31:05.373283 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16acf602-5b31-4603-a193-cfde1a9e5863 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:05.373283 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16acf602-5b31-4603-a193-cfde1a9e5863 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:05.387686 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1212/2442] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:31:05.389124 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb36450-43be-4ad4-9e3d-ba39260bb1a3 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:05.401153 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb36450-43be-4ad4-9e3d-ba39260bb1a3 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:05.407889 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747c591-e02e-4d48-b1c8-60233a74d125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:05.407889 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747c591-e02e-4d48-b1c8-60233a74d125 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:05.407889 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747c591-e02e-4d48-b1c8-60233a74d125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:05.408708 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747c591-e02e-4d48-b1c8-60233a74d125 admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:05.409452 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747c591-e02e-4d48-b1c8-60233a74d125 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:05.411625 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747c591-e02e-4d48-b1c8-60233a74d125 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:05.518378 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1231/2443] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:31:05 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:31:05.522593 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acf602-5b31-4603-a193-cfde1a9e5863 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:05.533446 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acf602-5b31-4603-a193-cfde1a9e5863 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:05.590453 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16899634-40b0-4115-a62f-0442e56341c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:05.591058 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16899634-40b0-4115-a62f-0442e56341c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:05.591338 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16899634-40b0-4115-a62f-0442e56341c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:05.591656 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16899634-40b0-4115-a62f-0442e56341c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:05.592294 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16899634-40b0-4115-a62f-0442e56341c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:05.594207 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16899634-40b0-4115-a62f-0442e56341c1 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:05.662841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:05.741856 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1213/2444] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:31:05 2022] POST /identity/v3/users => generated 287 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:31:05.743032 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747c591-e02e-4d48-b1c8-60233a74d125 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:05.757786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747c591-e02e-4d48-b1c8-60233a74d125 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:05.779928 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fb641-3735-474d-aa29-9034521dd821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:05.780927 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fb641-3735-474d-aa29-9034521dd821 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:05.782340 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fb641-3735-474d-aa29-9034521dd821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:05.782784 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fb641-3735-474d-aa29-9034521dd821 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:05.783946 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62fb641-3735-474d-aa29-9034521dd821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:05.786848 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62fb641-3735-474d-aa29-9034521dd821 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:05.806771 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1232/2445] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:05.809323 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16899634-40b0-4115-a62f-0442e56341c1 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:05.831414 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16899634-40b0-4115-a62f-0442e56341c1 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:05.835774 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7c33f-636f-4082-ac3d-183b5c88091e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:05.837019 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7c33f-636f-4082-ac3d-183b5c88091e admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:05.837019 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7c33f-636f-4082-ac3d-183b5c88091e admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:05.837243 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7c33f-636f-4082-ac3d-183b5c88091e admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:05.837898 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7c33f-636f-4082-ac3d-183b5c88091e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:05.841469 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7c33f-636f-4082-ac3d-183b5c88091e admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:05.858115 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1214/2446] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:05.859618 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fb641-3735-474d-aa29-9034521dd821 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:05.872843 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fb641-3735-474d-aa29-9034521dd821 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:05.877873 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00cb7a-e3e4-4b93-8d08-1337e0ae383d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:05.878624 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00cb7a-e3e4-4b93-8d08-1337e0ae383d admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:05.878981 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00cb7a-e3e4-4b93-8d08-1337e0ae383d admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:05.879498 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00cb7a-e3e4-4b93-8d08-1337e0ae383d admin admin] PATH_INFO: `/v3/projects/7d84f25ad9c44f8b8b0dcc9db9bf41ab/users/fa66ee807abe471fa7e7b33c0e72d74e/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:05.900527 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00cb7a-e3e4-4b93-8d08-1337e0ae383d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d84f25ad9c44f8b8b0dcc9db9bf41ab, user_id=fa66ee807abe471fa7e7b33c0e72d74e, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:05.900527 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00cb7a-e3e4-4b93-8d08-1337e0ae383d admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:06.002328 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:06.015713 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1233/2447] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:05 2022] PUT /identity/v3/projects/7d84f25ad9c44f8b8b0dcc9db9bf41ab/users/fa66ee807abe471fa7e7b33c0e72d74e/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:06.019971 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074b8ee-022e-49a5-9d09-8530d687a71e None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:06.020254 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074b8ee-022e-49a5-9d09-8530d687a71e None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:06.020548 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074b8ee-022e-49a5-9d09-8530d687a71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:06.048967 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-6074b8ee-022e-49a5-9d09-8530d687a71e None None] MFA Rules not processed for user `fa66ee807abe471fa7e7b33c0e72d74e`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:06.050327 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-6074b8ee-022e-49a5-9d09-8530d687a71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:06.121331 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1215/2448] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:31:06.133315 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00cb7a-e3e4-4b93-8d08-1337e0ae383d admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:06.135027 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-4e00cb7a-e3e4-4b93-8d08-1337e0ae383d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:06.205304 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00cb7a-e3e4-4b93-8d08-1337e0ae383d admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:06.209216 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48328bfa-6653-497c-b31d-825e9d1e539e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:06.209976 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48328bfa-6653-497c-b31d-825e9d1e539e service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:06.210369 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48328bfa-6653-497c-b31d-825e9d1e539e service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:06.210709 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48328bfa-6653-497c-b31d-825e9d1e539e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:06.219981 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48328bfa-6653-497c-b31d-825e9d1e539e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:06.221466 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48328bfa-6653-497c-b31d-825e9d1e539e service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:06.230966 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1234/2449] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:08.927320 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074b8ee-022e-49a5-9d09-8530d687a71e None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:08.928965 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-6074b8ee-022e-49a5-9d09-8530d687a71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:08.994896 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074b8ee-022e-49a5-9d09-8530d687a71e None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:08.999381 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964c715-2aaf-4be1-989d-1463de1d1f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:09.000232 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964c715-2aaf-4be1-989d-1463de1d1f4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:09.000510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964c715-2aaf-4be1-989d-1463de1d1f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:09.000783 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964c715-2aaf-4be1-989d-1463de1d1f4d admin admin] PATH_INFO: `/v3/users/bf2422e88cc94ef9b19f24f5d8e7d56c` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:09.001904 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964c715-2aaf-4be1-989d-1463de1d1f4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf2422e88cc94ef9b19f24f5d8e7d56c)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:09.003819 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964c715-2aaf-4be1-989d-1463de1d1f4d admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:09.314304 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:09.319967 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-f964c715-2aaf-4be1-989d-1463de1d1f4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf2422e88cc94ef9b19f24f5d8e7d56c'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:09.407893 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-f964c715-2aaf-4be1-989d-1463de1d1f4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf2422e88cc94ef9b19f24f5d8e7d56c'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:09.408633 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-f964c715-2aaf-4be1-989d-1463de1d1f4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf2422e88cc94ef9b19f24f5d8e7d56c'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:09.413034 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-f964c715-2aaf-4be1-989d-1463de1d1f4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf2422e88cc94ef9b19f24f5d8e7d56c'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:09.422193 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-f964c715-2aaf-4be1-989d-1463de1d1f4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf2422e88cc94ef9b19f24f5d8e7d56c'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:09.434893 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1216/2450] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:31:08 2022] DELETE /identity/v3/users/bf2422e88cc94ef9b19f24f5d8e7d56c => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:09.757869 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48328bfa-6653-497c-b31d-825e9d1e539e service cinder] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:09.771165 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48328bfa-6653-497c-b31d-825e9d1e539e service cinder] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:09.871931 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be05d9e-1e2e-4e3d-ad1c-f6a15c722a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:09.872576 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be05d9e-1e2e-4e3d-ad1c-f6a15c722a26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:09.873312 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be05d9e-1e2e-4e3d-ad1c-f6a15c722a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:09.873312 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be05d9e-1e2e-4e3d-ad1c-f6a15c722a26 admin admin] PATH_INFO: `/v3/projects/be7ad115782648ee9da0b20452460bd2` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:09.874389 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be05d9e-1e2e-4e3d-ad1c-f6a15c722a26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be7ad115782648ee9da0b20452460bd2)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:09.876455 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be05d9e-1e2e-4e3d-ad1c-f6a15c722a26 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:10.000474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-1be05d9e-1e2e-4e3d-ad1c-f6a15c722a26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be7ad115782648ee9da0b20452460bd2', 'request_id': 'req-1be05d9e-1e2e-4e3d-ad1c-f6a15c722a26'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:10.006094 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-1be05d9e-1e2e-4e3d-ad1c-f6a15c722a26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be7ad115782648ee9da0b20452460bd2', 'request_id': 'req-1be05d9e-1e2e-4e3d-ad1c-f6a15c722a26'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:10.012456 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-1be05d9e-1e2e-4e3d-ad1c-f6a15c722a26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be7ad115782648ee9da0b20452460bd2', 'request_id': 'req-1be05d9e-1e2e-4e3d-ad1c-f6a15c722a26'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:10.120729 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-1be05d9e-1e2e-4e3d-ad1c-f6a15c722a26 admin admin] The token cache is being invalidate because project be7ad115782648ee9da0b20452460bd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:31:10.121260 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-1be05d9e-1e2e-4e3d-ad1c-f6a15c722a26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:10.122236 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-1be05d9e-1e2e-4e3d-ad1c-f6a15c722a26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:10.123993 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1235/2451] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:31:09 2022] DELETE /identity/v3/projects/be7ad115782648ee9da0b20452460bd2 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:10.130037 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960c47b-21cd-4c4a-9dd0-92a8ef7a25c9 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:10.130540 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960c47b-21cd-4c4a-9dd0-92a8ef7a25c9 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:10.130972 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960c47b-21cd-4c4a-9dd0-92a8ef7a25c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:10.154763 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-d960c47b-21cd-4c4a-9dd0-92a8ef7a25c9 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:10.156176 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-d960c47b-21cd-4c4a-9dd0-92a8ef7a25c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:10.221429 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1217/2452] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:10.231150 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eca590-b2a3-469f-af66-0884d96685fe None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:10.231567 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eca590-b2a3-469f-af66-0884d96685fe None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:10.231912 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eca590-b2a3-469f-af66-0884d96685fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:10.252281 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-b1eca590-b2a3-469f-af66-0884d96685fe None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:10.253577 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-b1eca590-b2a3-469f-af66-0884d96685fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:10.264588 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1236/2453] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:10.267597 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960c47b-21cd-4c4a-9dd0-92a8ef7a25c9 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:10.278225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960c47b-21cd-4c4a-9dd0-92a8ef7a25c9 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:10.282731 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f901d-1e7b-4d3d-ae5c-125ddab68dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:10.283326 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f901d-1e7b-4d3d-ae5c-125ddab68dbb admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:10.283638 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f901d-1e7b-4d3d-ae5c-125ddab68dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:10.284085 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f901d-1e7b-4d3d-ae5c-125ddab68dbb admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:10.284600 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f901d-1e7b-4d3d-ae5c-125ddab68dbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:31:10.285131 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f901d-1e7b-4d3d-ae5c-125ddab68dbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:10.287598 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f901d-1e7b-4d3d-ae5c-125ddab68dbb admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:10.299937 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1218/2454] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:31:10.304418 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eca590-b2a3-469f-af66-0884d96685fe None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:10.313756 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eca590-b2a3-469f-af66-0884d96685fe None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:10.318480 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a565af5-087d-4783-bc97-ce5e29d33d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:10.321866 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a565af5-087d-4783-bc97-ce5e29d33d31 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:10.321866 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a565af5-087d-4783-bc97-ce5e29d33d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:10.321866 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a565af5-087d-4783-bc97-ce5e29d33d31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:10.321866 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a565af5-087d-4783-bc97-ce5e29d33d31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:10.322203 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a565af5-087d-4783-bc97-ce5e29d33d31 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:10.420041 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1237/2455] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:31:10 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:31:10.424478 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f901d-1e7b-4d3d-ae5c-125ddab68dbb admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:10.434279 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f901d-1e7b-4d3d-ae5c-125ddab68dbb admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:10.490895 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa1609-96ca-49c0-a92e-039dbc2cc4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:10.491523 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa1609-96ca-49c0-a92e-039dbc2cc4a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:10.491807 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa1609-96ca-49c0-a92e-039dbc2cc4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:10.492089 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa1609-96ca-49c0-a92e-039dbc2cc4a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:10.492718 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa1609-96ca-49c0-a92e-039dbc2cc4a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:10.494622 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa1609-96ca-49c0-a92e-039dbc2cc4a8 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:10.628856 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1219/2456] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:31:10 2022] POST /identity/v3/users => generated 289 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:31:10.632489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a565af5-087d-4783-bc97-ce5e29d33d31 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:10.638422 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:10.643415 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a565af5-087d-4783-bc97-ce5e29d33d31 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:10.648247 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661200c-1622-460c-955a-c002294b0f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:10.648836 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661200c-1622-460c-955a-c002294b0f50 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:10.649115 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661200c-1622-460c-955a-c002294b0f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:10.649387 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661200c-1622-460c-955a-c002294b0f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:10.650016 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8661200c-1622-460c-955a-c002294b0f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:10.652189 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8661200c-1622-460c-955a-c002294b0f50 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:10.661921 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1238/2457] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:10.665669 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa1609-96ca-49c0-a92e-039dbc2cc4a8 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:10.675546 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa1609-96ca-49c0-a92e-039dbc2cc4a8 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:10.680034 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8cadd4-f2ef-4ba9-bb5b-5745ff93ee64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:10.680617 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cadd4-f2ef-4ba9-bb5b-5745ff93ee64 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:10.680897 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cadd4-f2ef-4ba9-bb5b-5745ff93ee64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:10.681177 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cadd4-f2ef-4ba9-bb5b-5745ff93ee64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:10.681806 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8cadd4-f2ef-4ba9-bb5b-5745ff93ee64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:10.683930 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8cadd4-f2ef-4ba9-bb5b-5745ff93ee64 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:10.694363 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1220/2458] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:10.698851 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661200c-1622-460c-955a-c002294b0f50 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:10.708445 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661200c-1622-460c-955a-c002294b0f50 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:10.713298 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff9205-e2fc-454e-a6e8-30a8f1d5420e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:10.713990 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff9205-e2fc-454e-a6e8-30a8f1d5420e admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:10.714272 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff9205-e2fc-454e-a6e8-30a8f1d5420e admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:10.714547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff9205-e2fc-454e-a6e8-30a8f1d5420e admin admin] PATH_INFO: `/v3/projects/50798262886241b3b6b7d71dd7e89fa9/users/7d91c4525b2e4dfd8e80424682831947/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:10.728439 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff9205-e2fc-454e-a6e8-30a8f1d5420e admin admin] RBAC: Authorizing `identity:create_grant(project_id=50798262886241b3b6b7d71dd7e89fa9, user_id=7d91c4525b2e4dfd8e80424682831947, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:10.731122 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff9205-e2fc-454e-a6e8-30a8f1d5420e admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:10.861499 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8cadd4-f2ef-4ba9-bb5b-5745ff93ee64 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:10.863292 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-ac8cadd4-f2ef-4ba9-bb5b-5745ff93ee64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:10.876431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8cadd4-f2ef-4ba9-bb5b-5745ff93ee64 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:10.881059 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1171e5-0357-4ae5-b3d9-89c6be704fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:10.881674 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1171e5-0357-4ae5-b3d9-89c6be704fae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:10.881956 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1171e5-0357-4ae5-b3d9-89c6be704fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:10.882229 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1171e5-0357-4ae5-b3d9-89c6be704fae admin admin] PATH_INFO: `/v3/users/fa66ee807abe471fa7e7b33c0e72d74e` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:10.883342 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1171e5-0357-4ae5-b3d9-89c6be704fae admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa66ee807abe471fa7e7b33c0e72d74e)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:10.885270 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1171e5-0357-4ae5-b3d9-89c6be704fae admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:10.897263 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1239/2459] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:10 2022] PUT /identity/v3/projects/50798262886241b3b6b7d71dd7e89fa9/users/7d91c4525b2e4dfd8e80424682831947/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:10.902208 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:10.909590 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2a959-5ad4-4a57-b2c2-0eeda21b72d7 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:10.909881 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2a959-5ad4-4a57-b2c2-0eeda21b72d7 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:10.910211 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2a959-5ad4-4a57-b2c2-0eeda21b72d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:10.939222 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-14b2a959-5ad4-4a57-b2c2-0eeda21b72d7 None None] MFA Rules not processed for user `7d91c4525b2e4dfd8e80424682831947`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:10.940472 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-14b2a959-5ad4-4a57-b2c2-0eeda21b72d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:11.006657 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1240/2460] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:11.012894 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2a959-5ad4-4a57-b2c2-0eeda21b72d7 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:11.068171 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-6b1171e5-0357-4ae5-b3d9-89c6be704fae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa66ee807abe471fa7e7b33c0e72d74e'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:11.083057 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2a959-5ad4-4a57-b2c2-0eeda21b72d7 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:11.087846 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4750301-5e5a-4103-abee-ff4dff6c2ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:11.088448 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4750301-5e5a-4103-abee-ff4dff6c2ba3 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:11.088727 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4750301-5e5a-4103-abee-ff4dff6c2ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:11.089021 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4750301-5e5a-4103-abee-ff4dff6c2ba3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:11.089663 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4750301-5e5a-4103-abee-ff4dff6c2ba3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:11.091561 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4750301-5e5a-4103-abee-ff4dff6c2ba3 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:11.195640 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-6b1171e5-0357-4ae5-b3d9-89c6be704fae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa66ee807abe471fa7e7b33c0e72d74e'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:11.196311 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-6b1171e5-0357-4ae5-b3d9-89c6be704fae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa66ee807abe471fa7e7b33c0e72d74e'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:11.212941 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-6b1171e5-0357-4ae5-b3d9-89c6be704fae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa66ee807abe471fa7e7b33c0e72d74e'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:11.212941 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-6b1171e5-0357-4ae5-b3d9-89c6be704fae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa66ee807abe471fa7e7b33c0e72d74e'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:11.221460 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1221/2461] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:31:10 2022] DELETE /identity/v3/users/fa66ee807abe471fa7e7b33c0e72d74e => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:31:11.225840 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c1b39-ad31-4ee2-addd-207cdb2a35ec None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:11.226133 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c1b39-ad31-4ee2-addd-207cdb2a35ec None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:11.226417 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c1b39-ad31-4ee2-addd-207cdb2a35ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:11.242559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1241/2462] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:31:11 2022] POST /identity/v3/projects => generated 379 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:31:11.246830 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-684c1b39-ad31-4ee2-addd-207cdb2a35ec None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:11.248143 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-684c1b39-ad31-4ee2-addd-207cdb2a35ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:11.250632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4750301-5e5a-4103-abee-ff4dff6c2ba3 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:11.252408 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-f4750301-5e5a-4103-abee-ff4dff6c2ba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:11.311230 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1222/2463] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:31:11.316367 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c1b39-ad31-4ee2-addd-207cdb2a35ec None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:11.316367 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-684c1b39-ad31-4ee2-addd-207cdb2a35ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:11.324451 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4750301-5e5a-4103-abee-ff4dff6c2ba3 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:11.327010 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c1b39-ad31-4ee2-addd-207cdb2a35ec None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:11.329269 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40f90b-d6ed-4397-bede-b846eff719b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:11.329865 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40f90b-d6ed-4397-bede-b846eff719b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:11.330145 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40f90b-d6ed-4397-bede-b846eff719b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:11.330415 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40f90b-d6ed-4397-bede-b846eff719b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:11.331074 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40f90b-d6ed-4397-bede-b846eff719b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:11.331754 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec612d66-ef4f-42f7-b593-12aabeb15bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:11.332449 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec612d66-ef4f-42f7-b593-12aabeb15bc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:11.332802 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec612d66-ef4f-42f7-b593-12aabeb15bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:11.333097 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40f90b-d6ed-4397-bede-b846eff719b8 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:11.333211 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec612d66-ef4f-42f7-b593-12aabeb15bc6 admin admin] PATH_INFO: `/v3/users/655961875e40495c919c1447ef627e68` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:11.334405 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec612d66-ef4f-42f7-b593-12aabeb15bc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=655961875e40495c919c1447ef627e68)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:11.336402 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec612d66-ef4f-42f7-b593-12aabeb15bc6 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:11.447414 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1242/2464] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:31:11 2022] POST /identity/v3/users => generated 296 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:31:11.448176 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40f90b-d6ed-4397-bede-b846eff719b8 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:11.449828 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-0d40f90b-d6ed-4397-bede-b846eff719b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:11.508907 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40f90b-d6ed-4397-bede-b846eff719b8 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:11.512789 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5c16f-e222-4db2-af71-a6a68eb471b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:11.513507 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5c16f-e222-4db2-af71-a6a68eb471b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:11.513884 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5c16f-e222-4db2-af71-a6a68eb471b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:11.514181 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5c16f-e222-4db2-af71-a6a68eb471b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:11.523599 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c5c16f-e222-4db2-af71-a6a68eb471b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:11.525038 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c5c16f-e222-4db2-af71-a6a68eb471b1 service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:11.540335 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1243/2465] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:11.541199 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5c16f-e222-4db2-af71-a6a68eb471b1 service neutron] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:11.555845 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5c16f-e222-4db2-af71-a6a68eb471b1 service neutron] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:11.560933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543c365-f3e3-4dda-9398-bd45407ebd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:11.561554 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543c365-f3e3-4dda-9398-bd45407ebd83 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:11.561844 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543c365-f3e3-4dda-9398-bd45407ebd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:11.562128 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543c365-f3e3-4dda-9398-bd45407ebd83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:11.562797 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8543c365-f3e3-4dda-9398-bd45407ebd83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:11.564417 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8543c365-f3e3-4dda-9398-bd45407ebd83 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:11.580283 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1244/2466] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:11.583633 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543c365-f3e3-4dda-9398-bd45407ebd83 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:11.599074 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543c365-f3e3-4dda-9398-bd45407ebd83 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:11.605168 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eedec4-8abc-4486-9ef8-00de31501e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:11.605979 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eedec4-8abc-4486-9ef8-00de31501e59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:11.606265 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eedec4-8abc-4486-9ef8-00de31501e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:11.606760 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eedec4-8abc-4486-9ef8-00de31501e59 admin admin] PATH_INFO: `/v3/projects/6ce34b3087da4c0ca868422912ea0423/users/83a202bab1a240f5a5fb63b71bc5efee/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:11.622504 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eedec4-8abc-4486-9ef8-00de31501e59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ce34b3087da4c0ca868422912ea0423, user_id=83a202bab1a240f5a5fb63b71bc5efee, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:11.625228 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eedec4-8abc-4486-9ef8-00de31501e59 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:11.676333 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-ec612d66-ef4f-42f7-b593-12aabeb15bc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '655961875e40495c919c1447ef627e68'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:11.728710 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1245/2467] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:11 2022] PUT /identity/v3/projects/6ce34b3087da4c0ca868422912ea0423/users/83a202bab1a240f5a5fb63b71bc5efee/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:31:11.737648 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eedec4-8abc-4486-9ef8-00de31501e59 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:11.755871 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-ec612d66-ef4f-42f7-b593-12aabeb15bc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '655961875e40495c919c1447ef627e68'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:11.756547 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-ec612d66-ef4f-42f7-b593-12aabeb15bc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '655961875e40495c919c1447ef627e68'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:11.757234 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-ec612d66-ef4f-42f7-b593-12aabeb15bc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '655961875e40495c919c1447ef627e68'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:11.775140 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-ec612d66-ef4f-42f7-b593-12aabeb15bc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '655961875e40495c919c1447ef627e68'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:11.793182 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1223/2468] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:31:11 2022] DELETE /identity/v3/users/655961875e40495c919c1447ef627e68 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:11.799278 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ef12d-350b-4063-9734-10b6e6cc0bc9 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:11.799738 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ef12d-350b-4063-9734-10b6e6cc0bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:11.800502 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ef12d-350b-4063-9734-10b6e6cc0bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:11.825911 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-178ef12d-350b-4063-9734-10b6e6cc0bc9 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:11.827069 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-178ef12d-350b-4063-9734-10b6e6cc0bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:11.845961 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eedec4-8abc-4486-9ef8-00de31501e59 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:11.883425 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:11.897640 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1224/2469] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:31:11.898324 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ef12d-350b-4063-9734-10b6e6cc0bc9 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:11.901502 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-178ef12d-350b-4063-9734-10b6e6cc0bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:11.929613 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6689d17-0cb8-4a27-8f8b-cc0b5364aad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:11.932151 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6689d17-0cb8-4a27-8f8b-cc0b5364aad6 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:11.932618 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6689d17-0cb8-4a27-8f8b-cc0b5364aad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:11.932904 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6689d17-0cb8-4a27-8f8b-cc0b5364aad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:11.933615 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6689d17-0cb8-4a27-8f8b-cc0b5364aad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:11.935255 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6689d17-0cb8-4a27-8f8b-cc0b5364aad6 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:11.953248 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1246/2470] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:11.954419 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6689d17-0cb8-4a27-8f8b-cc0b5364aad6 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:11.957815 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-a6689d17-0cb8-4a27-8f8b-cc0b5364aad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:11.990904 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ef12d-350b-4063-9734-10b6e6cc0bc9 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:11.996959 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889dbb82-90e8-43be-ab25-a22697920b72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:11.997947 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889dbb82-90e8-43be-ab25-a22697920b72 service nova] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:11.997947 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889dbb82-90e8-43be-ab25-a22697920b72 service nova] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:11.998149 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889dbb82-90e8-43be-ab25-a22697920b72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:11.999915 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-889dbb82-90e8-43be-ab25-a22697920b72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:12.014626 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:12.017597 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889dbb82-90e8-43be-ab25-a22697920b72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:12.019187 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889dbb82-90e8-43be-ab25-a22697920b72 service nova] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:12.023497 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6689d17-0cb8-4a27-8f8b-cc0b5364aad6 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:12.028475 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab1b18-9b22-49a8-bb55-c57020bf6ad5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:12.030145 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab1b18-9b22-49a8-bb55-c57020bf6ad5 service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:12.030145 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab1b18-9b22-49a8-bb55-c57020bf6ad5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:12.030145 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab1b18-9b22-49a8-bb55-c57020bf6ad5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:12.031501 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1225/2471] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:12.036561 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889dbb82-90e8-43be-ab25-a22697920b72 service nova] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:12.039524 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-889dbb82-90e8-43be-ab25-a22697920b72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:12.040188 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab1b18-9b22-49a8-bb55-c57020bf6ad5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:12.041281 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab1b18-9b22-49a8-bb55-c57020bf6ad5 service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:12.052088 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889dbb82-90e8-43be-ab25-a22697920b72 service nova] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:12.052963 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1247/2472] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:12.057331 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01e4de-f530-4cf4-9d92-ebfdff0b6f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:12.058015 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01e4de-f530-4cf4-9d92-ebfdff0b6f34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:12.058303 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01e4de-f530-4cf4-9d92-ebfdff0b6f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:12.058583 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01e4de-f530-4cf4-9d92-ebfdff0b6f34 admin admin] PATH_INFO: `/v3/projects/6ce34b3087da4c0ca868422912ea0423/users/83a202bab1a240f5a5fb63b71bc5efee/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:12.060570 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed01e4de-f530-4cf4-9d92-ebfdff0b6f34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ce34b3087da4c0ca868422912ea0423, user_id=83a202bab1a240f5a5fb63b71bc5efee, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:12.063189 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed01e4de-f530-4cf4-9d92-ebfdff0b6f34 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:12.078841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1226/2473] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:12 2022] PUT /identity/v3/projects/6ce34b3087da4c0ca868422912ea0423/users/83a202bab1a240f5a5fb63b71bc5efee/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:12.088711 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab1b18-9b22-49a8-bb55-c57020bf6ad5 service neutron] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:12.090704 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-4bab1b18-9b22-49a8-bb55-c57020bf6ad5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:12.093758 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d65e3f-b227-461b-a573-47a163f11b00 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:12.096586 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d65e3f-b227-461b-a573-47a163f11b00 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:12.096778 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d65e3f-b227-461b-a573-47a163f11b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:12.106147 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab1b18-9b22-49a8-bb55-c57020bf6ad5 service neutron] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:12.171832 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-87d65e3f-b227-461b-a573-47a163f11b00 None None] MFA Rules not processed for user `83a202bab1a240f5a5fb63b71bc5efee`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:12.173149 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-87d65e3f-b227-461b-a573-47a163f11b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:12.192659 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479d1f3-6674-429b-bfad-978f19ab1e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:12.193744 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479d1f3-6674-429b-bfad-978f19ab1e04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:12.194113 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479d1f3-6674-429b-bfad-978f19ab1e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:12.194382 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479d1f3-6674-429b-bfad-978f19ab1e04 admin admin] PATH_INFO: `/v3/projects/7d84f25ad9c44f8b8b0dcc9db9bf41ab` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:12.196062 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b479d1f3-6674-429b-bfad-978f19ab1e04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d84f25ad9c44f8b8b0dcc9db9bf41ab)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:12.197600 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b479d1f3-6674-429b-bfad-978f19ab1e04 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:12.257022 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1227/2474] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:12 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:12.270618 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d65e3f-b227-461b-a573-47a163f11b00 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:12.272683 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-87d65e3f-b227-461b-a573-47a163f11b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:12.346509 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d65e3f-b227-461b-a573-47a163f11b00 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:12.359045 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-b479d1f3-6674-429b-bfad-978f19ab1e04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d84f25ad9c44f8b8b0dcc9db9bf41ab', 'request_id': 'req-b479d1f3-6674-429b-bfad-978f19ab1e04'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:12.364828 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-b479d1f3-6674-429b-bfad-978f19ab1e04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d84f25ad9c44f8b8b0dcc9db9bf41ab', 'request_id': 'req-b479d1f3-6674-429b-bfad-978f19ab1e04'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:12.372316 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-b479d1f3-6674-429b-bfad-978f19ab1e04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d84f25ad9c44f8b8b0dcc9db9bf41ab', 'request_id': 'req-b479d1f3-6674-429b-bfad-978f19ab1e04'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:12.421310 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ea8f0-d561-462a-bb55-8703ad9c7b29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:12.422064 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ea8f0-d561-462a-bb55-8703ad9c7b29 service cinder] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:12.422409 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ea8f0-d561-462a-bb55-8703ad9c7b29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:12.422754 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ea8f0-d561-462a-bb55-8703ad9c7b29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:12.427766 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-723ea8f0-d561-462a-bb55-8703ad9c7b29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:12.447247 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:12.486767 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-b479d1f3-6674-429b-bfad-978f19ab1e04 admin admin] The token cache is being invalidate because project 7d84f25ad9c44f8b8b0dcc9db9bf41ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:31:12.487051 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-b479d1f3-6674-429b-bfad-978f19ab1e04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:12.488280 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-b479d1f3-6674-429b-bfad-978f19ab1e04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:12.493619 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1248/2475] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:31:12 2022] DELETE /identity/v3/projects/7d84f25ad9c44f8b8b0dcc9db9bf41ab => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:31:12.495047 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a357464-9ae7-4117-9208-7f05e49e5371 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:12.495887 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a357464-9ae7-4117-9208-7f05e49e5371 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:12.496163 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a357464-9ae7-4117-9208-7f05e49e5371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:12.509444 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ea8f0-d561-462a-bb55-8703ad9c7b29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:12.512767 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ea8f0-d561-462a-bb55-8703ad9c7b29 service cinder] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:12.535511 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1228/2476] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:31:12.539237 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-4a357464-9ae7-4117-9208-7f05e49e5371 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:12.540842 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-4a357464-9ae7-4117-9208-7f05e49e5371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:12.603947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1249/2477] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:12.612336 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3d06d-1458-4e67-a619-083f5987a3a3 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:12.612626 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3d06d-1458-4e67-a619-083f5987a3a3 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:12.612914 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3d06d-1458-4e67-a619-083f5987a3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:12.632451 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-cec3d06d-1458-4e67-a619-083f5987a3a3 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:12.633653 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-cec3d06d-1458-4e67-a619-083f5987a3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:12.641993 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1229/2478] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:12.646383 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a357464-9ae7-4117-9208-7f05e49e5371 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:12.669259 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a357464-9ae7-4117-9208-7f05e49e5371 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:12.670399 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec3d06d-1458-4e67-a619-083f5987a3a3 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:12.671306 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e168dceb-3116-49d5-af7f-bcd34033cc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:12.672101 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168dceb-3116-49d5-af7f-bcd34033cc34 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:12.672280 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-cec3d06d-1458-4e67-a619-083f5987a3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:12.672728 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168dceb-3116-49d5-af7f-bcd34033cc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:12.673250 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168dceb-3116-49d5-af7f-bcd34033cc34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:12.674043 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e168dceb-3116-49d5-af7f-bcd34033cc34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:31:12.674572 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e168dceb-3116-49d5-af7f-bcd34033cc34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:12.676381 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e168dceb-3116-49d5-af7f-bcd34033cc34 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:12.693645 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1250/2479] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:31:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:31:12.693841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec3d06d-1458-4e67-a619-083f5987a3a3 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:12.699988 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce761d-7d94-4cd0-a745-c5ae42de1e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:12.700639 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e168dceb-3116-49d5-af7f-bcd34033cc34 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:12.700785 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce761d-7d94-4cd0-a745-c5ae42de1e31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:12.700908 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce761d-7d94-4cd0-a745-c5ae42de1e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:12.701419 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce761d-7d94-4cd0-a745-c5ae42de1e31 admin admin] PATH_INFO: `/v3/projects/71509c8bd0e34182935933409963adb5` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:12.702350 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce761d-7d94-4cd0-a745-c5ae42de1e31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71509c8bd0e34182935933409963adb5)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:12.704341 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce761d-7d94-4cd0-a745-c5ae42de1e31 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:12.714467 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e168dceb-3116-49d5-af7f-bcd34033cc34 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:12.724019 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548d29b-2dd8-4d60-be07-803361fa7176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:12.724019 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548d29b-2dd8-4d60-be07-803361fa7176 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:12.724019 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548d29b-2dd8-4d60-be07-803361fa7176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:12.724481 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548d29b-2dd8-4d60-be07-803361fa7176 admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:12.724923 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548d29b-2dd8-4d60-be07-803361fa7176 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:12.726984 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548d29b-2dd8-4d60-be07-803361fa7176 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:12.857896 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1251/2480] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:31:12 2022] POST /identity/v3/projects => generated 391 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:31:12.858936 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548d29b-2dd8-4d60-be07-803361fa7176 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:12.865173 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c9ce761d-7d94-4cd0-a745-c5ae42de1e31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71509c8bd0e34182935933409963adb5', 'request_id': 'req-c9ce761d-7d94-4cd0-a745-c5ae42de1e31'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:12.871553 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c9ce761d-7d94-4cd0-a745-c5ae42de1e31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71509c8bd0e34182935933409963adb5', 'request_id': 'req-c9ce761d-7d94-4cd0-a745-c5ae42de1e31'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:12.877863 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c9ce761d-7d94-4cd0-a745-c5ae42de1e31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71509c8bd0e34182935933409963adb5', 'request_id': 'req-c9ce761d-7d94-4cd0-a745-c5ae42de1e31'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:12.919130 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548d29b-2dd8-4d60-be07-803361fa7176 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:12.923816 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a6197-63c5-47d1-b8e9-a5df135ca050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:12.924407 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a6197-63c5-47d1-b8e9-a5df135ca050 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:12.924688 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a6197-63c5-47d1-b8e9-a5df135ca050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:12.924961 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a6197-63c5-47d1-b8e9-a5df135ca050 admin admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:12.925570 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a6197-63c5-47d1-b8e9-a5df135ca050 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:12.927489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a6197-63c5-47d1-b8e9-a5df135ca050 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:12.974200 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:12.980619 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c9ce761d-7d94-4cd0-a745-c5ae42de1e31 admin admin] The token cache is being invalidate because project 71509c8bd0e34182935933409963adb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:31:12.980910 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c9ce761d-7d94-4cd0-a745-c5ae42de1e31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:12.981541 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c9ce761d-7d94-4cd0-a745-c5ae42de1e31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:12.983022 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1230/2481] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:31:12 2022] DELETE /identity/v3/projects/71509c8bd0e34182935933409963adb5 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:12.986770 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce761d-7d94-4cd0-a745-c5ae42de1e31 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:12.988059 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-c9ce761d-7d94-4cd0-a745-c5ae42de1e31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:13.051028 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce761d-7d94-4cd0-a745-c5ae42de1e31 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:13.056228 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a0efa0-2f53-4c35-9f12-03e871c17744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:13.056928 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0efa0-2f53-4c35-9f12-03e871c17744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:13.057911 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0efa0-2f53-4c35-9f12-03e871c17744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:13.058193 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0efa0-2f53-4c35-9f12-03e871c17744 admin admin] PATH_INFO: `/v3/users/8afb2bfea65b428992837d6452e71da0` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:13.059459 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a0efa0-2f53-4c35-9f12-03e871c17744 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8afb2bfea65b428992837d6452e71da0)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:13.063918 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1252/2482] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:31:12 2022] POST /identity/v3/users => generated 296 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:31:13.064374 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a0efa0-2f53-4c35-9f12-03e871c17744 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:13.064724 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a6197-63c5-47d1-b8e9-a5df135ca050 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:13.066392 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-324a6197-63c5-47d1-b8e9-a5df135ca050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:13.078044 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a6197-63c5-47d1-b8e9-a5df135ca050 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:13.082691 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18c0bc-677d-45b9-8a4c-095d43a77bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:13.083282 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18c0bc-677d-45b9-8a4c-095d43a77bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:13.083590 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18c0bc-677d-45b9-8a4c-095d43a77bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:13.083862 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18c0bc-677d-45b9-8a4c-095d43a77bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:13.084490 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a18c0bc-677d-45b9-8a4c-095d43a77bd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:13.086059 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a18c0bc-677d-45b9-8a4c-095d43a77bd6 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:13.093609 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:13.098389 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1253/2483] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:31:13.102374 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18c0bc-677d-45b9-8a4c-095d43a77bd6 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:13.112506 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18c0bc-677d-45b9-8a4c-095d43a77bd6 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:13.117268 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487c03f-ed81-438d-bd5c-aa8cbf78bb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:13.117841 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487c03f-ed81-438d-bd5c-aa8cbf78bb7d admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:13.118149 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487c03f-ed81-438d-bd5c-aa8cbf78bb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:13.118421 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487c03f-ed81-438d-bd5c-aa8cbf78bb7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:13.119042 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e487c03f-ed81-438d-bd5c-aa8cbf78bb7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:13.120689 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e487c03f-ed81-438d-bd5c-aa8cbf78bb7d admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:13.130985 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1254/2484] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:31:13.135290 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487c03f-ed81-438d-bd5c-aa8cbf78bb7d admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:13.144538 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487c03f-ed81-438d-bd5c-aa8cbf78bb7d admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:13.149004 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae1070-6eb1-45d7-9d59-457ff9ebdcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:13.149604 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae1070-6eb1-45d7-9d59-457ff9ebdcd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:13.149884 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae1070-6eb1-45d7-9d59-457ff9ebdcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:13.150161 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae1070-6eb1-45d7-9d59-457ff9ebdcd5 admin admin] PATH_INFO: `/v3/projects/a0347a199fa94e96b4e4540b58fa8a4c/users/1adb4fc2079e47e9b1bcc42011868951/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:13.164399 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aae1070-6eb1-45d7-9d59-457ff9ebdcd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0347a199fa94e96b4e4540b58fa8a4c, user_id=1adb4fc2079e47e9b1bcc42011868951, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:13.167696 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aae1070-6eb1-45d7-9d59-457ff9ebdcd5 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:13.258325 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1255/2485] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:13 2022] PUT /identity/v3/projects/a0347a199fa94e96b4e4540b58fa8a4c/users/1adb4fc2079e47e9b1bcc42011868951/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:31:13.267668 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c6a0efa0-2f53-4c35-9f12-03e871c17744 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8afb2bfea65b428992837d6452e71da0'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:13.268937 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd62472-5ea9-489c-86c4-7fa5747cfd5e None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:13.269230 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd62472-5ea9-489c-86c4-7fa5747cfd5e None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:13.269507 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd62472-5ea9-489c-86c4-7fa5747cfd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:13.297164 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-5cd62472-5ea9-489c-86c4-7fa5747cfd5e None None] MFA Rules not processed for user `1adb4fc2079e47e9b1bcc42011868951`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:13.298359 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-5cd62472-5ea9-489c-86c4-7fa5747cfd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:13.361306 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1256/2486] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:13 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:13.371911 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd62472-5ea9-489c-86c4-7fa5747cfd5e None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:13.373292 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-5cd62472-5ea9-489c-86c4-7fa5747cfd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:13.419339 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c6a0efa0-2f53-4c35-9f12-03e871c17744 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8afb2bfea65b428992837d6452e71da0'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:13.426723 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c6a0efa0-2f53-4c35-9f12-03e871c17744 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8afb2bfea65b428992837d6452e71da0'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:13.426723 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c6a0efa0-2f53-4c35-9f12-03e871c17744 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8afb2bfea65b428992837d6452e71da0'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:13.436341 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c6a0efa0-2f53-4c35-9f12-03e871c17744 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8afb2bfea65b428992837d6452e71da0'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:13.447008 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd62472-5ea9-489c-86c4-7fa5747cfd5e None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:13.452953 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e3f85-fb9e-4a16-849e-5d6cd68dcc0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:13.453685 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e3f85-fb9e-4a16-849e-5d6cd68dcc0d service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:13.454020 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e3f85-fb9e-4a16-849e-5d6cd68dcc0d service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:13.454307 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e3f85-fb9e-4a16-849e-5d6cd68dcc0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:13.456188 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-0b9e3f85-fb9e-4a16-849e-5d6cd68dcc0d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:13.458520 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1231/2487] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:31:12 2022] DELETE /identity/v3/users/8afb2bfea65b428992837d6452e71da0 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:31:13.469099 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e3f85-fb9e-4a16-849e-5d6cd68dcc0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:13.470463 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e3f85-fb9e-4a16-849e-5d6cd68dcc0d service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:13.485250 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1257/2488] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:13 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:31:13.661808 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcb895-b4f1-4ba8-9790-81d7923382c5 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:13.662097 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcb895-b4f1-4ba8-9790-81d7923382c5 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:13.662376 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcb895-b4f1-4ba8-9790-81d7923382c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:13.681073 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-84bcb895-b4f1-4ba8-9790-81d7923382c5 None None] MFA Rules not processed for user `1d39439278814d4faac4cfb1e71aa4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:13.682262 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-84bcb895-b4f1-4ba8-9790-81d7923382c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:13.747595 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1232/2489] 10.222.0.23 () {58 vars in 967 bytes} [Mon Aug 8 02:31:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:31:13.760743 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e3f85-fb9e-4a16-849e-5d6cd68dcc0d service cinder] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:13.764372 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-0b9e3f85-fb9e-4a16-849e-5d6cd68dcc0d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:13.824900 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:13.840424 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e3f85-fb9e-4a16-849e-5d6cd68dcc0d service cinder] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:13.899198 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f30bb-d4a9-4a1b-aaa6-4acd3154daf0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c212009b6a44e1bad92769630116408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:13.899864 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f30bb-d4a9-4a1b-aaa6-4acd3154daf0 service swift] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:13.900147 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f30bb-d4a9-4a1b-aaa6-4acd3154daf0 service swift] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:13.904300 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f30bb-d4a9-4a1b-aaa6-4acd3154daf0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:13.909311 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f30bb-d4a9-4a1b-aaa6-4acd3154daf0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:13.910887 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f30bb-d4a9-4a1b-aaa6-4acd3154daf0 service swift] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:13.919490 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1258/2490] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 8 02:31:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:31:14.020046 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcb895-b4f1-4ba8-9790-81d7923382c5 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:14.021454 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-84bcb895-b4f1-4ba8-9790-81d7923382c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:14.106923 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcb895-b4f1-4ba8-9790-81d7923382c5 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:14.117432 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d197b17-34fb-4b9d-a1ab-77f3e4554b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:14.118138 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d197b17-34fb-4b9d-a1ab-77f3e4554b2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:14.118322 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d197b17-34fb-4b9d-a1ab-77f3e4554b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:14.118598 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d197b17-34fb-4b9d-a1ab-77f3e4554b2f admin admin] PATH_INFO: `/v3/projects/9c08be5fc86047faa0cedec27703d178` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:14.119795 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d197b17-34fb-4b9d-a1ab-77f3e4554b2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c08be5fc86047faa0cedec27703d178)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:14.121765 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d197b17-34fb-4b9d-a1ab-77f3e4554b2f admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:14.277951 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-6d197b17-34fb-4b9d-a1ab-77f3e4554b2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c08be5fc86047faa0cedec27703d178', 'request_id': 'req-6d197b17-34fb-4b9d-a1ab-77f3e4554b2f'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:14.283534 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-6d197b17-34fb-4b9d-a1ab-77f3e4554b2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c08be5fc86047faa0cedec27703d178', 'request_id': 'req-6d197b17-34fb-4b9d-a1ab-77f3e4554b2f'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:14.289918 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-6d197b17-34fb-4b9d-a1ab-77f3e4554b2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c08be5fc86047faa0cedec27703d178', 'request_id': 'req-6d197b17-34fb-4b9d-a1ab-77f3e4554b2f'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:14.396304 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-6d197b17-34fb-4b9d-a1ab-77f3e4554b2f admin admin] The token cache is being invalidate because project 9c08be5fc86047faa0cedec27703d178 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:31:14.396846 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-6d197b17-34fb-4b9d-a1ab-77f3e4554b2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:14.397868 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-6d197b17-34fb-4b9d-a1ab-77f3e4554b2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:14.400208 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1233/2491] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:31:14 2022] DELETE /identity/v3/projects/9c08be5fc86047faa0cedec27703d178 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:14.407723 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8287a-7f6c-4174-a781-34589258f4e3 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:14.408807 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8287a-7f6c-4174-a781-34589258f4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:14.410247 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8287a-7f6c-4174-a781-34589258f4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:14.436161 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-59d8287a-7f6c-4174-a781-34589258f4e3 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:14.437681 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-59d8287a-7f6c-4174-a781-34589258f4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:14.513552 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1259/2492] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:31:14.522084 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c272567-86a0-4874-8f94-b2e509b9ff58 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:14.522644 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c272567-86a0-4874-8f94-b2e509b9ff58 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:14.523156 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c272567-86a0-4874-8f94-b2e509b9ff58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:14.571458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-6c272567-86a0-4874-8f94-b2e509b9ff58 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:14.572826 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-6c272567-86a0-4874-8f94-b2e509b9ff58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:14.576260 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d8287a-7f6c-4174-a781-34589258f4e3 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:14.578231 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-59d8287a-7f6c-4174-a781-34589258f4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:14.596964 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1234/2493] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:14.600447 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c272567-86a0-4874-8f94-b2e509b9ff58 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:14.624738 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c272567-86a0-4874-8f94-b2e509b9ff58 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:14.632971 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cbded-4d1c-4268-873d-8fbd717b1b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:14.633661 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cbded-4d1c-4268-873d-8fbd717b1b38 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:14.634731 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cbded-4d1c-4268-873d-8fbd717b1b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:14.635207 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cbded-4d1c-4268-873d-8fbd717b1b38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:14.636006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344cbded-4d1c-4268-873d-8fbd717b1b38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:31:14.636374 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344cbded-4d1c-4268-873d-8fbd717b1b38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:14.640808 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:14.641586 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344cbded-4d1c-4268-873d-8fbd717b1b38 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:14.658681 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1235/2494] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:31:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:31:14.663563 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cbded-4d1c-4268-873d-8fbd717b1b38 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:14.680481 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cbded-4d1c-4268-873d-8fbd717b1b38 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:14.687616 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854a95a-0eb2-467e-899b-0424459ee22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:14.688360 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854a95a-0eb2-467e-899b-0424459ee22c admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:14.688741 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854a95a-0eb2-467e-899b-0424459ee22c admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:14.689130 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854a95a-0eb2-467e-899b-0424459ee22c admin admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:14.689852 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854a95a-0eb2-467e-899b-0424459ee22c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:14.691888 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854a95a-0eb2-467e-899b-0424459ee22c admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:14.707520 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d8287a-7f6c-4174-a781-34589258f4e3 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:14.712283 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe3962-c7bf-4a42-ad57-b5cd0b797b9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:14.714364 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe3962-c7bf-4a42-ad57-b5cd0b797b9c service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:14.719993 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe3962-c7bf-4a42-ad57-b5cd0b797b9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:14.719993 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe3962-c7bf-4a42-ad57-b5cd0b797b9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:14.719993 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-0bfe3962-c7bf-4a42-ad57-b5cd0b797b9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:14.800103 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe3962-c7bf-4a42-ad57-b5cd0b797b9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:14.801777 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe3962-c7bf-4a42-ad57-b5cd0b797b9c service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:14.804122 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1236/2495] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:31:14 2022] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:31:14.808510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854a95a-0eb2-467e-899b-0424459ee22c admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:14.812407 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1260/2496] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:14 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:14.873466 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854a95a-0eb2-467e-899b-0424459ee22c admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:14.878242 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e35fa-3b74-4e5a-a8f5-ac147954b3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:14.878846 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e35fa-3b74-4e5a-a8f5-ac147954b3fe admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:14.879129 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e35fa-3b74-4e5a-a8f5-ac147954b3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:14.879535 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e35fa-3b74-4e5a-a8f5-ac147954b3fe admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:14.880156 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e35fa-3b74-4e5a-a8f5-ac147954b3fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:14.882056 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e35fa-3b74-4e5a-a8f5-ac147954b3fe admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:14.931066 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:15.001403 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1237/2497] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:31:14 2022] POST /identity/v3/users => generated 287 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:31:15.006368 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe3962-c7bf-4a42-ad57-b5cd0b797b9c service cinder] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:15.018103 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe3962-c7bf-4a42-ad57-b5cd0b797b9c service cinder] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:15.022564 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f80267-6032-44a8-9622-7cd81fdce6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:15.023227 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f80267-6032-44a8-9622-7cd81fdce6bf admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:15.028651 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f80267-6032-44a8-9622-7cd81fdce6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:15.028651 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f80267-6032-44a8-9622-7cd81fdce6bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:15.028651 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f80267-6032-44a8-9622-7cd81fdce6bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:15.028651 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f80267-6032-44a8-9622-7cd81fdce6bf admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:15.044442 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1261/2498] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:15.045771 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e35fa-3b74-4e5a-a8f5-ac147954b3fe admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:15.059035 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e35fa-3b74-4e5a-a8f5-ac147954b3fe admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:15.065731 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe23ff-d76f-4c8f-846c-3922ffa0b9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:15.066868 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe23ff-d76f-4c8f-846c-3922ffa0b9b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:15.068523 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe23ff-d76f-4c8f-846c-3922ffa0b9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:15.068523 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe23ff-d76f-4c8f-846c-3922ffa0b9b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:15.069362 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe23ff-d76f-4c8f-846c-3922ffa0b9b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:15.072222 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe23ff-d76f-4c8f-846c-3922ffa0b9b3 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:15.088559 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1238/2499] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:31:15.091502 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f80267-6032-44a8-9622-7cd81fdce6bf admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:15.103774 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f80267-6032-44a8-9622-7cd81fdce6bf admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:15.109021 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9511ac2-a38b-4202-b4fb-d0b9075095d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:15.109760 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9511ac2-a38b-4202-b4fb-d0b9075095d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:15.110196 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9511ac2-a38b-4202-b4fb-d0b9075095d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:15.110493 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9511ac2-a38b-4202-b4fb-d0b9075095d2 admin admin] PATH_INFO: `/v3/projects/98cb2f80460e48f19450f147cda6da37/users/025d319c2b094054ae0374177d67b725/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:15.128180 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9511ac2-a38b-4202-b4fb-d0b9075095d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98cb2f80460e48f19450f147cda6da37, user_id=025d319c2b094054ae0374177d67b725, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:15.130945 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9511ac2-a38b-4202-b4fb-d0b9075095d2 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:15.286722 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1262/2500] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:15 2022] PUT /identity/v3/projects/98cb2f80460e48f19450f147cda6da37/users/025d319c2b094054ae0374177d67b725/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:15.352842 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e0b76-eeed-4827-ba53-ac919cbf6879 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:15.353397 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e0b76-eeed-4827-ba53-ac919cbf6879 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:15.353397 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e0b76-eeed-4827-ba53-ac919cbf6879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:15.382412 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-904e0b76-eeed-4827-ba53-ac919cbf6879 None None] MFA Rules not processed for user `025d319c2b094054ae0374177d67b725`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:15.383688 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-904e0b76-eeed-4827-ba53-ac919cbf6879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:15.446621 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1239/2501] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:15.458965 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9511ac2-a38b-4202-b4fb-d0b9075095d2 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:15.521010 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9511ac2-a38b-4202-b4fb-d0b9075095d2 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:15.525342 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b9dba-907e-4feb-bfec-8e21c074066a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:15.525950 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b9dba-907e-4feb-bfec-8e21c074066a service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:15.526231 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b9dba-907e-4feb-bfec-8e21c074066a service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:15.526535 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b9dba-907e-4feb-bfec-8e21c074066a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:15.535865 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72b9dba-907e-4feb-bfec-8e21c074066a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:15.537475 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72b9dba-907e-4feb-bfec-8e21c074066a service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:15.547293 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1263/2502] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:31:15.771255 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:16.053182 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:16.310418 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:19.358545 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e0b76-eeed-4827-ba53-ac919cbf6879 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:19.367921 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-904e0b76-eeed-4827-ba53-ac919cbf6879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:19.434738 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e0b76-eeed-4827-ba53-ac919cbf6879 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:19.439274 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef8d83-6132-4f6b-8c52-c097a6728489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:19.440204 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef8d83-6132-4f6b-8c52-c097a6728489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:19.440509 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef8d83-6132-4f6b-8c52-c097a6728489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:19.440784 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef8d83-6132-4f6b-8c52-c097a6728489 admin admin] PATH_INFO: `/v3/users/7d91c4525b2e4dfd8e80424682831947` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:19.441912 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef8d83-6132-4f6b-8c52-c097a6728489 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d91c4525b2e4dfd8e80424682831947)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:19.443843 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef8d83-6132-4f6b-8c52-c097a6728489 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:19.729126 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-9cef8d83-6132-4f6b-8c52-c097a6728489 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d91c4525b2e4dfd8e80424682831947'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:19.824060 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-9cef8d83-6132-4f6b-8c52-c097a6728489 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d91c4525b2e4dfd8e80424682831947'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:19.824879 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-9cef8d83-6132-4f6b-8c52-c097a6728489 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d91c4525b2e4dfd8e80424682831947'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:19.825530 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-9cef8d83-6132-4f6b-8c52-c097a6728489 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d91c4525b2e4dfd8e80424682831947'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:19.839192 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-9cef8d83-6132-4f6b-8c52-c097a6728489 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d91c4525b2e4dfd8e80424682831947'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:19.841214 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:19.851736 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1240/2503] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:31:19 2022] DELETE /identity/v3/users/7d91c4525b2e4dfd8e80424682831947 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:19.856234 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6151ae0-3b84-4c4f-8785-b527c705dae8 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:19.856778 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6151ae0-3b84-4c4f-8785-b527c705dae8 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:19.856778 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6151ae0-3b84-4c4f-8785-b527c705dae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:19.876326 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-c6151ae0-3b84-4c4f-8785-b527c705dae8 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:19.877607 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-c6151ae0-3b84-4c4f-8785-b527c705dae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:19.938821 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1264/2504] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:19.948644 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef8d83-6132-4f6b-8c52-c097a6728489 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:19.950033 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-9cef8d83-6132-4f6b-8c52-c097a6728489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:20.007399 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef8d83-6132-4f6b-8c52-c097a6728489 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:20.010860 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ee3cf-fef7-4e42-94cd-91a4c7bec2f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:20.011536 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ee3cf-fef7-4e42-94cd-91a4c7bec2f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:20.011815 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ee3cf-fef7-4e42-94cd-91a4c7bec2f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:20.012087 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ee3cf-fef7-4e42-94cd-91a4c7bec2f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:20.020788 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ee3cf-fef7-4e42-94cd-91a4c7bec2f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:20.022187 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ee3cf-fef7-4e42-94cd-91a4c7bec2f1 service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:20.031457 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1241/2505] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:20.642817 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6151ae0-3b84-4c4f-8785-b527c705dae8 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:20.646005 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-c6151ae0-3b84-4c4f-8785-b527c705dae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:20.661037 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6151ae0-3b84-4c4f-8785-b527c705dae8 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:20.666232 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94171fdc-5b07-4cff-9bf7-a0def2c28129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:20.666994 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94171fdc-5b07-4cff-9bf7-a0def2c28129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:20.667281 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94171fdc-5b07-4cff-9bf7-a0def2c28129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:20.667588 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94171fdc-5b07-4cff-9bf7-a0def2c28129 admin admin] PATH_INFO: `/v3/projects/50798262886241b3b6b7d71dd7e89fa9` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:20.668825 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94171fdc-5b07-4cff-9bf7-a0def2c28129 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50798262886241b3b6b7d71dd7e89fa9)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:20.672267 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94171fdc-5b07-4cff-9bf7-a0def2c28129 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:20.789032 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-94171fdc-5b07-4cff-9bf7-a0def2c28129 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50798262886241b3b6b7d71dd7e89fa9', 'request_id': 'req-94171fdc-5b07-4cff-9bf7-a0def2c28129'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:20.794765 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-94171fdc-5b07-4cff-9bf7-a0def2c28129 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50798262886241b3b6b7d71dd7e89fa9', 'request_id': 'req-94171fdc-5b07-4cff-9bf7-a0def2c28129'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:20.801383 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-94171fdc-5b07-4cff-9bf7-a0def2c28129 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50798262886241b3b6b7d71dd7e89fa9', 'request_id': 'req-94171fdc-5b07-4cff-9bf7-a0def2c28129'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:20.868871 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-94171fdc-5b07-4cff-9bf7-a0def2c28129 admin admin] The token cache is being invalidate because project 50798262886241b3b6b7d71dd7e89fa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:31:20.870576 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-94171fdc-5b07-4cff-9bf7-a0def2c28129 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:20.870576 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-94171fdc-5b07-4cff-9bf7-a0def2c28129 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:20.872289 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1265/2506] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:31:20 2022] DELETE /identity/v3/projects/50798262886241b3b6b7d71dd7e89fa9 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:20.876492 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ee3cf-fef7-4e42-94cd-91a4c7bec2f1 service neutron] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:20.892781 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ee3cf-fef7-4e42-94cd-91a4c7bec2f1 service neutron] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:20.953661 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595a6ba-b5b5-4d2b-bc25-f4afa287db86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:20.954389 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595a6ba-b5b5-4d2b-bc25-f4afa287db86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:20.954739 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595a6ba-b5b5-4d2b-bc25-f4afa287db86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:20.955112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595a6ba-b5b5-4d2b-bc25-f4afa287db86 admin admin] PATH_INFO: `/v3/users/83a202bab1a240f5a5fb63b71bc5efee` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:20.956400 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595a6ba-b5b5-4d2b-bc25-f4afa287db86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83a202bab1a240f5a5fb63b71bc5efee)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:20.958360 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595a6ba-b5b5-4d2b-bc25-f4afa287db86 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:21.188449 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-7595a6ba-b5b5-4d2b-bc25-f4afa287db86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83a202bab1a240f5a5fb63b71bc5efee'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:21.296487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-7595a6ba-b5b5-4d2b-bc25-f4afa287db86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83a202bab1a240f5a5fb63b71bc5efee'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:21.297154 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-7595a6ba-b5b5-4d2b-bc25-f4afa287db86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83a202bab1a240f5a5fb63b71bc5efee'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:21.297769 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-7595a6ba-b5b5-4d2b-bc25-f4afa287db86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83a202bab1a240f5a5fb63b71bc5efee'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:21.313557 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-7595a6ba-b5b5-4d2b-bc25-f4afa287db86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83a202bab1a240f5a5fb63b71bc5efee'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:21.323312 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1242/2507] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:31:20 2022] DELETE /identity/v3/users/83a202bab1a240f5a5fb63b71bc5efee => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:31:21.837880 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94171fdc-5b07-4cff-9bf7-a0def2c28129 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:21.839666 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-94171fdc-5b07-4cff-9bf7-a0def2c28129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:21.853472 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94171fdc-5b07-4cff-9bf7-a0def2c28129 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:21.885678 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:21.920175 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e2155-c7b2-434e-be87-a57b6c487f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:21.920175 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e2155-c7b2-434e-be87-a57b6c487f29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:21.920175 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e2155-c7b2-434e-be87-a57b6c487f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:21.920175 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e2155-c7b2-434e-be87-a57b6c487f29 admin admin] PATH_INFO: `/v3/projects/6ce34b3087da4c0ca868422912ea0423` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:21.920518 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e2155-c7b2-434e-be87-a57b6c487f29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ce34b3087da4c0ca868422912ea0423)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:21.920518 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e2155-c7b2-434e-be87-a57b6c487f29 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:22.064695 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-ea9e2155-c7b2-434e-be87-a57b6c487f29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ce34b3087da4c0ca868422912ea0423', 'request_id': 'req-ea9e2155-c7b2-434e-be87-a57b6c487f29'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:22.070220 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-ea9e2155-c7b2-434e-be87-a57b6c487f29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ce34b3087da4c0ca868422912ea0423', 'request_id': 'req-ea9e2155-c7b2-434e-be87-a57b6c487f29'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:22.076544 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-ea9e2155-c7b2-434e-be87-a57b6c487f29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ce34b3087da4c0ca868422912ea0423', 'request_id': 'req-ea9e2155-c7b2-434e-be87-a57b6c487f29'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:22.154357 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-ea9e2155-c7b2-434e-be87-a57b6c487f29 admin admin] The token cache is being invalidate because project 6ce34b3087da4c0ca868422912ea0423 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:31:22.154682 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-ea9e2155-c7b2-434e-be87-a57b6c487f29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:22.155313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-ea9e2155-c7b2-434e-be87-a57b6c487f29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:22.156935 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1266/2508] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:31:21 2022] DELETE /identity/v3/projects/6ce34b3087da4c0ca868422912ea0423 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:22.162051 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10de35-65eb-4fec-bf55-35704f30fa9f None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:22.162544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10de35-65eb-4fec-bf55-35704f30fa9f None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:22.162874 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10de35-65eb-4fec-bf55-35704f30fa9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:22.183285 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-9f10de35-65eb-4fec-bf55-35704f30fa9f None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:22.184520 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-9f10de35-65eb-4fec-bf55-35704f30fa9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:22.192918 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:22.259015 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1243/2509] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:22.267276 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb983e3-c400-4395-a228-4931c1f11b41 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:22.271760 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb983e3-c400-4395-a228-4931c1f11b41 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:22.271760 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb983e3-c400-4395-a228-4931c1f11b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:22.289974 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-ebb983e3-c400-4395-a228-4931c1f11b41 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:22.291244 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-ebb983e3-c400-4395-a228-4931c1f11b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:22.299666 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1267/2510] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:31:22.304017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f10de35-65eb-4fec-bf55-35704f30fa9f None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:22.316555 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f10de35-65eb-4fec-bf55-35704f30fa9f None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:22.321458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5f291-2a9b-4318-943e-3d3dfb1db3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:22.322073 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5f291-2a9b-4318-943e-3d3dfb1db3ee admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:22.322434 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5f291-2a9b-4318-943e-3d3dfb1db3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:22.322769 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5f291-2a9b-4318-943e-3d3dfb1db3ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:22.323470 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5f291-2a9b-4318-943e-3d3dfb1db3ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:31:22.323799 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5f291-2a9b-4318-943e-3d3dfb1db3ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:22.325449 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5f291-2a9b-4318-943e-3d3dfb1db3ee admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:22.339346 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1244/2511] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:31:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:31:22.345945 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb983e3-c400-4395-a228-4931c1f11b41 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:22.355190 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb983e3-c400-4395-a228-4931c1f11b41 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:22.360405 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f52a1-7b87-44a7-adda-44a424c5ff88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:22.361008 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f52a1-7b87-44a7-adda-44a424c5ff88 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:22.361431 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f52a1-7b87-44a7-adda-44a424c5ff88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:22.361710 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f52a1-7b87-44a7-adda-44a424c5ff88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:22.362344 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f52a1-7b87-44a7-adda-44a424c5ff88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:22.364267 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f52a1-7b87-44a7-adda-44a424c5ff88 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:22.503871 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1268/2512] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:31:22 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:31:22.505183 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5f291-2a9b-4318-943e-3d3dfb1db3ee admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:22.517889 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5f291-2a9b-4318-943e-3d3dfb1db3ee admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:22.579853 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e1018-f317-44f4-a775-0a17bce9f699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:22.580509 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e1018-f317-44f4-a775-0a17bce9f699 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:22.580853 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e1018-f317-44f4-a775-0a17bce9f699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:22.581223 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e1018-f317-44f4-a775-0a17bce9f699 admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:22.581931 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e1018-f317-44f4-a775-0a17bce9f699 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:22.584119 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e1018-f317-44f4-a775-0a17bce9f699 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:22.699567 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1245/2513] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:31:22 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:31:22.709437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f52a1-7b87-44a7-adda-44a424c5ff88 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:22.720126 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f52a1-7b87-44a7-adda-44a424c5ff88 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:22.728855 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc23db7-f1cc-4fdc-9684-1e98d968814e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:22.729457 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc23db7-f1cc-4fdc-9684-1e98d968814e admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:22.729739 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc23db7-f1cc-4fdc-9684-1e98d968814e admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:22.730014 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc23db7-f1cc-4fdc-9684-1e98d968814e admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:22.730652 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc23db7-f1cc-4fdc-9684-1e98d968814e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:22.732478 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc23db7-f1cc-4fdc-9684-1e98d968814e admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:22.745268 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1269/2514] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:22.751985 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e1018-f317-44f4-a775-0a17bce9f699 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:22.767458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e1018-f317-44f4-a775-0a17bce9f699 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:22.772250 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bfd028-0fce-4529-90e8-f3f322ad2b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:22.772966 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfd028-0fce-4529-90e8-f3f322ad2b6d admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:22.773246 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfd028-0fce-4529-90e8-f3f322ad2b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:22.773520 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfd028-0fce-4529-90e8-f3f322ad2b6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:22.774161 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bfd028-0fce-4529-90e8-f3f322ad2b6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:22.775775 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bfd028-0fce-4529-90e8-f3f322ad2b6d admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:22.786710 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1246/2515] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:22.791100 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc23db7-f1cc-4fdc-9684-1e98d968814e admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:22.801477 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc23db7-f1cc-4fdc-9684-1e98d968814e admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:22.806074 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216c2c9-0740-4f06-b3ec-f91b5f59a654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:22.806723 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216c2c9-0740-4f06-b3ec-f91b5f59a654 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:22.807008 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216c2c9-0740-4f06-b3ec-f91b5f59a654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:22.807287 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216c2c9-0740-4f06-b3ec-f91b5f59a654 admin admin] PATH_INFO: `/v3/projects/235a134756f946c9ad09baa958030b0c/users/cb5f5928319a41349f26d5ed59e6dc07/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:22.824443 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7216c2c9-0740-4f06-b3ec-f91b5f59a654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=235a134756f946c9ad09baa958030b0c, user_id=cb5f5928319a41349f26d5ed59e6dc07, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:22.827766 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7216c2c9-0740-4f06-b3ec-f91b5f59a654 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:22.905544 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1270/2516] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:22 2022] PUT /identity/v3/projects/235a134756f946c9ad09baa958030b0c/users/cb5f5928319a41349f26d5ed59e6dc07/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:22.918551 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc74c1-091e-4b28-8f31-394c92fd8555 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:22.918844 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc74c1-091e-4b28-8f31-394c92fd8555 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:22.919130 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc74c1-091e-4b28-8f31-394c92fd8555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:22.946786 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-d8fc74c1-091e-4b28-8f31-394c92fd8555 None None] MFA Rules not processed for user `cb5f5928319a41349f26d5ed59e6dc07`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:22.948031 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-d8fc74c1-091e-4b28-8f31-394c92fd8555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:23.013578 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1247/2517] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:23.018185 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216c2c9-0740-4f06-b3ec-f91b5f59a654 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:23.081534 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:23.085345 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216c2c9-0740-4f06-b3ec-f91b5f59a654 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:23.090288 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02686878-c561-4dc4-93bf-2971a8d38d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:23.090928 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02686878-c561-4dc4-93bf-2971a8d38d83 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:23.091202 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02686878-c561-4dc4-93bf-2971a8d38d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:23.091508 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02686878-c561-4dc4-93bf-2971a8d38d83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:23.092128 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02686878-c561-4dc4-93bf-2971a8d38d83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:23.094023 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02686878-c561-4dc4-93bf-2971a8d38d83 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:23.174709 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1271/2518] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:31:23 2022] POST /identity/v3/projects => generated 387 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:31:23.178728 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc74c1-091e-4b28-8f31-394c92fd8555 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:23.189923 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc74c1-091e-4b28-8f31-394c92fd8555 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:23.199523 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:23.252518 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2ec8a-d884-4382-82a2-c2ab188e6cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:23.253169 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2ec8a-d884-4382-82a2-c2ab188e6cba admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:23.253456 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2ec8a-d884-4382-82a2-c2ab188e6cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:23.253735 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2ec8a-d884-4382-82a2-c2ab188e6cba admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:23.254372 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b2ec8a-d884-4382-82a2-c2ab188e6cba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:23.256300 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b2ec8a-d884-4382-82a2-c2ab188e6cba admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:23.372967 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1248/2519] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:31:23 2022] POST /identity/v3/users => generated 294 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:31:23.389254 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02686878-c561-4dc4-93bf-2971a8d38d83 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:23.399641 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02686878-c561-4dc4-93bf-2971a8d38d83 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:23.405621 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642a627-7054-490f-b6ec-36bd804f5ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:23.405621 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642a627-7054-490f-b6ec-36bd804f5ffb admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:23.405621 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642a627-7054-490f-b6ec-36bd804f5ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:23.415759 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642a627-7054-490f-b6ec-36bd804f5ffb admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:23.415759 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642a627-7054-490f-b6ec-36bd804f5ffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:23.415759 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642a627-7054-490f-b6ec-36bd804f5ffb admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:23.427377 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1272/2520] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:23.431461 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2ec8a-d884-4382-82a2-c2ab188e6cba admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:23.442735 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2ec8a-d884-4382-82a2-c2ab188e6cba admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:23.447951 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007f422-a069-4cc1-ac66-4053c65e2a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:23.448554 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007f422-a069-4cc1-ac66-4053c65e2a0c admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:23.448839 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007f422-a069-4cc1-ac66-4053c65e2a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:23.449152 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007f422-a069-4cc1-ac66-4053c65e2a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:23.449793 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007f422-a069-4cc1-ac66-4053c65e2a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:23.451417 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007f422-a069-4cc1-ac66-4053c65e2a0c admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:23.461694 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1249/2521] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:31:23.466848 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642a627-7054-490f-b6ec-36bd804f5ffb admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:23.477048 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642a627-7054-490f-b6ec-36bd804f5ffb admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:23.482486 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e1112-cdbc-4483-bee4-edd0ac4792d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:23.483211 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e1112-cdbc-4483-bee4-edd0ac4792d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:23.483602 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e1112-cdbc-4483-bee4-edd0ac4792d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:23.483961 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e1112-cdbc-4483-bee4-edd0ac4792d8 admin admin] PATH_INFO: `/v3/projects/51b8a51e78e545e2ac1f9d8eb5f7fdeb/users/d4700b4c906a4432af88438eda4ac28c/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:23.499636 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e1112-cdbc-4483-bee4-edd0ac4792d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51b8a51e78e545e2ac1f9d8eb5f7fdeb, user_id=d4700b4c906a4432af88438eda4ac28c, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:23.502531 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e1112-cdbc-4483-bee4-edd0ac4792d8 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:23.584390 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1273/2522] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:23 2022] PUT /identity/v3/projects/51b8a51e78e545e2ac1f9d8eb5f7fdeb/users/d4700b4c906a4432af88438eda4ac28c/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:23.596328 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb75240-0a5c-4994-b799-6bfc78002130 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:23.596601 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb75240-0a5c-4994-b799-6bfc78002130 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:23.596856 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb75240-0a5c-4994-b799-6bfc78002130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:23.626038 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-afb75240-0a5c-4994-b799-6bfc78002130 None None] MFA Rules not processed for user `d4700b4c906a4432af88438eda4ac28c`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:23.627254 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-afb75240-0a5c-4994-b799-6bfc78002130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:23.694044 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1250/2523] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:23.698636 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e1112-cdbc-4483-bee4-edd0ac4792d8 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:23.760530 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e1112-cdbc-4483-bee4-edd0ac4792d8 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:23.765961 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676646f-d74b-4120-b4e3-16a9834e996f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:23.766564 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676646f-d74b-4120-b4e3-16a9834e996f admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:23.766843 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676646f-d74b-4120-b4e3-16a9834e996f admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:23.767118 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676646f-d74b-4120-b4e3-16a9834e996f admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:23.767763 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1676646f-d74b-4120-b4e3-16a9834e996f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:23.769659 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1676646f-d74b-4120-b4e3-16a9834e996f admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:23.894906 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1274/2524] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:31:23 2022] POST /identity/v3/projects => generated 387 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:31:23.898972 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb75240-0a5c-4994-b799-6bfc78002130 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:23.910375 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb75240-0a5c-4994-b799-6bfc78002130 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:23.971286 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f74f22-30c9-4a79-810e-0a8ba12d45dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:23.971926 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f74f22-30c9-4a79-810e-0a8ba12d45dd admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:23.972226 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f74f22-30c9-4a79-810e-0a8ba12d45dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:23.972606 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f74f22-30c9-4a79-810e-0a8ba12d45dd admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:23.973236 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f74f22-30c9-4a79-810e-0a8ba12d45dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:23.986733 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f74f22-30c9-4a79-810e-0a8ba12d45dd admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:24.115602 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1251/2525] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:31:23 2022] POST /identity/v3/users => generated 300 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:31:24.119929 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676646f-d74b-4120-b4e3-16a9834e996f admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:24.131007 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676646f-d74b-4120-b4e3-16a9834e996f admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:24.135721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc40f2e-372e-4aee-ba43-0743211afd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:24.136315 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc40f2e-372e-4aee-ba43-0743211afd81 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:24.136597 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc40f2e-372e-4aee-ba43-0743211afd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:24.136885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc40f2e-372e-4aee-ba43-0743211afd81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:24.137521 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc40f2e-372e-4aee-ba43-0743211afd81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:24.139747 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc40f2e-372e-4aee-ba43-0743211afd81 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:24.150187 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1275/2526] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:24.154401 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f74f22-30c9-4a79-810e-0a8ba12d45dd admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:24.164520 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f74f22-30c9-4a79-810e-0a8ba12d45dd admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:24.171658 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352432a5-7079-4d0f-9f6f-26d14872a82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:24.171658 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352432a5-7079-4d0f-9f6f-26d14872a82d admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:24.171658 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352432a5-7079-4d0f-9f6f-26d14872a82d admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:24.171658 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352432a5-7079-4d0f-9f6f-26d14872a82d admin admin] PATH_INFO: `/v3/projects/dc7f75c786684be78a32fdc659839045/users/da24777e33744e53929e24b60152b14e/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:24.172715 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:24.186098 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352432a5-7079-4d0f-9f6f-26d14872a82d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc7f75c786684be78a32fdc659839045, user_id=da24777e33744e53929e24b60152b14e, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:24.188818 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352432a5-7079-4d0f-9f6f-26d14872a82d admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:24.253349 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1252/2527] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:24 2022] PUT /identity/v3/projects/dc7f75c786684be78a32fdc659839045/users/da24777e33744e53929e24b60152b14e/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:31:24.257317 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc40f2e-372e-4aee-ba43-0743211afd81 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:24.268168 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc40f2e-372e-4aee-ba43-0743211afd81 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:24.322254 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd6bbf-3b2e-4271-86e4-585ca4c76490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:24.322939 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd6bbf-3b2e-4271-86e4-585ca4c76490 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:24.323235 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd6bbf-3b2e-4271-86e4-585ca4c76490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:24.323546 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd6bbf-3b2e-4271-86e4-585ca4c76490 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:24.324175 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd6bbf-3b2e-4271-86e4-585ca4c76490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:24.326317 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd6bbf-3b2e-4271-86e4-585ca4c76490 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:24.335862 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1276/2528] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:24.340382 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352432a5-7079-4d0f-9f6f-26d14872a82d admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:24.350424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352432a5-7079-4d0f-9f6f-26d14872a82d admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:24.355059 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a0eb7-f08c-4497-804c-9bb482beb483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:24.355803 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a0eb7-f08c-4497-804c-9bb482beb483 admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:24.356090 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a0eb7-f08c-4497-804c-9bb482beb483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:24.356372 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a0eb7-f08c-4497-804c-9bb482beb483 admin admin] PATH_INFO: `/v3/projects/dc7f75c786684be78a32fdc659839045/users/da24777e33744e53929e24b60152b14e/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:24.358295 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a0eb7-f08c-4497-804c-9bb482beb483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc7f75c786684be78a32fdc659839045, user_id=da24777e33744e53929e24b60152b14e, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:24.362504 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a0eb7-f08c-4497-804c-9bb482beb483 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:24.372308 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1253/2529] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:24 2022] PUT /identity/v3/projects/dc7f75c786684be78a32fdc659839045/users/da24777e33744e53929e24b60152b14e/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:24.383342 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08bb02-173a-49d0-90ad-4dfd67f63fed None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:24.383741 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08bb02-173a-49d0-90ad-4dfd67f63fed None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:24.384027 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08bb02-173a-49d0-90ad-4dfd67f63fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:24.412197 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-8e08bb02-173a-49d0-90ad-4dfd67f63fed None None] MFA Rules not processed for user `da24777e33744e53929e24b60152b14e`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:24.413444 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-8e08bb02-173a-49d0-90ad-4dfd67f63fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:24.418399 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:24.481239 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1277/2530] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:24 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:24.492881 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a0eb7-f08c-4497-804c-9bb482beb483 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:24.494615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-365a0eb7-f08c-4497-804c-9bb482beb483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:24.552004 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a0eb7-f08c-4497-804c-9bb482beb483 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:24.555597 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b817459-4228-4a7f-86cb-21a13715fa1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:24.556188 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b817459-4228-4a7f-86cb-21a13715fa1f service cinder] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:24.556466 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b817459-4228-4a7f-86cb-21a13715fa1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:24.556741 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b817459-4228-4a7f-86cb-21a13715fa1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:24.566044 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b817459-4228-4a7f-86cb-21a13715fa1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:24.567489 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b817459-4228-4a7f-86cb-21a13715fa1f service cinder] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:24.576647 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1254/2531] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:24 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:25.801318 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08bb02-173a-49d0-90ad-4dfd67f63fed None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:25.802239 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08bb02-173a-49d0-90ad-4dfd67f63fed None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:25.802360 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b817459-4228-4a7f-86cb-21a13715fa1f service cinder] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:25.803748 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-2b817459-4228-4a7f-86cb-21a13715fa1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:25.806329 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237e9422-f150-4d85-b7bb-6a86d9efb377 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:25.807007 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e9422-f150-4d85-b7bb-6a86d9efb377 service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:25.807428 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e9422-f150-4d85-b7bb-6a86d9efb377 service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:25.807711 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e9422-f150-4d85-b7bb-6a86d9efb377 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:25.876492 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b817459-4228-4a7f-86cb-21a13715fa1f service cinder] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:25.878571 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237e9422-f150-4d85-b7bb-6a86d9efb377 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:25.880143 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237e9422-f150-4d85-b7bb-6a86d9efb377 service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:25.881001 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86522cb8-8f73-4ea7-9bb1-7500e8e611fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:25.881619 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86522cb8-8f73-4ea7-9bb1-7500e8e611fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:25.881894 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86522cb8-8f73-4ea7-9bb1-7500e8e611fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:25.882165 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86522cb8-8f73-4ea7-9bb1-7500e8e611fa admin admin] PATH_INFO: `/v3/users/1adb4fc2079e47e9b1bcc42011868951` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:25.883270 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86522cb8-8f73-4ea7-9bb1-7500e8e611fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=1adb4fc2079e47e9b1bcc42011868951)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:25.885222 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86522cb8-8f73-4ea7-9bb1-7500e8e611fa admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:25.889443 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1278/2532] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:26.094628 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-86522cb8-8f73-4ea7-9bb1-7500e8e611fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1adb4fc2079e47e9b1bcc42011868951'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:26.202303 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-86522cb8-8f73-4ea7-9bb1-7500e8e611fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1adb4fc2079e47e9b1bcc42011868951'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:26.202415 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-86522cb8-8f73-4ea7-9bb1-7500e8e611fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1adb4fc2079e47e9b1bcc42011868951'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:26.203014 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-86522cb8-8f73-4ea7-9bb1-7500e8e611fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1adb4fc2079e47e9b1bcc42011868951'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:26.217007 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-86522cb8-8f73-4ea7-9bb1-7500e8e611fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1adb4fc2079e47e9b1bcc42011868951'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:26.219061 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:26.229696 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1255/2533] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:31:25 2022] DELETE /identity/v3/users/1adb4fc2079e47e9b1bcc42011868951 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:26.234219 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219251c-2bbd-4def-8b10-8cc85bb0dd2f None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:26.234511 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219251c-2bbd-4def-8b10-8cc85bb0dd2f None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:26.234790 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219251c-2bbd-4def-8b10-8cc85bb0dd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:26.253706 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-6219251c-2bbd-4def-8b10-8cc85bb0dd2f None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:26.254918 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-6219251c-2bbd-4def-8b10-8cc85bb0dd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:26.316484 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1279/2534] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:26.327199 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86522cb8-8f73-4ea7-9bb1-7500e8e611fa admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:26.328707 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-86522cb8-8f73-4ea7-9bb1-7500e8e611fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:26.389080 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86522cb8-8f73-4ea7-9bb1-7500e8e611fa admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:26.392623 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3dcf2-26de-4ea8-bc05-4f55aab43053 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:26.393222 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3dcf2-26de-4ea8-bc05-4f55aab43053 service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:26.393499 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3dcf2-26de-4ea8-bc05-4f55aab43053 service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:26.393768 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3dcf2-26de-4ea8-bc05-4f55aab43053 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:26.403255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3dcf2-26de-4ea8-bc05-4f55aab43053 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:26.404733 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3dcf2-26de-4ea8-bc05-4f55aab43053 service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:26.413969 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1256/2535] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:26.861497 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219251c-2bbd-4def-8b10-8cc85bb0dd2f None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:26.865340 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-6219251c-2bbd-4def-8b10-8cc85bb0dd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:26.879249 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219251c-2bbd-4def-8b10-8cc85bb0dd2f None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:26.883959 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da494215-7604-47f8-a00e-6cf347207c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:26.884585 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da494215-7604-47f8-a00e-6cf347207c35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:26.884866 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da494215-7604-47f8-a00e-6cf347207c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:26.885177 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da494215-7604-47f8-a00e-6cf347207c35 admin admin] PATH_INFO: `/v3/projects/a0347a199fa94e96b4e4540b58fa8a4c` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:26.886285 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da494215-7604-47f8-a00e-6cf347207c35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0347a199fa94e96b4e4540b58fa8a4c)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:26.888237 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da494215-7604-47f8-a00e-6cf347207c35 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:26.981571 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:26.991131 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-da494215-7604-47f8-a00e-6cf347207c35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0347a199fa94e96b4e4540b58fa8a4c', 'request_id': 'req-da494215-7604-47f8-a00e-6cf347207c35'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:26.996724 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-da494215-7604-47f8-a00e-6cf347207c35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0347a199fa94e96b4e4540b58fa8a4c', 'request_id': 'req-da494215-7604-47f8-a00e-6cf347207c35'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:27.003203 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-da494215-7604-47f8-a00e-6cf347207c35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0347a199fa94e96b4e4540b58fa8a4c', 'request_id': 'req-da494215-7604-47f8-a00e-6cf347207c35'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:27.114652 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-da494215-7604-47f8-a00e-6cf347207c35 admin admin] The token cache is being invalidate because project a0347a199fa94e96b4e4540b58fa8a4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:31:27.114898 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-da494215-7604-47f8-a00e-6cf347207c35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:27.115512 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-da494215-7604-47f8-a00e-6cf347207c35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:27.117105 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1280/2536] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:31:26 2022] DELETE /identity/v3/projects/a0347a199fa94e96b4e4540b58fa8a4c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:27.122059 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa98b29-682e-46b7-b118-2d72a0cb3b85 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:27.122538 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa98b29-682e-46b7-b118-2d72a0cb3b85 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:27.122635 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa98b29-682e-46b7-b118-2d72a0cb3b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:27.141790 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-baa98b29-682e-46b7-b118-2d72a0cb3b85 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:27.143080 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-baa98b29-682e-46b7-b118-2d72a0cb3b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:27.201110 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1257/2537] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:27.208914 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e932bb1-e77f-4ece-92d0-cf7029edc20b None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:27.209208 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e932bb1-e77f-4ece-92d0-cf7029edc20b None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:27.209511 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e932bb1-e77f-4ece-92d0-cf7029edc20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:27.230234 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-8e932bb1-e77f-4ece-92d0-cf7029edc20b None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:27.231519 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-8e932bb1-e77f-4ece-92d0-cf7029edc20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:27.239909 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1281/2538] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:31:27.244251 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa98b29-682e-46b7-b118-2d72a0cb3b85 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:27.253785 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa98b29-682e-46b7-b118-2d72a0cb3b85 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:27.258410 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffcad4-f82a-48d7-9446-5ebd6b55f4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:27.259011 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffcad4-f82a-48d7-9446-5ebd6b55f4da admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:27.259300 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffcad4-f82a-48d7-9446-5ebd6b55f4da admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:27.259610 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffcad4-f82a-48d7-9446-5ebd6b55f4da admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:27.260265 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffcad4-f82a-48d7-9446-5ebd6b55f4da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:31:27.260599 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffcad4-f82a-48d7-9446-5ebd6b55f4da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:27.262304 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffcad4-f82a-48d7-9446-5ebd6b55f4da admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:27.274288 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1258/2539] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:31:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:31:27.279269 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e932bb1-e77f-4ece-92d0-cf7029edc20b None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:27.288785 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e932bb1-e77f-4ece-92d0-cf7029edc20b None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:27.293843 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5b6a6-a57b-4723-a110-f5f77f66bc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:27.295121 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5b6a6-a57b-4723-a110-f5f77f66bc62 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:27.295433 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5b6a6-a57b-4723-a110-f5f77f66bc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:27.295711 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5b6a6-a57b-4723-a110-f5f77f66bc62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:27.296333 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5b6a6-a57b-4723-a110-f5f77f66bc62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:27.298311 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5b6a6-a57b-4723-a110-f5f77f66bc62 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:27.429596 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1282/2540] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:31:27 2022] POST /identity/v3/projects => generated 397 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:31:27.433680 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffcad4-f82a-48d7-9446-5ebd6b55f4da admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:27.443572 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffcad4-f82a-48d7-9446-5ebd6b55f4da admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:27.499868 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c71c0-3ce2-42a8-a8ce-966fe0ef9e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:27.500599 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c71c0-3ce2-42a8-a8ce-966fe0ef9e10 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:27.501073 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c71c0-3ce2-42a8-a8ce-966fe0ef9e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:27.501353 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c71c0-3ce2-42a8-a8ce-966fe0ef9e10 admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:27.501969 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c71c0-3ce2-42a8-a8ce-966fe0ef9e10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:27.503902 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c71c0-3ce2-42a8-a8ce-966fe0ef9e10 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:27.589865 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1259/2541] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:31:27 2022] POST /identity/v3/users => generated 299 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:31:27.594512 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5b6a6-a57b-4723-a110-f5f77f66bc62 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:27.605150 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5b6a6-a57b-4723-a110-f5f77f66bc62 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:27.609766 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810fc647-c857-401b-8a83-4f8676ff255b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:27.610362 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fc647-c857-401b-8a83-4f8676ff255b admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:27.610643 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fc647-c857-401b-8a83-4f8676ff255b admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:27.610920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fc647-c857-401b-8a83-4f8676ff255b admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:27.611597 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810fc647-c857-401b-8a83-4f8676ff255b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:27.613212 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810fc647-c857-401b-8a83-4f8676ff255b admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:27.623121 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1283/2542] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:27.626988 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c71c0-3ce2-42a8-a8ce-966fe0ef9e10 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:27.637215 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c71c0-3ce2-42a8-a8ce-966fe0ef9e10 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:27.642929 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d37fb4-e178-4506-9709-56b41fc9f2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:27.643566 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d37fb4-e178-4506-9709-56b41fc9f2ba admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:27.643848 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d37fb4-e178-4506-9709-56b41fc9f2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:27.644119 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d37fb4-e178-4506-9709-56b41fc9f2ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:27.644758 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d37fb4-e178-4506-9709-56b41fc9f2ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:27.646333 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d37fb4-e178-4506-9709-56b41fc9f2ba admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:27.651853 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:27.661616 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1260/2543] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:27.664388 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810fc647-c857-401b-8a83-4f8676ff255b admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:27.674569 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810fc647-c857-401b-8a83-4f8676ff255b admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:27.683393 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83592c-8f4a-44f3-84b2-170aef80a80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:27.684048 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83592c-8f4a-44f3-84b2-170aef80a80c admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:27.684496 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83592c-8f4a-44f3-84b2-170aef80a80c admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:27.684887 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83592c-8f4a-44f3-84b2-170aef80a80c admin admin] PATH_INFO: `/v3/projects/3d249e86ea6040c4ae4e81bb5a4b25bb/users/a20b4acd41404f0ca4be8a14b8d4d2bc/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:27.701290 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d83592c-8f4a-44f3-84b2-170aef80a80c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d249e86ea6040c4ae4e81bb5a4b25bb, user_id=a20b4acd41404f0ca4be8a14b8d4d2bc, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:27.703922 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d83592c-8f4a-44f3-84b2-170aef80a80c admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:27.710673 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d37fb4-e178-4506-9709-56b41fc9f2ba admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:27.713026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-d4d37fb4-e178-4506-9709-56b41fc9f2ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:27.725919 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d37fb4-e178-4506-9709-56b41fc9f2ba admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:27.730463 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eab936-f97c-47ba-95cc-d45c8e8d4933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:27.731074 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eab936-f97c-47ba-95cc-d45c8e8d4933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:27.731369 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eab936-f97c-47ba-95cc-d45c8e8d4933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:27.731661 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eab936-f97c-47ba-95cc-d45c8e8d4933 admin admin] PATH_INFO: `/v3/users/025d319c2b094054ae0374177d67b725` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:27.732786 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eab936-f97c-47ba-95cc-d45c8e8d4933 admin admin] RBAC: Authorizing `identity:delete_user(user_id=025d319c2b094054ae0374177d67b725)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:27.734691 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eab936-f97c-47ba-95cc-d45c8e8d4933 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:27.785010 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1284/2544] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:27 2022] PUT /identity/v3/projects/3d249e86ea6040c4ae4e81bb5a4b25bb/users/a20b4acd41404f0ca4be8a14b8d4d2bc/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:27.795856 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3903e8-5c47-45e1-8293-4ea088fcec5e None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:27.796233 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3903e8-5c47-45e1-8293-4ea088fcec5e None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:27.796574 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3903e8-5c47-45e1-8293-4ea088fcec5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:27.829688 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-cf3903e8-5c47-45e1-8293-4ea088fcec5e None None] MFA Rules not processed for user `a20b4acd41404f0ca4be8a14b8d4d2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:27.830930 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-cf3903e8-5c47-45e1-8293-4ea088fcec5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:27.900379 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1285/2545] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:27 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:31:27.912129 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3903e8-5c47-45e1-8293-4ea088fcec5e None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:27.913456 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-cf3903e8-5c47-45e1-8293-4ea088fcec5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:27.963248 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-b4eab936-f97c-47ba-95cc-d45c8e8d4933 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '025d319c2b094054ae0374177d67b725'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:27.969029 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3903e8-5c47-45e1-8293-4ea088fcec5e None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:27.972618 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608afc1a-8684-48f2-a928-1391bf85a020 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:27.973211 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608afc1a-8684-48f2-a928-1391bf85a020 service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:27.973490 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608afc1a-8684-48f2-a928-1391bf85a020 service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:27.973761 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608afc1a-8684-48f2-a928-1391bf85a020 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:27.978808 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:27.982190 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608afc1a-8684-48f2-a928-1391bf85a020 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:27.983826 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608afc1a-8684-48f2-a928-1391bf85a020 service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:27.992786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1286/2546] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:27 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:31:28.058135 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-b4eab936-f97c-47ba-95cc-d45c8e8d4933 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '025d319c2b094054ae0374177d67b725'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:28.058812 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-b4eab936-f97c-47ba-95cc-d45c8e8d4933 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '025d319c2b094054ae0374177d67b725'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:28.059615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-b4eab936-f97c-47ba-95cc-d45c8e8d4933 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '025d319c2b094054ae0374177d67b725'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:28.073951 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-b4eab936-f97c-47ba-95cc-d45c8e8d4933 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '025d319c2b094054ae0374177d67b725'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:28.087418 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1261/2547] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:31:27 2022] DELETE /identity/v3/users/025d319c2b094054ae0374177d67b725 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:28.092077 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c855c-0400-4d57-9c41-da4b5f11ae16 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:28.092375 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c855c-0400-4d57-9c41-da4b5f11ae16 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:28.092662 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c855c-0400-4d57-9c41-da4b5f11ae16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:28.121250 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-903c855c-0400-4d57-9c41-da4b5f11ae16 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:28.125677 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-903c855c-0400-4d57-9c41-da4b5f11ae16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:28.189015 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1287/2548] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:31:28.199804 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eab936-f97c-47ba-95cc-d45c8e8d4933 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:28.204559 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-b4eab936-f97c-47ba-95cc-d45c8e8d4933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:28.262768 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eab936-f97c-47ba-95cc-d45c8e8d4933 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:28.266646 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285d899-f6cd-40db-9008-191e6fc5bc6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:28.267238 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285d899-f6cd-40db-9008-191e6fc5bc6b service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:28.267575 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285d899-f6cd-40db-9008-191e6fc5bc6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:28.267852 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285d899-f6cd-40db-9008-191e6fc5bc6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:28.276977 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285d899-f6cd-40db-9008-191e6fc5bc6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:28.278475 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285d899-f6cd-40db-9008-191e6fc5bc6b service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:28.288542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1262/2549] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:28.780238 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c855c-0400-4d57-9c41-da4b5f11ae16 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:28.781672 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-903c855c-0400-4d57-9c41-da4b5f11ae16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:28.796083 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c855c-0400-4d57-9c41-da4b5f11ae16 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:28.802365 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3cbd77-854f-4c48-b046-e15925f1d448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:28.806469 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cbd77-854f-4c48-b046-e15925f1d448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:28.806469 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cbd77-854f-4c48-b046-e15925f1d448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:28.806469 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cbd77-854f-4c48-b046-e15925f1d448 admin admin] PATH_INFO: `/v3/projects/98cb2f80460e48f19450f147cda6da37` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:28.806469 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3cbd77-854f-4c48-b046-e15925f1d448 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98cb2f80460e48f19450f147cda6da37)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:28.807749 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3cbd77-854f-4c48-b046-e15925f1d448 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:28.985594 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-4f3cbd77-854f-4c48-b046-e15925f1d448 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98cb2f80460e48f19450f147cda6da37', 'request_id': 'req-4f3cbd77-854f-4c48-b046-e15925f1d448'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:28.991477 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-4f3cbd77-854f-4c48-b046-e15925f1d448 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98cb2f80460e48f19450f147cda6da37', 'request_id': 'req-4f3cbd77-854f-4c48-b046-e15925f1d448'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:28.998100 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-4f3cbd77-854f-4c48-b046-e15925f1d448 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98cb2f80460e48f19450f147cda6da37', 'request_id': 'req-4f3cbd77-854f-4c48-b046-e15925f1d448'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:29.088368 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-4f3cbd77-854f-4c48-b046-e15925f1d448 admin admin] The token cache is being invalidate because project 98cb2f80460e48f19450f147cda6da37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:31:29.088946 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-4f3cbd77-854f-4c48-b046-e15925f1d448 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:29.090152 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-4f3cbd77-854f-4c48-b046-e15925f1d448 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:29.093318 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1288/2550] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:31:28 2022] DELETE /identity/v3/projects/98cb2f80460e48f19450f147cda6da37 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:31:29.104511 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3284ee8-a98e-4ff3-9d8c-7d2ceedd923b None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:29.104511 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3284ee8-a98e-4ff3-9d8c-7d2ceedd923b None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:29.104511 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3284ee8-a98e-4ff3-9d8c-7d2ceedd923b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:29.133894 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-a3284ee8-a98e-4ff3-9d8c-7d2ceedd923b None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:29.135097 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-a3284ee8-a98e-4ff3-9d8c-7d2ceedd923b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:29.195634 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1263/2551] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:29.203820 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80b0b9-e851-4c49-9c06-b3f5eca36305 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:29.204109 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80b0b9-e851-4c49-9c06-b3f5eca36305 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:29.204556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80b0b9-e851-4c49-9c06-b3f5eca36305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:29.226309 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-ad80b0b9-e851-4c49-9c06-b3f5eca36305 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:29.227578 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-ad80b0b9-e851-4c49-9c06-b3f5eca36305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:29.235488 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1289/2552] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:29.239870 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3284ee8-a98e-4ff3-9d8c-7d2ceedd923b None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:29.249411 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3284ee8-a98e-4ff3-9d8c-7d2ceedd923b None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:29.253940 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57631b74-559a-45f8-b574-f15145c4bbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:29.254529 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57631b74-559a-45f8-b574-f15145c4bbcf admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:29.254809 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57631b74-559a-45f8-b574-f15145c4bbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:29.255084 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57631b74-559a-45f8-b574-f15145c4bbcf admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:29.255779 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57631b74-559a-45f8-b574-f15145c4bbcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:31:29.256081 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57631b74-559a-45f8-b574-f15145c4bbcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:29.257652 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57631b74-559a-45f8-b574-f15145c4bbcf admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:29.269431 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1264/2553] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:31:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:31:29.273721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80b0b9-e851-4c49-9c06-b3f5eca36305 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:29.284019 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80b0b9-e851-4c49-9c06-b3f5eca36305 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:29.288710 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52831b88-53ce-4d2f-9216-495e77d8ebc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:29.289305 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52831b88-53ce-4d2f-9216-495e77d8ebc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:29.289587 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52831b88-53ce-4d2f-9216-495e77d8ebc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:29.289862 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52831b88-53ce-4d2f-9216-495e77d8ebc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:29.290485 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52831b88-53ce-4d2f-9216-495e77d8ebc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:29.292403 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52831b88-53ce-4d2f-9216-495e77d8ebc0 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:29.420800 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1290/2554] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:31:29 2022] POST /identity/v3/projects => generated 383 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:31:29.424936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57631b74-559a-45f8-b574-f15145c4bbcf admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:29.430093 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:29.435227 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57631b74-559a-45f8-b574-f15145c4bbcf admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:29.490039 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4e08c-1b35-47a7-ae27-05ead10f2e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:29.490433 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4e08c-1b35-47a7-ae27-05ead10f2e07 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:29.490677 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4e08c-1b35-47a7-ae27-05ead10f2e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:29.490955 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4e08c-1b35-47a7-ae27-05ead10f2e07 admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:29.491621 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4e08c-1b35-47a7-ae27-05ead10f2e07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:29.496647 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4e08c-1b35-47a7-ae27-05ead10f2e07 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:29.599285 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1265/2555] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:31:29 2022] POST /identity/v3/users => generated 292 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:31:29.603445 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52831b88-53ce-4d2f-9216-495e77d8ebc0 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:29.614253 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52831b88-53ce-4d2f-9216-495e77d8ebc0 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:29.618821 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ee581-1842-46a4-8bb0-b523f05ce59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:29.619443 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ee581-1842-46a4-8bb0-b523f05ce59d admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:29.619727 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ee581-1842-46a4-8bb0-b523f05ce59d admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:29.620001 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ee581-1842-46a4-8bb0-b523f05ce59d admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:29.620813 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ee581-1842-46a4-8bb0-b523f05ce59d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:29.622419 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ee581-1842-46a4-8bb0-b523f05ce59d admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:29.632752 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1291/2556] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:31:29.636836 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4e08c-1b35-47a7-ae27-05ead10f2e07 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:29.646710 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4e08c-1b35-47a7-ae27-05ead10f2e07 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:29.651449 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c29789-5725-4461-ba5b-88562edfe025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:29.652037 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c29789-5725-4461-ba5b-88562edfe025 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:29.652317 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c29789-5725-4461-ba5b-88562edfe025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:29.653279 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c29789-5725-4461-ba5b-88562edfe025 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:29.653279 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c29789-5725-4461-ba5b-88562edfe025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:29.655338 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c29789-5725-4461-ba5b-88562edfe025 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:29.665726 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1266/2557] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:29.670594 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ee581-1842-46a4-8bb0-b523f05ce59d admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:29.680641 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ee581-1842-46a4-8bb0-b523f05ce59d admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:29.685497 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4c160-9927-48f6-900d-8b23e6f7e944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:29.686129 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4c160-9927-48f6-900d-8b23e6f7e944 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:29.686414 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4c160-9927-48f6-900d-8b23e6f7e944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:29.686685 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4c160-9927-48f6-900d-8b23e6f7e944 admin admin] PATH_INFO: `/v3/projects/d8014abf90124e639ec68832c03b2bea/users/06d56cf3a0314eb194e44ff2c9ca4b3b/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:29.700887 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e4c160-9927-48f6-900d-8b23e6f7e944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8014abf90124e639ec68832c03b2bea, user_id=06d56cf3a0314eb194e44ff2c9ca4b3b, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:29.703703 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e4c160-9927-48f6-900d-8b23e6f7e944 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:29.816857 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1292/2558] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:29 2022] PUT /identity/v3/projects/d8014abf90124e639ec68832c03b2bea/users/06d56cf3a0314eb194e44ff2c9ca4b3b/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:29.821885 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae77a0-e2a7-457b-9ca5-7ed16330618f None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:29.822168 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae77a0-e2a7-457b-9ca5-7ed16330618f None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:29.822439 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae77a0-e2a7-457b-9ca5-7ed16330618f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:29.842958 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-4cae77a0-e2a7-457b-9ca5-7ed16330618f None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:29.843949 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-4cae77a0-e2a7-457b-9ca5-7ed16330618f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:29.907318 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1267/2559] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:29.917110 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4c160-9927-48f6-900d-8b23e6f7e944 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:29.918885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-a1e4c160-9927-48f6-900d-8b23e6f7e944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:29.932988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:29.974808 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4c160-9927-48f6-900d-8b23e6f7e944 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:29.978551 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64445ba7-7d37-4cf5-b6d2-8891aeb7a6e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:29.979140 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64445ba7-7d37-4cf5-b6d2-8891aeb7a6e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:29.979450 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64445ba7-7d37-4cf5-b6d2-8891aeb7a6e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:29.979726 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64445ba7-7d37-4cf5-b6d2-8891aeb7a6e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:29.989246 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64445ba7-7d37-4cf5-b6d2-8891aeb7a6e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:29.990318 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64445ba7-7d37-4cf5-b6d2-8891aeb7a6e8 service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:30.000358 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1293/2560] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:31.131724 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae77a0-e2a7-457b-9ca5-7ed16330618f None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:31.133282 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-4cae77a0-e2a7-457b-9ca5-7ed16330618f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:31.190998 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae77a0-e2a7-457b-9ca5-7ed16330618f None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:31.194841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43b68f-9053-4e61-b364-de47a33655c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:31.195479 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43b68f-9053-4e61-b364-de47a33655c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:31.195765 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43b68f-9053-4e61-b364-de47a33655c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:31.196068 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43b68f-9053-4e61-b364-de47a33655c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:31.198017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-2c43b68f-9053-4e61-b364-de47a33655c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:31.233887 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:31.258052 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43b68f-9053-4e61-b364-de47a33655c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:31.259511 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43b68f-9053-4e61-b364-de47a33655c5 service cinder] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:31.268341 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1268/2561] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:31 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:31.432047 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd07057-1d57-4396-81f8-3d91e2e615bc None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:31.432560 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd07057-1d57-4396-81f8-3d91e2e615bc None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:31.432782 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd07057-1d57-4396-81f8-3d91e2e615bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:31.463670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-3dd07057-1d57-4396-81f8-3d91e2e615bc None None] MFA Rules not processed for user `06d56cf3a0314eb194e44ff2c9ca4b3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:31.465006 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-3dd07057-1d57-4396-81f8-3d91e2e615bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:31.533203 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1294/2562] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:31:31.544063 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43b68f-9053-4e61-b364-de47a33655c5 service cinder] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:31.545963 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-2c43b68f-9053-4e61-b364-de47a33655c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:31.556827 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43b68f-9053-4e61-b364-de47a33655c5 service cinder] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:31.561064 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94182846-cd02-4a24-a639-e72574a86a3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:31.561662 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94182846-cd02-4a24-a639-e72574a86a3d service cinder] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:31.561945 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94182846-cd02-4a24-a639-e72574a86a3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:31.562224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94182846-cd02-4a24-a639-e72574a86a3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:31.570632 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94182846-cd02-4a24-a639-e72574a86a3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:31.572070 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94182846-cd02-4a24-a639-e72574a86a3d service cinder] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:31.580877 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1269/2563] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:33.457015 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1545ad8-0622-4e11-8a74-2f2437725657 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:33.484567 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1545ad8-0622-4e11-8a74-2f2437725657 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:33.484567 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1545ad8-0622-4e11-8a74-2f2437725657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:33.484567 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-f1545ad8-0622-4e11-8a74-2f2437725657 None None] MFA Rules not processed for user `06d56cf3a0314eb194e44ff2c9ca4b3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:33.484567 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-f1545ad8-0622-4e11-8a74-2f2437725657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:33.487007 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1295/2564] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:34.962319 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94182846-cd02-4a24-a639-e72574a86a3d service cinder] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:34.963768 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-94182846-cd02-4a24-a639-e72574a86a3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:34.980008 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94182846-cd02-4a24-a639-e72574a86a3d service cinder] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:34.982458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71cd28a-8da9-4bdb-9438-5a283bf28696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:34.983481 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cd28a-8da9-4bdb-9438-5a283bf28696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:34.983897 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cd28a-8da9-4bdb-9438-5a283bf28696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:34.984310 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cd28a-8da9-4bdb-9438-5a283bf28696 admin admin] PATH_INFO: `/v3/users/a20b4acd41404f0ca4be8a14b8d4d2bc` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:34.985672 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71cd28a-8da9-4bdb-9438-5a283bf28696 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a20b4acd41404f0ca4be8a14b8d4d2bc)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:34.987621 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71cd28a-8da9-4bdb-9438-5a283bf28696 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:35.240164 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-b71cd28a-8da9-4bdb-9438-5a283bf28696 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a20b4acd41404f0ca4be8a14b8d4d2bc'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:35.349717 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-b71cd28a-8da9-4bdb-9438-5a283bf28696 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a20b4acd41404f0ca4be8a14b8d4d2bc'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:35.350338 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-b71cd28a-8da9-4bdb-9438-5a283bf28696 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a20b4acd41404f0ca4be8a14b8d4d2bc'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:35.351059 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-b71cd28a-8da9-4bdb-9438-5a283bf28696 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a20b4acd41404f0ca4be8a14b8d4d2bc'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:35.363787 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-b71cd28a-8da9-4bdb-9438-5a283bf28696 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a20b4acd41404f0ca4be8a14b8d4d2bc'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:35.376620 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1270/2565] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:31:34 2022] DELETE /identity/v3/users/a20b4acd41404f0ca4be8a14b8d4d2bc => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:35.381286 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6a557-452e-41d8-a490-dfe04d451305 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:35.381737 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6a557-452e-41d8-a490-dfe04d451305 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:35.381839 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6a557-452e-41d8-a490-dfe04d451305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:35.401161 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-a1b6a557-452e-41d8-a490-dfe04d451305 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:35.402468 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-a1b6a557-452e-41d8-a490-dfe04d451305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:35.460065 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1296/2566] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:35.470201 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71cd28a-8da9-4bdb-9438-5a283bf28696 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:35.471641 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-b71cd28a-8da9-4bdb-9438-5a283bf28696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:35.530319 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71cd28a-8da9-4bdb-9438-5a283bf28696 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:35.533946 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4776333-1d74-4d1b-b20a-8a790558b7e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:35.534678 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4776333-1d74-4d1b-b20a-8a790558b7e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:35.534826 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4776333-1d74-4d1b-b20a-8a790558b7e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:35.535103 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4776333-1d74-4d1b-b20a-8a790558b7e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:35.544503 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4776333-1d74-4d1b-b20a-8a790558b7e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:35.546055 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4776333-1d74-4d1b-b20a-8a790558b7e9 service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:35.555905 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1271/2567] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:35.882356 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6a557-452e-41d8-a490-dfe04d451305 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:35.883806 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-a1b6a557-452e-41d8-a490-dfe04d451305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:35.896104 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6a557-452e-41d8-a490-dfe04d451305 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:35.904343 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501faca3-779d-4337-b698-b9dea69aef23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:35.905009 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501faca3-779d-4337-b698-b9dea69aef23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:35.909935 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501faca3-779d-4337-b698-b9dea69aef23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:35.909935 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501faca3-779d-4337-b698-b9dea69aef23 admin admin] PATH_INFO: `/v3/users/cb5f5928319a41349f26d5ed59e6dc07` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:35.909935 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501faca3-779d-4337-b698-b9dea69aef23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb5f5928319a41349f26d5ed59e6dc07)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:35.909935 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501faca3-779d-4337-b698-b9dea69aef23 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:35.975945 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4776333-1d74-4d1b-b20a-8a790558b7e9 service neutron] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:35.977421 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-a4776333-1d74-4d1b-b20a-8a790558b7e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:35.990358 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4776333-1d74-4d1b-b20a-8a790558b7e9 service neutron] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:35.997497 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb9f63f-ea1e-42c0-b70e-1b9c619d453a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:35.998241 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9f63f-ea1e-42c0-b70e-1b9c619d453a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:35.998516 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9f63f-ea1e-42c0-b70e-1b9c619d453a admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:35.998957 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9f63f-ea1e-42c0-b70e-1b9c619d453a admin admin] PATH_INFO: `/v3/projects/3d249e86ea6040c4ae4e81bb5a4b25bb` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:36.001264 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb9f63f-ea1e-42c0-b70e-1b9c619d453a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d249e86ea6040c4ae4e81bb5a4b25bb)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:36.008505 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb9f63f-ea1e-42c0-b70e-1b9c619d453a admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:36.090260 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:36.099882 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-501faca3-779d-4337-b698-b9dea69aef23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb5f5928319a41349f26d5ed59e6dc07'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:36.120597 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:36.133047 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-8cb9f63f-ea1e-42c0-b70e-1b9c619d453a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d249e86ea6040c4ae4e81bb5a4b25bb', 'request_id': 'req-8cb9f63f-ea1e-42c0-b70e-1b9c619d453a'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:36.138990 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-8cb9f63f-ea1e-42c0-b70e-1b9c619d453a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d249e86ea6040c4ae4e81bb5a4b25bb', 'request_id': 'req-8cb9f63f-ea1e-42c0-b70e-1b9c619d453a'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:36.145345 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-8cb9f63f-ea1e-42c0-b70e-1b9c619d453a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d249e86ea6040c4ae4e81bb5a4b25bb', 'request_id': 'req-8cb9f63f-ea1e-42c0-b70e-1b9c619d453a'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:36.170574 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-501faca3-779d-4337-b698-b9dea69aef23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb5f5928319a41349f26d5ed59e6dc07'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:36.171213 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-501faca3-779d-4337-b698-b9dea69aef23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb5f5928319a41349f26d5ed59e6dc07'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:36.183348 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-501faca3-779d-4337-b698-b9dea69aef23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb5f5928319a41349f26d5ed59e6dc07'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:36.190744 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-501faca3-779d-4337-b698-b9dea69aef23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb5f5928319a41349f26d5ed59e6dc07'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:36.197168 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1297/2568] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:31:35 2022] DELETE /identity/v3/users/cb5f5928319a41349f26d5ed59e6dc07 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:36.202212 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c7a32-805c-4951-99a6-bbaabf9575e7 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:36.202491 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c7a32-805c-4951-99a6-bbaabf9575e7 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:36.202944 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c7a32-805c-4951-99a6-bbaabf9575e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:36.221609 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-d64c7a32-805c-4951-99a6-bbaabf9575e7 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:36.222799 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-d64c7a32-805c-4951-99a6-bbaabf9575e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:36.269411 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-8cb9f63f-ea1e-42c0-b70e-1b9c619d453a admin admin] The token cache is being invalidate because project 3d249e86ea6040c4ae4e81bb5a4b25bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:31:36.269789 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-8cb9f63f-ea1e-42c0-b70e-1b9c619d453a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:36.271141 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-8cb9f63f-ea1e-42c0-b70e-1b9c619d453a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:36.272655 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1272/2569] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:31:35 2022] DELETE /identity/v3/projects/3d249e86ea6040c4ae4e81bb5a4b25bb => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:36.277850 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27937c7-db46-4ddc-9c48-be04dad4f114 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:36.278135 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27937c7-db46-4ddc-9c48-be04dad4f114 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:36.278441 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27937c7-db46-4ddc-9c48-be04dad4f114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:36.290144 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1298/2570] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:31:36.300869 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-a27937c7-db46-4ddc-9c48-be04dad4f114 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:36.302295 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-a27937c7-db46-4ddc-9c48-be04dad4f114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:36.304265 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c7a32-805c-4951-99a6-bbaabf9575e7 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:36.305930 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-d64c7a32-805c-4951-99a6-bbaabf9575e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:36.311310 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1273/2571] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:31:36.320284 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded84ec4-3ce9-4edd-a63c-88add7ac6bfe None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:36.324713 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded84ec4-3ce9-4edd-a63c-88add7ac6bfe None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:36.324713 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded84ec4-3ce9-4edd-a63c-88add7ac6bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:36.343636 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-ded84ec4-3ce9-4edd-a63c-88add7ac6bfe None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:36.344880 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-ded84ec4-3ce9-4edd-a63c-88add7ac6bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:36.353467 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1274/2572] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:31:36.357913 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded84ec4-3ce9-4edd-a63c-88add7ac6bfe None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:36.366906 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded84ec4-3ce9-4edd-a63c-88add7ac6bfe None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:36.369407 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c7a32-805c-4951-99a6-bbaabf9575e7 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:36.371810 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f67cd-cab6-45bc-b882-e5a6e34b0ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:36.373189 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f67cd-cab6-45bc-b882-e5a6e34b0ceb admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:36.375225 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b512053-9ed8-4e56-a1fd-805b51779717 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:36.375683 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f67cd-cab6-45bc-b882-e5a6e34b0ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:36.375978 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f67cd-cab6-45bc-b882-e5a6e34b0ceb admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:36.376213 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b512053-9ed8-4e56-a1fd-805b51779717 service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:36.376500 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b512053-9ed8-4e56-a1fd-805b51779717 service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:36.376674 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f67cd-cab6-45bc-b882-e5a6e34b0ceb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:31:36.376891 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b512053-9ed8-4e56-a1fd-805b51779717 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:36.377041 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f67cd-cab6-45bc-b882-e5a6e34b0ceb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:36.380329 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f67cd-cab6-45bc-b882-e5a6e34b0ceb admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:36.394742 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b512053-9ed8-4e56-a1fd-805b51779717 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:36.396409 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b512053-9ed8-4e56-a1fd-805b51779717 service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:36.397502 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1275/2573] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:31:36.401818 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f67cd-cab6-45bc-b882-e5a6e34b0ceb admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:36.406489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1299/2574] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:31:36.412121 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f67cd-cab6-45bc-b882-e5a6e34b0ceb admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:36.417218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93111cd7-f187-4262-91e1-88e2168c98e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:36.417811 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93111cd7-f187-4262-91e1-88e2168c98e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:36.418095 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93111cd7-f187-4262-91e1-88e2168c98e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:36.418373 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93111cd7-f187-4262-91e1-88e2168c98e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:36.418993 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93111cd7-f187-4262-91e1-88e2168c98e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:36.420945 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93111cd7-f187-4262-91e1-88e2168c98e1 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:36.546279 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1276/2575] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:31:36 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:31:36.551156 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b512053-9ed8-4e56-a1fd-805b51779717 service neutron] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:36.560682 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b512053-9ed8-4e56-a1fd-805b51779717 service neutron] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:36.619313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:36.626807 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f77ec-8a08-45d6-bebe-8d98bdc6ce8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:36.627438 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f77ec-8a08-45d6-bebe-8d98bdc6ce8a admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:36.627721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f77ec-8a08-45d6-bebe-8d98bdc6ce8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:36.628006 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f77ec-8a08-45d6-bebe-8d98bdc6ce8a admin admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:36.629471 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f77ec-8a08-45d6-bebe-8d98bdc6ce8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:36.630697 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f77ec-8a08-45d6-bebe-8d98bdc6ce8a admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:36.729454 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1300/2576] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:31:36 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:31:36.733812 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93111cd7-f187-4262-91e1-88e2168c98e1 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:36.745252 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93111cd7-f187-4262-91e1-88e2168c98e1 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:36.750750 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e76d88-1878-4a43-a2ca-425e7d71dfad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:36.750914 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e76d88-1878-4a43-a2ca-425e7d71dfad admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:36.751131 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e76d88-1878-4a43-a2ca-425e7d71dfad admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:36.751449 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e76d88-1878-4a43-a2ca-425e7d71dfad admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:36.752092 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e76d88-1878-4a43-a2ca-425e7d71dfad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:36.753686 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e76d88-1878-4a43-a2ca-425e7d71dfad admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:36.768782 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1277/2577] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:36.771156 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f77ec-8a08-45d6-bebe-8d98bdc6ce8a admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:36.783769 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f77ec-8a08-45d6-bebe-8d98bdc6ce8a admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:36.790586 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9f85d-7cd6-483c-b07f-81ba94857790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:36.791633 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9f85d-7cd6-483c-b07f-81ba94857790 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:36.792158 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9f85d-7cd6-483c-b07f-81ba94857790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:36.792671 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9f85d-7cd6-483c-b07f-81ba94857790 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:36.793690 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9f85d-7cd6-483c-b07f-81ba94857790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:36.796435 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9f85d-7cd6-483c-b07f-81ba94857790 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:36.808183 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1301/2578] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:36.812359 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e76d88-1878-4a43-a2ca-425e7d71dfad admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:36.822662 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e76d88-1878-4a43-a2ca-425e7d71dfad admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:36.827490 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81160cf6-8d8b-4ec0-9ffd-c87eb751ca7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:36.828152 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81160cf6-8d8b-4ec0-9ffd-c87eb751ca7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:36.828436 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81160cf6-8d8b-4ec0-9ffd-c87eb751ca7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:36.828717 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81160cf6-8d8b-4ec0-9ffd-c87eb751ca7a admin admin] PATH_INFO: `/v3/projects/baf3b3071297476086f6f52eb812756c/users/e83d227094f4419a9d98021636f8b1f1/roles/5691bce246d6452990f13933e19f2825` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:36.844542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81160cf6-8d8b-4ec0-9ffd-c87eb751ca7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=baf3b3071297476086f6f52eb812756c, user_id=e83d227094f4419a9d98021636f8b1f1, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:36.847295 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81160cf6-8d8b-4ec0-9ffd-c87eb751ca7a admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:36.888495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9f85d-7cd6-483c-b07f-81ba94857790 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:36.891569 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-7da9f85d-7cd6-483c-b07f-81ba94857790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:36.904225 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9f85d-7cd6-483c-b07f-81ba94857790 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:36.909322 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd008c-de9e-4c6c-ab66-062b754a5b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:36.910526 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd008c-de9e-4c6c-ab66-062b754a5b82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:36.910814 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd008c-de9e-4c6c-ab66-062b754a5b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:36.911094 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd008c-de9e-4c6c-ab66-062b754a5b82 admin admin] PATH_INFO: `/v3/projects/235a134756f946c9ad09baa958030b0c` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:36.912288 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd008c-de9e-4c6c-ab66-062b754a5b82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=235a134756f946c9ad09baa958030b0c)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:36.914194 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd008c-de9e-4c6c-ab66-062b754a5b82 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:36.978109 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1278/2579] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:36 2022] PUT /identity/v3/projects/baf3b3071297476086f6f52eb812756c/users/e83d227094f4419a9d98021636f8b1f1/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:36.983763 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc110e0-c0d8-434f-b321-94f15baa4347 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:36.984208 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc110e0-c0d8-434f-b321-94f15baa4347 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:36.986380 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc110e0-c0d8-434f-b321-94f15baa4347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:37.008294 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-ffc110e0-c0d8-434f-b321-94f15baa4347 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:37.009505 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-ffc110e0-c0d8-434f-b321-94f15baa4347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:37.054198 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-3bbd008c-de9e-4c6c-ab66-062b754a5b82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '235a134756f946c9ad09baa958030b0c', 'request_id': 'req-3bbd008c-de9e-4c6c-ab66-062b754a5b82'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:37.061529 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-3bbd008c-de9e-4c6c-ab66-062b754a5b82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '235a134756f946c9ad09baa958030b0c', 'request_id': 'req-3bbd008c-de9e-4c6c-ab66-062b754a5b82'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:37.070192 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-3bbd008c-de9e-4c6c-ab66-062b754a5b82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '235a134756f946c9ad09baa958030b0c', 'request_id': 'req-3bbd008c-de9e-4c6c-ab66-062b754a5b82'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:37.079918 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1279/2580] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:31:37.089719 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc110e0-c0d8-434f-b321-94f15baa4347 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:37.092187 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-ffc110e0-c0d8-434f-b321-94f15baa4347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:37.141609 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:37.157646 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc110e0-c0d8-434f-b321-94f15baa4347 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:37.199397 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-3bbd008c-de9e-4c6c-ab66-062b754a5b82 admin admin] The token cache is being invalidate because project 235a134756f946c9ad09baa958030b0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:31:37.199845 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-3bbd008c-de9e-4c6c-ab66-062b754a5b82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:37.201349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-3bbd008c-de9e-4c6c-ab66-062b754a5b82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:37.203292 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1302/2581] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:31:36 2022] DELETE /identity/v3/projects/235a134756f946c9ad09baa958030b0c => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:31:37.207590 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd008c-de9e-4c6c-ab66-062b754a5b82 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:37.208870 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-3bbd008c-de9e-4c6c-ab66-062b754a5b82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:37.209271 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9d0de-b682-41d1-a60c-fd2b48da099c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:37.209913 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9d0de-b682-41d1-a60c-fd2b48da099c service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:37.210203 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9d0de-b682-41d1-a60c-fd2b48da099c service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:37.210480 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9d0de-b682-41d1-a60c-fd2b48da099c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:37.212522 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-c4a9d0de-b682-41d1-a60c-fd2b48da099c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:37.287848 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a9d0de-b682-41d1-a60c-fd2b48da099c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:37.288681 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd008c-de9e-4c6c-ab66-062b754a5b82 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:37.289328 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a9d0de-b682-41d1-a60c-fd2b48da099c service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:37.295132 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07dc78-a8f3-40a7-811f-e7866c8f77e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:37.298012 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07dc78-a8f3-40a7-811f-e7866c8f77e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:37.298012 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07dc78-a8f3-40a7-811f-e7866c8f77e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:37.298012 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07dc78-a8f3-40a7-811f-e7866c8f77e2 admin admin] PATH_INFO: `/v3/users/d4700b4c906a4432af88438eda4ac28c` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:37.298781 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d07dc78-a8f3-40a7-811f-e7866c8f77e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4700b4c906a4432af88438eda4ac28c)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:37.302292 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d07dc78-a8f3-40a7-811f-e7866c8f77e2 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:37.303640 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1280/2582] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:31:37.628600 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-3d07dc78-a8f3-40a7-811f-e7866c8f77e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4700b4c906a4432af88438eda4ac28c'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:37.761695 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-3d07dc78-a8f3-40a7-811f-e7866c8f77e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4700b4c906a4432af88438eda4ac28c'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:37.762418 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-3d07dc78-a8f3-40a7-811f-e7866c8f77e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4700b4c906a4432af88438eda4ac28c'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:37.767483 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=80,keystone:INSERT=5,keystone:DELETE=15 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:37.780247 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-3d07dc78-a8f3-40a7-811f-e7866c8f77e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4700b4c906a4432af88438eda4ac28c'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:37.787009 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-3d07dc78-a8f3-40a7-811f-e7866c8f77e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4700b4c906a4432af88438eda4ac28c'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:37.793120 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1303/2583] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:31:37 2022] DELETE /identity/v3/users/d4700b4c906a4432af88438eda4ac28c => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:31:38.328580 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9d0de-b682-41d1-a60c-fd2b48da099c service neutron] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:38.340447 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9d0de-b682-41d1-a60c-fd2b48da099c service neutron] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:38.409944 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598c303-2ab6-4746-9a2f-402d51be64ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:38.412444 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598c303-2ab6-4746-9a2f-402d51be64ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:38.412444 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598c303-2ab6-4746-9a2f-402d51be64ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:38.412444 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598c303-2ab6-4746-9a2f-402d51be64ab admin admin] PATH_INFO: `/v3/projects/51b8a51e78e545e2ac1f9d8eb5f7fdeb` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:38.412444 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598c303-2ab6-4746-9a2f-402d51be64ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=51b8a51e78e545e2ac1f9d8eb5f7fdeb)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:38.414170 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598c303-2ab6-4746-9a2f-402d51be64ab admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:38.598042 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:38.601200 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c598c303-2ab6-4746-9a2f-402d51be64ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51b8a51e78e545e2ac1f9d8eb5f7fdeb', 'request_id': 'req-c598c303-2ab6-4746-9a2f-402d51be64ab'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:38.606636 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c598c303-2ab6-4746-9a2f-402d51be64ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51b8a51e78e545e2ac1f9d8eb5f7fdeb', 'request_id': 'req-c598c303-2ab6-4746-9a2f-402d51be64ab'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:38.613381 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c598c303-2ab6-4746-9a2f-402d51be64ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51b8a51e78e545e2ac1f9d8eb5f7fdeb', 'request_id': 'req-c598c303-2ab6-4746-9a2f-402d51be64ab'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:38.698697 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c598c303-2ab6-4746-9a2f-402d51be64ab admin admin] The token cache is being invalidate because project 51b8a51e78e545e2ac1f9d8eb5f7fdeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:31:38.702375 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c598c303-2ab6-4746-9a2f-402d51be64ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:38.702375 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c598c303-2ab6-4746-9a2f-402d51be64ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:38.702375 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1281/2584] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:31:38 2022] DELETE /identity/v3/projects/51b8a51e78e545e2ac1f9d8eb5f7fdeb => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:38.705223 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07dc78-a8f3-40a7-811f-e7866c8f77e2 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:38.707088 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-3d07dc78-a8f3-40a7-811f-e7866c8f77e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:38.726329 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07dc78-a8f3-40a7-811f-e7866c8f77e2 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:38.796860 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b207bc-029d-4120-8125-c9c900bd5a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:38.799193 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b207bc-029d-4120-8125-c9c900bd5a4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:38.799530 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b207bc-029d-4120-8125-c9c900bd5a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:38.799960 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b207bc-029d-4120-8125-c9c900bd5a4c admin admin] PATH_INFO: `/v3/users/da24777e33744e53929e24b60152b14e` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:38.801284 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b207bc-029d-4120-8125-c9c900bd5a4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=da24777e33744e53929e24b60152b14e)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:38.803485 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b207bc-029d-4120-8125-c9c900bd5a4c admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:39.000578 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-97b207bc-029d-4120-8125-c9c900bd5a4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da24777e33744e53929e24b60152b14e'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:39.079318 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-97b207bc-029d-4120-8125-c9c900bd5a4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da24777e33744e53929e24b60152b14e'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:39.080020 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-97b207bc-029d-4120-8125-c9c900bd5a4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da24777e33744e53929e24b60152b14e'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:39.094780 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-97b207bc-029d-4120-8125-c9c900bd5a4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da24777e33744e53929e24b60152b14e'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:39.102733 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-97b207bc-029d-4120-8125-c9c900bd5a4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da24777e33744e53929e24b60152b14e'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:39.109631 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1304/2585] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:31:38 2022] DELETE /identity/v3/users/da24777e33744e53929e24b60152b14e => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:39.855281 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598c303-2ab6-4746-9a2f-402d51be64ab admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:39.863225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-c598c303-2ab6-4746-9a2f-402d51be64ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:39.880710 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598c303-2ab6-4746-9a2f-402d51be64ab admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:39.966579 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a3bdd-8c6e-44fb-9265-1f21ab13867a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:39.968065 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a3bdd-8c6e-44fb-9265-1f21ab13867a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:39.968367 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a3bdd-8c6e-44fb-9265-1f21ab13867a admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:39.968635 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a3bdd-8c6e-44fb-9265-1f21ab13867a admin admin] PATH_INFO: `/v3/projects/dc7f75c786684be78a32fdc659839045` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:39.972172 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443a3bdd-8c6e-44fb-9265-1f21ab13867a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc7f75c786684be78a32fdc659839045)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:39.974369 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443a3bdd-8c6e-44fb-9265-1f21ab13867a admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:40.161544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-443a3bdd-8c6e-44fb-9265-1f21ab13867a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc7f75c786684be78a32fdc659839045', 'request_id': 'req-443a3bdd-8c6e-44fb-9265-1f21ab13867a'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:40.161544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-443a3bdd-8c6e-44fb-9265-1f21ab13867a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc7f75c786684be78a32fdc659839045', 'request_id': 'req-443a3bdd-8c6e-44fb-9265-1f21ab13867a'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:40.161544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-443a3bdd-8c6e-44fb-9265-1f21ab13867a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc7f75c786684be78a32fdc659839045', 'request_id': 'req-443a3bdd-8c6e-44fb-9265-1f21ab13867a'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:40.448691 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-443a3bdd-8c6e-44fb-9265-1f21ab13867a admin admin] The token cache is being invalidate because project dc7f75c786684be78a32fdc659839045 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:31:40.448691 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-443a3bdd-8c6e-44fb-9265-1f21ab13867a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:40.448691 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-443a3bdd-8c6e-44fb-9265-1f21ab13867a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:40.448691 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1282/2586] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:31:39 2022] DELETE /identity/v3/projects/dc7f75c786684be78a32fdc659839045 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:40.450311 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789fc6d-141c-439e-96e1-8fb5c1d95ccf None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:40.451341 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789fc6d-141c-439e-96e1-8fb5c1d95ccf None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:40.451730 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789fc6d-141c-439e-96e1-8fb5c1d95ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:40.474469 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-d789fc6d-141c-439e-96e1-8fb5c1d95ccf None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:40.476126 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-d789fc6d-141c-439e-96e1-8fb5c1d95ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:40.539406 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:40.560458 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1305/2587] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:40.563154 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50e29e-464e-4172-9ca7-97173ab3586f None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:40.564578 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50e29e-464e-4172-9ca7-97173ab3586f None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:40.564885 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50e29e-464e-4172-9ca7-97173ab3586f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:40.595696 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-8b50e29e-464e-4172-9ca7-97173ab3586f None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:40.597394 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-8b50e29e-464e-4172-9ca7-97173ab3586f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:40.607396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1283/2588] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:40.611962 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789fc6d-141c-439e-96e1-8fb5c1d95ccf None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:40.624003 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789fc6d-141c-439e-96e1-8fb5c1d95ccf None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:40.630310 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b9331-e978-470d-b68d-a533dc884ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:40.630861 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b9331-e978-470d-b68d-a533dc884ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:40.631153 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b9331-e978-470d-b68d-a533dc884ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:40.631521 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b9331-e978-470d-b68d-a533dc884ab8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:40.632197 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b9331-e978-470d-b68d-a533dc884ab8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:31:40.632506 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b9331-e978-470d-b68d-a533dc884ab8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:40.635280 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b9331-e978-470d-b68d-a533dc884ab8 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:40.650624 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1306/2589] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:31:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:31:40.654765 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50e29e-464e-4172-9ca7-97173ab3586f None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:40.664331 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50e29e-464e-4172-9ca7-97173ab3586f None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:40.669551 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435db94-4e90-488b-ba1c-2f657cc98dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:40.670176 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435db94-4e90-488b-ba1c-2f657cc98dbb admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:40.670458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435db94-4e90-488b-ba1c-2f657cc98dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:40.670765 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435db94-4e90-488b-ba1c-2f657cc98dbb admin admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:40.671453 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7435db94-4e90-488b-ba1c-2f657cc98dbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:40.673515 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7435db94-4e90-488b-ba1c-2f657cc98dbb admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:40.786032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1284/2590] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:31:40 2022] POST /identity/v3/projects => generated 407 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:31:40.790335 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b9331-e978-470d-b68d-a533dc884ab8 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:40.805669 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b9331-e978-470d-b68d-a533dc884ab8 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:40.906489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385bbee-49d6-42f2-8e5e-52d32859d8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:40.907518 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385bbee-49d6-42f2-8e5e-52d32859d8e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:40.907870 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385bbee-49d6-42f2-8e5e-52d32859d8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:40.908238 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385bbee-49d6-42f2-8e5e-52d32859d8e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:40.909984 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b385bbee-49d6-42f2-8e5e-52d32859d8e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:40.910951 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b385bbee-49d6-42f2-8e5e-52d32859d8e1 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:41.025464 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1307/2591] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:31:40 2022] POST /identity/v3/users => generated 304 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:31:41.029979 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435db94-4e90-488b-ba1c-2f657cc98dbb admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:41.043873 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435db94-4e90-488b-ba1c-2f657cc98dbb admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:41.049628 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc70108-03eb-4dc4-bd32-318277bcccb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:41.050511 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc70108-03eb-4dc4-bd32-318277bcccb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:41.050962 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc70108-03eb-4dc4-bd32-318277bcccb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:41.051440 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc70108-03eb-4dc4-bd32-318277bcccb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:41.052494 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc70108-03eb-4dc4-bd32-318277bcccb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:41.054442 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc70108-03eb-4dc4-bd32-318277bcccb4 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:41.066929 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1285/2592] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:41.073395 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385bbee-49d6-42f2-8e5e-52d32859d8e1 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:41.085048 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385bbee-49d6-42f2-8e5e-52d32859d8e1 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:41.106044 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fd350-f2e8-4b4f-9c0c-9278e82108a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:41.106701 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fd350-f2e8-4b4f-9c0c-9278e82108a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:41.106989 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fd350-f2e8-4b4f-9c0c-9278e82108a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:41.107267 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fd350-f2e8-4b4f-9c0c-9278e82108a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:41.107976 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82fd350-f2e8-4b4f-9c0c-9278e82108a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:41.109804 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82fd350-f2e8-4b4f-9c0c-9278e82108a5 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:41.120988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1308/2593] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:41.136118 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc70108-03eb-4dc4-bd32-318277bcccb4 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:41.147276 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc70108-03eb-4dc4-bd32-318277bcccb4 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:41.159314 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10821f51-03e9-4f11-8029-c94d942ce55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:41.159314 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10821f51-03e9-4f11-8029-c94d942ce55d admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:41.159314 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10821f51-03e9-4f11-8029-c94d942ce55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:41.159314 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10821f51-03e9-4f11-8029-c94d942ce55d admin admin] PATH_INFO: `/v3/projects/9793fe0e5da747e18378bf5169a67aad/users/3a0cb81173354d4b8517cbe2953bc14a/roles/5691bce246d6452990f13933e19f2825` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:41.181088 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10821f51-03e9-4f11-8029-c94d942ce55d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9793fe0e5da747e18378bf5169a67aad, user_id=3a0cb81173354d4b8517cbe2953bc14a, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:41.185690 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10821f51-03e9-4f11-8029-c94d942ce55d admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:41.273174 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:41.278792 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1286/2594] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:41 2022] PUT /identity/v3/projects/9793fe0e5da747e18378bf5169a67aad/users/3a0cb81173354d4b8517cbe2953bc14a/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:41.291540 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a0c8f-99a3-4e21-b6f6-e21b95dad503 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:41.291835 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a0c8f-99a3-4e21-b6f6-e21b95dad503 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:41.292138 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a0c8f-99a3-4e21-b6f6-e21b95dad503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:41.325423 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-a34a0c8f-99a3-4e21-b6f6-e21b95dad503 None None] MFA Rules not processed for user `3a0cb81173354d4b8517cbe2953bc14a`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:41.327052 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-a34a0c8f-99a3-4e21-b6f6-e21b95dad503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:41.408826 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1309/2595] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:41 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:41.412668 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10821f51-03e9-4f11-8029-c94d942ce55d admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:41.477235 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10821f51-03e9-4f11-8029-c94d942ce55d admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:41.482882 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2e9eb-5b14-4367-9230-5828dc1d818e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:41.483532 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2e9eb-5b14-4367-9230-5828dc1d818e admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:41.483803 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2e9eb-5b14-4367-9230-5828dc1d818e admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:41.484123 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2e9eb-5b14-4367-9230-5828dc1d818e admin admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:41.484914 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2e9eb-5b14-4367-9230-5828dc1d818e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:41.486826 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2e9eb-5b14-4367-9230-5828dc1d818e admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:41.689931 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1287/2596] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:31:41 2022] POST /identity/v3/projects => generated 409 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:31:41.694485 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a0c8f-99a3-4e21-b6f6-e21b95dad503 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:41.709034 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a0c8f-99a3-4e21-b6f6-e21b95dad503 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:41.773224 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:41.782745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55bb626-2224-486b-b7f1-2f8d8e046f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:41.785394 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bb626-2224-486b-b7f1-2f8d8e046f39 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:41.785394 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bb626-2224-486b-b7f1-2f8d8e046f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:41.785394 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bb626-2224-486b-b7f1-2f8d8e046f39 admin admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:41.785394 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55bb626-2224-486b-b7f1-2f8d8e046f39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:41.786567 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55bb626-2224-486b-b7f1-2f8d8e046f39 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:41.917183 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1310/2597] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:31:41 2022] POST /identity/v3/users => generated 311 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:31:41.921337 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2e9eb-5b14-4367-9230-5828dc1d818e admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:41.934367 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2e9eb-5b14-4367-9230-5828dc1d818e admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:41.961061 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6639cc0-25fd-46df-aea4-6bfa90b65b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:41.961061 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6639cc0-25fd-46df-aea4-6bfa90b65b42 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:41.961061 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6639cc0-25fd-46df-aea4-6bfa90b65b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:41.961061 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6639cc0-25fd-46df-aea4-6bfa90b65b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:41.961671 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6639cc0-25fd-46df-aea4-6bfa90b65b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:41.961671 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6639cc0-25fd-46df-aea4-6bfa90b65b42 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:41.961671 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1288/2598] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:41.964660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55bb626-2224-486b-b7f1-2f8d8e046f39 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:41.978855 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55bb626-2224-486b-b7f1-2f8d8e046f39 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:41.986252 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3663c1d-89ab-4962-a2cb-b3765f7742bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:41.987020 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3663c1d-89ab-4962-a2cb-b3765f7742bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:41.987411 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3663c1d-89ab-4962-a2cb-b3765f7742bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:41.987761 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3663c1d-89ab-4962-a2cb-b3765f7742bd admin admin] PATH_INFO: `/v3/projects/b5cd3e44e36341c3be0c30ef4546dc0a/users/a692555301c54d38b87a65df6846bd99/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:42.006069 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3663c1d-89ab-4962-a2cb-b3765f7742bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5cd3e44e36341c3be0c30ef4546dc0a, user_id=a692555301c54d38b87a65df6846bd99, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:42.009380 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3663c1d-89ab-4962-a2cb-b3765f7742bd admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:42.111559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1311/2599] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:41 2022] PUT /identity/v3/projects/b5cd3e44e36341c3be0c30ef4546dc0a/users/a692555301c54d38b87a65df6846bd99/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:42.114351 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6639cc0-25fd-46df-aea4-6bfa90b65b42 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:42.126812 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6639cc0-25fd-46df-aea4-6bfa90b65b42 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:42.194210 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a4067-b8a4-4bfc-9d8c-523e4ae8bd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:42.194829 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a4067-b8a4-4bfc-9d8c-523e4ae8bd12 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:42.195117 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a4067-b8a4-4bfc-9d8c-523e4ae8bd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:42.195422 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a4067-b8a4-4bfc-9d8c-523e4ae8bd12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:42.196368 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a4067-b8a4-4bfc-9d8c-523e4ae8bd12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:42.198082 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a4067-b8a4-4bfc-9d8c-523e4ae8bd12 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:42.213998 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1289/2600] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:42.215178 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3663c1d-89ab-4962-a2cb-b3765f7742bd admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:42.227583 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3663c1d-89ab-4962-a2cb-b3765f7742bd admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:42.236008 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a945e0-23a2-4583-8b72-0d2deca253a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:42.236760 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a945e0-23a2-4583-8b72-0d2deca253a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:42.237636 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a945e0-23a2-4583-8b72-0d2deca253a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:42.238133 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a945e0-23a2-4583-8b72-0d2deca253a0 admin admin] PATH_INFO: `/v3/projects/b5cd3e44e36341c3be0c30ef4546dc0a/users/a692555301c54d38b87a65df6846bd99/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:42.240410 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a945e0-23a2-4583-8b72-0d2deca253a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5cd3e44e36341c3be0c30ef4546dc0a, user_id=a692555301c54d38b87a65df6846bd99, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:42.243312 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a945e0-23a2-4583-8b72-0d2deca253a0 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:42.259399 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1312/2601] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:42 2022] PUT /identity/v3/projects/b5cd3e44e36341c3be0c30ef4546dc0a/users/a692555301c54d38b87a65df6846bd99/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:42.269982 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41190de0-f881-409f-92c4-0ca1edaf73e4 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:42.270277 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41190de0-f881-409f-92c4-0ca1edaf73e4 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:42.270562 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41190de0-f881-409f-92c4-0ca1edaf73e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:42.302023 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-41190de0-f881-409f-92c4-0ca1edaf73e4 None None] MFA Rules not processed for user `a692555301c54d38b87a65df6846bd99`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:42.303987 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-41190de0-f881-409f-92c4-0ca1edaf73e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:42.379729 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:42.411879 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1290/2602] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:42 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:31:42.426830 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a945e0-23a2-4583-8b72-0d2deca253a0 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:42.429476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-b4a945e0-23a2-4583-8b72-0d2deca253a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:42.518654 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a945e0-23a2-4583-8b72-0d2deca253a0 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:42.522473 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728bfed-f039-4a1e-ba83-6ee95a47ec86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:42.523087 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728bfed-f039-4a1e-ba83-6ee95a47ec86 service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:42.523453 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728bfed-f039-4a1e-ba83-6ee95a47ec86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:42.523788 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728bfed-f039-4a1e-ba83-6ee95a47ec86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:42.536375 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728bfed-f039-4a1e-ba83-6ee95a47ec86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:42.537816 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728bfed-f039-4a1e-ba83-6ee95a47ec86 service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:42.550115 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1313/2603] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:42 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:42.985031 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41190de0-f881-409f-92c4-0ca1edaf73e4 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:42.997996 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41190de0-f881-409f-92c4-0ca1edaf73e4 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:43.001859 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e676c-e37a-48af-8af1-fe0027dcf4fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:43.002559 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e676c-e37a-48af-8af1-fe0027dcf4fa service cinder] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:43.003065 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e676c-e37a-48af-8af1-fe0027dcf4fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:43.003440 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e676c-e37a-48af-8af1-fe0027dcf4fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:43.073358 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e676c-e37a-48af-8af1-fe0027dcf4fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:43.074808 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e676c-e37a-48af-8af1-fe0027dcf4fa service cinder] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:43.086836 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1291/2604] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:42 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:43.816537 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac435b-147d-47b0-aca4-1b59d7276f57 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:43.818370 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac435b-147d-47b0-aca4-1b59d7276f57 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:43.818835 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac435b-147d-47b0-aca4-1b59d7276f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:43.869495 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-8cac435b-147d-47b0-aca4-1b59d7276f57 None None] MFA Rules not processed for user `e83d227094f4419a9d98021636f8b1f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:43.871981 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-8cac435b-147d-47b0-aca4-1b59d7276f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:43.977375 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1314/2605] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:43.982463 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e676c-e37a-48af-8af1-fe0027dcf4fa service cinder] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:43.984064 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-3a9e676c-e37a-48af-8af1-fe0027dcf4fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:44.080909 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e676c-e37a-48af-8af1-fe0027dcf4fa service cinder] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:44.087804 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a375c-d22a-4790-90ff-95a7c982ae33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:44.088536 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a375c-d22a-4790-90ff-95a7c982ae33 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:44.088879 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a375c-d22a-4790-90ff-95a7c982ae33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:44.089236 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a375c-d22a-4790-90ff-95a7c982ae33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:44.089918 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a375c-d22a-4790-90ff-95a7c982ae33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:44.096246 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a375c-d22a-4790-90ff-95a7c982ae33 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:44.287182 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1292/2606] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:31:43 2022] POST /identity/v3/projects => generated 385 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:31:44.291406 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac435b-147d-47b0-aca4-1b59d7276f57 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:44.303285 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac435b-147d-47b0-aca4-1b59d7276f57 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:44.342059 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:44.368578 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4facbe-ffee-4e2a-b4af-99ebbca15c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:44.369211 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4facbe-ffee-4e2a-b4af-99ebbca15c78 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:44.369473 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4facbe-ffee-4e2a-b4af-99ebbca15c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:44.369747 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4facbe-ffee-4e2a-b4af-99ebbca15c78 admin admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:44.370371 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4facbe-ffee-4e2a-b4af-99ebbca15c78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:44.372434 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4facbe-ffee-4e2a-b4af-99ebbca15c78 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:44.497913 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1315/2607] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:31:44 2022] POST /identity/v3/users => generated 299 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:31:44.502128 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a375c-d22a-4790-90ff-95a7c982ae33 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:44.513300 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a375c-d22a-4790-90ff-95a7c982ae33 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:44.518541 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294e4b6-63e9-41a4-bbda-7db83a443d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:44.519157 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294e4b6-63e9-41a4-bbda-7db83a443d5b admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:44.519487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294e4b6-63e9-41a4-bbda-7db83a443d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:44.519772 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294e4b6-63e9-41a4-bbda-7db83a443d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:44.520426 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2294e4b6-63e9-41a4-bbda-7db83a443d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:44.522048 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2294e4b6-63e9-41a4-bbda-7db83a443d5b admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:44.537701 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1293/2608] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:44.542175 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4facbe-ffee-4e2a-b4af-99ebbca15c78 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:44.564038 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4facbe-ffee-4e2a-b4af-99ebbca15c78 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:44.569624 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc6b1c-d770-4a24-9134-83f0695521c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:44.570372 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc6b1c-d770-4a24-9134-83f0695521c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:44.570647 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc6b1c-d770-4a24-9134-83f0695521c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:44.570930 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc6b1c-d770-4a24-9134-83f0695521c0 admin admin] PATH_INFO: `/v3/projects/8072f48f3da342f49b1cf77d440af727/users/74b03fa601f84b3b9e0cafedac7ebc00/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:44.589736 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc6b1c-d770-4a24-9134-83f0695521c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8072f48f3da342f49b1cf77d440af727, user_id=74b03fa601f84b3b9e0cafedac7ebc00, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:44.593523 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc6b1c-d770-4a24-9134-83f0695521c0 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:44.687403 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1316/2609] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:44 2022] PUT /identity/v3/projects/8072f48f3da342f49b1cf77d440af727/users/74b03fa601f84b3b9e0cafedac7ebc00/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:44.691468 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294e4b6-63e9-41a4-bbda-7db83a443d5b admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:44.701925 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294e4b6-63e9-41a4-bbda-7db83a443d5b admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:44.769457 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b2a47-03b2-4799-b494-80d0366d3c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:44.770073 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b2a47-03b2-4799-b494-80d0366d3c19 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:44.770362 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b2a47-03b2-4799-b494-80d0366d3c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:44.770629 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b2a47-03b2-4799-b494-80d0366d3c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:44.771269 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b2a47-03b2-4799-b494-80d0366d3c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:44.772987 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b2a47-03b2-4799-b494-80d0366d3c19 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:44.783742 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1294/2610] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:44.788204 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc6b1c-d770-4a24-9134-83f0695521c0 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:44.798728 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc6b1c-d770-4a24-9134-83f0695521c0 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:44.803422 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e83f6-0211-49bb-8427-f6d254b6c0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:44.804101 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e83f6-0211-49bb-8427-f6d254b6c0c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:44.804380 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e83f6-0211-49bb-8427-f6d254b6c0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:44.804660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e83f6-0211-49bb-8427-f6d254b6c0c2 admin admin] PATH_INFO: `/v3/projects/8072f48f3da342f49b1cf77d440af727/users/74b03fa601f84b3b9e0cafedac7ebc00/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:44.806580 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e83f6-0211-49bb-8427-f6d254b6c0c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8072f48f3da342f49b1cf77d440af727, user_id=74b03fa601f84b3b9e0cafedac7ebc00, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:44.809318 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e83f6-0211-49bb-8427-f6d254b6c0c2 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:44.820580 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1317/2611] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:44 2022] PUT /identity/v3/projects/8072f48f3da342f49b1cf77d440af727/users/74b03fa601f84b3b9e0cafedac7ebc00/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:31:51.150336 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b2a47-03b2-4799-b494-80d0366d3c19 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:51.159396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:51.163701 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b2a47-03b2-4799-b494-80d0366d3c19 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:51.307388 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d0aff-b8a2-4fee-9e00-b82901184e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:51.310459 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d0aff-b8a2-4fee-9e00-b82901184e7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:51.310908 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d0aff-b8a2-4fee-9e00-b82901184e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:51.311402 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d0aff-b8a2-4fee-9e00-b82901184e7d admin admin] PATH_INFO: `/v3/users/3a0cb81173354d4b8517cbe2953bc14a` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:51.312613 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d0aff-b8a2-4fee-9e00-b82901184e7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a0cb81173354d4b8517cbe2953bc14a)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:51.314683 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d0aff-b8a2-4fee-9e00-b82901184e7d admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:51.345820 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9032528-2560-4c7a-9f3b-398b97ccf545 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:51.346416 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9032528-2560-4c7a-9f3b-398b97ccf545 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:51.346416 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9032528-2560-4c7a-9f3b-398b97ccf545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:51.380077 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-e9032528-2560-4c7a-9f3b-398b97ccf545 None None] MFA Rules not processed for user `74b03fa601f84b3b9e0cafedac7ebc00`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:51.381691 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-e9032528-2560-4c7a-9f3b-398b97ccf545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:51.478639 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1318/2612] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:51 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:31:51.493808 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9032528-2560-4c7a-9f3b-398b97ccf545 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:51.495301 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-e9032528-2560-4c7a-9f3b-398b97ccf545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:51.562212 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-180d0aff-b8a2-4fee-9e00-b82901184e7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a0cb81173354d4b8517cbe2953bc14a'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:51.581985 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9032528-2560-4c7a-9f3b-398b97ccf545 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:51.591699 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ae6ca-d9cc-479c-886b-a5d3872a8555 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aae574170d6f4eb8ab70805d8b5f4f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:51.592327 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ae6ca-d9cc-479c-886b-a5d3872a8555 service glance] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:51.592609 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ae6ca-d9cc-479c-886b-a5d3872a8555 service glance] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:51.592885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ae6ca-d9cc-479c-886b-a5d3872a8555 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:51.623315 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:51.656007 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ae6ca-d9cc-479c-886b-a5d3872a8555 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:51.657477 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ae6ca-d9cc-479c-886b-a5d3872a8555 service glance] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:51.667551 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1319/2613] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:31:51.693985 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-180d0aff-b8a2-4fee-9e00-b82901184e7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a0cb81173354d4b8517cbe2953bc14a'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:51.694727 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-180d0aff-b8a2-4fee-9e00-b82901184e7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a0cb81173354d4b8517cbe2953bc14a'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:51.695382 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-180d0aff-b8a2-4fee-9e00-b82901184e7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a0cb81173354d4b8517cbe2953bc14a'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:51.716142 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-180d0aff-b8a2-4fee-9e00-b82901184e7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a0cb81173354d4b8517cbe2953bc14a'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:51.738134 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1295/2614] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:31:51 2022] DELETE /identity/v3/users/3a0cb81173354d4b8517cbe2953bc14a => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:51.739627 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19af094-604d-4b73-bf4d-da2ee6a0b612 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:51.739953 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19af094-604d-4b73-bf4d-da2ee6a0b612 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:51.740597 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19af094-604d-4b73-bf4d-da2ee6a0b612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:51.760865 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-e19af094-604d-4b73-bf4d-da2ee6a0b612 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:51.762020 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-e19af094-604d-4b73-bf4d-da2ee6a0b612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:51.868312 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1320/2615] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:31:51.879855 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d0aff-b8a2-4fee-9e00-b82901184e7d admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:51.882082 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-180d0aff-b8a2-4fee-9e00-b82901184e7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:51.956358 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d0aff-b8a2-4fee-9e00-b82901184e7d admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:51.960102 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52010083-9c6c-4b57-813c-142e066d6b57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:51.960756 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52010083-9c6c-4b57-813c-142e066d6b57 service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:51.961022 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52010083-9c6c-4b57-813c-142e066d6b57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:51.961292 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52010083-9c6c-4b57-813c-142e066d6b57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:51.971103 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52010083-9c6c-4b57-813c-142e066d6b57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:51.972572 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52010083-9c6c-4b57-813c-142e066d6b57 service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:51.983215 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1296/2616] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:52.009173 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f34f3d-34ba-4900-92e8-3ff4ab7f468c None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:52.009692 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f34f3d-34ba-4900-92e8-3ff4ab7f468c None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:52.010163 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f34f3d-34ba-4900-92e8-3ff4ab7f468c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:52.064541 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-91f34f3d-34ba-4900-92e8-3ff4ab7f468c None None] MFA Rules not processed for user `1d39439278814d4faac4cfb1e71aa4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:52.068148 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-91f34f3d-34ba-4900-92e8-3ff4ab7f468c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:52.208385 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1321/2617] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 8 02:31:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:31:52.243085 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52010083-9c6c-4b57-813c-142e066d6b57 service neutron] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:52.243085 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-52010083-9c6c-4b57-813c-142e066d6b57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:52.298723 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:52.388907 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52010083-9c6c-4b57-813c-142e066d6b57 service neutron] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:52.396135 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6695dd-c2e4-43f7-98eb-4c5a878c08ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c212009b6a44e1bad92769630116408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:52.397416 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6695dd-c2e4-43f7-98eb-4c5a878c08ce service swift] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:52.398191 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6695dd-c2e4-43f7-98eb-4c5a878c08ce service swift] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:52.398682 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6695dd-c2e4-43f7-98eb-4c5a878c08ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:52.418919 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6695dd-c2e4-43f7-98eb-4c5a878c08ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:52.423190 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6695dd-c2e4-43f7-98eb-4c5a878c08ce service swift] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:52.441226 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1297/2618] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 8 02:31:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:31:52.692826 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f34f3d-34ba-4900-92e8-3ff4ab7f468c None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:52.694279 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-91f34f3d-34ba-4900-92e8-3ff4ab7f468c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:52.716891 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f34f3d-34ba-4900-92e8-3ff4ab7f468c None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:52.731128 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fbae25-55d0-452e-9673-627fa4526957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:52.734155 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbae25-55d0-452e-9673-627fa4526957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:52.734444 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbae25-55d0-452e-9673-627fa4526957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:52.734731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbae25-55d0-452e-9673-627fa4526957 admin admin] PATH_INFO: `/v3/projects/9793fe0e5da747e18378bf5169a67aad` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:52.738824 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fbae25-55d0-452e-9673-627fa4526957 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9793fe0e5da747e18378bf5169a67aad)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:52.744376 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fbae25-55d0-452e-9673-627fa4526957 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:52.952211 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-e1fbae25-55d0-452e-9673-627fa4526957 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9793fe0e5da747e18378bf5169a67aad', 'request_id': 'req-e1fbae25-55d0-452e-9673-627fa4526957'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:52.958700 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-e1fbae25-55d0-452e-9673-627fa4526957 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9793fe0e5da747e18378bf5169a67aad', 'request_id': 'req-e1fbae25-55d0-452e-9673-627fa4526957'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:52.972906 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-e1fbae25-55d0-452e-9673-627fa4526957 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9793fe0e5da747e18378bf5169a67aad', 'request_id': 'req-e1fbae25-55d0-452e-9673-627fa4526957'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:52.982834 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:53.068570 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-e1fbae25-55d0-452e-9673-627fa4526957 admin admin] The token cache is being invalidate because project 9793fe0e5da747e18378bf5169a67aad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:31:53.068934 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-e1fbae25-55d0-452e-9673-627fa4526957 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:53.069675 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-e1fbae25-55d0-452e-9673-627fa4526957 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:53.071747 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1322/2619] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:31:52 2022] DELETE /identity/v3/projects/9793fe0e5da747e18378bf5169a67aad => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:53.075573 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6695dd-c2e4-43f7-98eb-4c5a878c08ce service swift] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:53.092754 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6695dd-c2e4-43f7-98eb-4c5a878c08ce service swift] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:53.282568 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d030b-57e7-44d3-9728-fffa3a7189aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:53.283555 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d030b-57e7-44d3-9728-fffa3a7189aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:53.286306 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d030b-57e7-44d3-9728-fffa3a7189aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:53.286587 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d030b-57e7-44d3-9728-fffa3a7189aa admin admin] PATH_INFO: `/v3/users/a692555301c54d38b87a65df6846bd99` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:53.289859 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d030b-57e7-44d3-9728-fffa3a7189aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=a692555301c54d38b87a65df6846bd99)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:53.293701 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d030b-57e7-44d3-9728-fffa3a7189aa admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:53.564070 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-060d030b-57e7-44d3-9728-fffa3a7189aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a692555301c54d38b87a65df6846bd99'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:53.679867 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-060d030b-57e7-44d3-9728-fffa3a7189aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a692555301c54d38b87a65df6846bd99'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:53.681147 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-060d030b-57e7-44d3-9728-fffa3a7189aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a692555301c54d38b87a65df6846bd99'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:53.681857 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-060d030b-57e7-44d3-9728-fffa3a7189aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a692555301c54d38b87a65df6846bd99'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:53.697806 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-060d030b-57e7-44d3-9728-fffa3a7189aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a692555301c54d38b87a65df6846bd99'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:53.730895 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1298/2620] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:31:53 2022] DELETE /identity/v3/users/a692555301c54d38b87a65df6846bd99 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:54.376271 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fbae25-55d0-452e-9673-627fa4526957 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:54.377950 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-e1fbae25-55d0-452e-9673-627fa4526957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:54.396195 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fbae25-55d0-452e-9673-627fa4526957 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:54.486348 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29b1b4-1b61-453d-bae3-8c2e8bbfe160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:54.487141 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29b1b4-1b61-453d-bae3-8c2e8bbfe160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:54.488096 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29b1b4-1b61-453d-bae3-8c2e8bbfe160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:54.489226 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29b1b4-1b61-453d-bae3-8c2e8bbfe160 admin admin] PATH_INFO: `/v3/projects/b5cd3e44e36341c3be0c30ef4546dc0a` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:54.493628 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29b1b4-1b61-453d-bae3-8c2e8bbfe160 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5cd3e44e36341c3be0c30ef4546dc0a)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:54.501128 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29b1b4-1b61-453d-bae3-8c2e8bbfe160 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:54.661970 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-da29b1b4-1b61-453d-bae3-8c2e8bbfe160 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5cd3e44e36341c3be0c30ef4546dc0a', 'request_id': 'req-da29b1b4-1b61-453d-bae3-8c2e8bbfe160'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:54.699879 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-da29b1b4-1b61-453d-bae3-8c2e8bbfe160 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5cd3e44e36341c3be0c30ef4546dc0a', 'request_id': 'req-da29b1b4-1b61-453d-bae3-8c2e8bbfe160'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:54.711299 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-da29b1b4-1b61-453d-bae3-8c2e8bbfe160 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5cd3e44e36341c3be0c30ef4546dc0a', 'request_id': 'req-da29b1b4-1b61-453d-bae3-8c2e8bbfe160'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:54.807584 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-da29b1b4-1b61-453d-bae3-8c2e8bbfe160 admin admin] The token cache is being invalidate because project b5cd3e44e36341c3be0c30ef4546dc0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:31:54.810776 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-da29b1b4-1b61-453d-bae3-8c2e8bbfe160 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:54.812926 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-da29b1b4-1b61-453d-bae3-8c2e8bbfe160 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:54.821602 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1323/2621] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:31:54 2022] DELETE /identity/v3/projects/b5cd3e44e36341c3be0c30ef4546dc0a => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:31:54.823240 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0f6a3-8e1a-445e-823e-f7a5c480a267 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:54.823728 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0f6a3-8e1a-445e-823e-f7a5c480a267 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:54.823878 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0f6a3-8e1a-445e-823e-f7a5c480a267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:54.867946 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-72d0f6a3-8e1a-445e-823e-f7a5c480a267 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:54.869181 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-72d0f6a3-8e1a-445e-823e-f7a5c480a267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:54.944248 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:54.999992 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1299/2622] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:31:55.006356 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b69e2b-d477-4899-b7e0-231a8824e42d None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:55.006649 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b69e2b-d477-4899-b7e0-231a8824e42d None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:55.006945 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b69e2b-d477-4899-b7e0-231a8824e42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:55.029507 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-d3b69e2b-d477-4899-b7e0-231a8824e42d None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:55.031272 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-d3b69e2b-d477-4899-b7e0-231a8824e42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:55.046063 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1324/2623] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:55.050931 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0f6a3-8e1a-445e-823e-f7a5c480a267 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:55.064589 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0f6a3-8e1a-445e-823e-f7a5c480a267 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:55.070222 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627e155-0765-49cc-beaf-a29c27366c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:55.073310 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627e155-0765-49cc-beaf-a29c27366c70 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:55.073854 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627e155-0765-49cc-beaf-a29c27366c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:55.074351 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627e155-0765-49cc-beaf-a29c27366c70 admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:55.075286 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f627e155-0765-49cc-beaf-a29c27366c70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:31:55.076669 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f627e155-0765-49cc-beaf-a29c27366c70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:55.078605 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f627e155-0765-49cc-beaf-a29c27366c70 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:55.096078 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1300/2624] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:31:55.100187 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b69e2b-d477-4899-b7e0-231a8824e42d None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:55.135947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b69e2b-d477-4899-b7e0-231a8824e42d None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:55.157604 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc32d3-3e9b-447d-9a50-590f85fd4f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:55.158818 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc32d3-3e9b-447d-9a50-590f85fd4f20 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:55.159099 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc32d3-3e9b-447d-9a50-590f85fd4f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:55.159408 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc32d3-3e9b-447d-9a50-590f85fd4f20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:55.160050 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fc32d3-3e9b-447d-9a50-590f85fd4f20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:55.161967 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fc32d3-3e9b-447d-9a50-590f85fd4f20 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:55.297881 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1325/2625] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:31:55 2022] POST /identity/v3/projects => generated 387 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:31:55.298455 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627e155-0765-49cc-beaf-a29c27366c70 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:55.314162 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627e155-0765-49cc-beaf-a29c27366c70 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:55.393075 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2184a-1f7b-47a4-b2d0-a414056caef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:55.393691 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2184a-1f7b-47a4-b2d0-a414056caef1 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:55.393987 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2184a-1f7b-47a4-b2d0-a414056caef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:55.394247 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2184a-1f7b-47a4-b2d0-a414056caef1 admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:55.395070 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2184a-1f7b-47a4-b2d0-a414056caef1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:55.397322 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2184a-1f7b-47a4-b2d0-a414056caef1 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:55.514006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1301/2626] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:31:55 2022] POST /identity/v3/users => generated 294 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:31:55.518240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc32d3-3e9b-447d-9a50-590f85fd4f20 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:55.532699 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc32d3-3e9b-447d-9a50-590f85fd4f20 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:55.538225 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f21827-c098-47de-b446-b1d13f959e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:55.538869 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f21827-c098-47de-b446-b1d13f959e1d admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:55.539187 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f21827-c098-47de-b446-b1d13f959e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:55.539474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f21827-c098-47de-b446-b1d13f959e1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:55.540115 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f21827-c098-47de-b446-b1d13f959e1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:55.542013 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f21827-c098-47de-b446-b1d13f959e1d admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:55.553891 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1326/2627] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:55.558087 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2184a-1f7b-47a4-b2d0-a414056caef1 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:55.572226 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2184a-1f7b-47a4-b2d0-a414056caef1 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:55.583068 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03442639-f669-47c5-b08e-375cb9fc13f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:55.584254 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03442639-f669-47c5-b08e-375cb9fc13f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:55.584772 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03442639-f669-47c5-b08e-375cb9fc13f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:55.585204 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03442639-f669-47c5-b08e-375cb9fc13f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:55.586667 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03442639-f669-47c5-b08e-375cb9fc13f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:55.590001 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03442639-f669-47c5-b08e-375cb9fc13f1 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:55.606128 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1302/2628] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:55.610789 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f21827-c098-47de-b446-b1d13f959e1d admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:55.622414 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f21827-c098-47de-b446-b1d13f959e1d admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:55.633843 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6d2b4-7b63-4a3a-85a5-9cd658649f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:55.634885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6d2b4-7b63-4a3a-85a5-9cd658649f1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:55.635478 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6d2b4-7b63-4a3a-85a5-9cd658649f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:55.642245 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6d2b4-7b63-4a3a-85a5-9cd658649f1a admin admin] PATH_INFO: `/v3/projects/4502de59ad134bf1b8c60716c1832af7/users/0720b6be68fe4229921e09ea7c791b22/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:55.672700 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6d2b4-7b63-4a3a-85a5-9cd658649f1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4502de59ad134bf1b8c60716c1832af7, user_id=0720b6be68fe4229921e09ea7c791b22, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:55.676354 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6d2b4-7b63-4a3a-85a5-9cd658649f1a admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:55.765273 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1327/2629] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:55 2022] PUT /identity/v3/projects/4502de59ad134bf1b8c60716c1832af7/users/0720b6be68fe4229921e09ea7c791b22/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:55.776464 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c3c24-4af8-4192-9e24-7733a6a9bbbe None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:55.776842 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c3c24-4af8-4192-9e24-7733a6a9bbbe None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:55.777223 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c3c24-4af8-4192-9e24-7733a6a9bbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:55.823739 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-b83c3c24-4af8-4192-9e24-7733a6a9bbbe None None] MFA Rules not processed for user `0720b6be68fe4229921e09ea7c791b22`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:55.825958 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-b83c3c24-4af8-4192-9e24-7733a6a9bbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:55.940910 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1303/2630] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:55.945356 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6d2b4-7b63-4a3a-85a5-9cd658649f1a admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:56.015160 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:56.059415 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6d2b4-7b63-4a3a-85a5-9cd658649f1a admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:56.065054 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6ac19-9aff-470a-bad2-a1beb9c7cec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:56.065678 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6ac19-9aff-470a-bad2-a1beb9c7cec5 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:56.065961 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6ac19-9aff-470a-bad2-a1beb9c7cec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:56.066240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6ac19-9aff-470a-bad2-a1beb9c7cec5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:56.066874 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc6ac19-9aff-470a-bad2-a1beb9c7cec5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:56.069074 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc6ac19-9aff-470a-bad2-a1beb9c7cec5 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:56.230122 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1328/2631] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:31:55 2022] POST /identity/v3/projects => generated 385 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:31:56.234681 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c3c24-4af8-4192-9e24-7733a6a9bbbe None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:56.250156 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c3c24-4af8-4192-9e24-7733a6a9bbbe None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:56.306332 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:56.341804 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d06fd-f807-4333-bb99-1e2f2905f06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:56.342423 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d06fd-f807-4333-bb99-1e2f2905f06b admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:56.342827 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d06fd-f807-4333-bb99-1e2f2905f06b admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:56.343081 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d06fd-f807-4333-bb99-1e2f2905f06b admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:56.343751 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d06fd-f807-4333-bb99-1e2f2905f06b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:56.345664 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d06fd-f807-4333-bb99-1e2f2905f06b admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:56.501223 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1304/2632] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:31:56 2022] POST /identity/v3/users => generated 299 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:31:56.508078 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6ac19-9aff-470a-bad2-a1beb9c7cec5 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:56.519889 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6ac19-9aff-470a-bad2-a1beb9c7cec5 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:56.525300 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b63f47-33f0-4f08-a1d0-3590f5b0f684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:56.525939 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b63f47-33f0-4f08-a1d0-3590f5b0f684 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:56.526223 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b63f47-33f0-4f08-a1d0-3590f5b0f684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:56.526494 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b63f47-33f0-4f08-a1d0-3590f5b0f684 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:56.527134 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b63f47-33f0-4f08-a1d0-3590f5b0f684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:56.529379 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b63f47-33f0-4f08-a1d0-3590f5b0f684 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:56.542421 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1329/2633] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:56.546796 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d06fd-f807-4333-bb99-1e2f2905f06b admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:56.572032 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d06fd-f807-4333-bb99-1e2f2905f06b admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:56.578248 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb67b6-f596-4cc7-95f2-6e0face09101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:56.578934 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb67b6-f596-4cc7-95f2-6e0face09101 admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:56.579218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb67b6-f596-4cc7-95f2-6e0face09101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:56.579801 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb67b6-f596-4cc7-95f2-6e0face09101 admin admin] PATH_INFO: `/v3/projects/1f072171017644029f3cb6eae68bfa04/users/4bc4b76cf888457081c016f8f1aaa470/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:56.600254 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb67b6-f596-4cc7-95f2-6e0face09101 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f072171017644029f3cb6eae68bfa04, user_id=4bc4b76cf888457081c016f8f1aaa470, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:56.608455 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb67b6-f596-4cc7-95f2-6e0face09101 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:56.879503 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1305/2634] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:56 2022] PUT /identity/v3/projects/1f072171017644029f3cb6eae68bfa04/users/4bc4b76cf888457081c016f8f1aaa470/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:56.883567 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b63f47-33f0-4f08-a1d0-3590f5b0f684 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:56.894098 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b63f47-33f0-4f08-a1d0-3590f5b0f684 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:56.969252 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a2244-0ef4-4f2e-a744-27f539cb86b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:56.970148 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a2244-0ef4-4f2e-a744-27f539cb86b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:56.970435 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a2244-0ef4-4f2e-a744-27f539cb86b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:56.970733 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a2244-0ef4-4f2e-a744-27f539cb86b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:56.971524 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a2244-0ef4-4f2e-a744-27f539cb86b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:56.973204 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a2244-0ef4-4f2e-a744-27f539cb86b7 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:56.993135 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1330/2635] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:31:56.994374 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb67b6-f596-4cc7-95f2-6e0face09101 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:57.006357 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb67b6-f596-4cc7-95f2-6e0face09101 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:57.018806 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a4fe7-95db-48d1-934b-ab31dbf36ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:57.019752 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a4fe7-95db-48d1-934b-ab31dbf36ff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:57.020108 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a4fe7-95db-48d1-934b-ab31dbf36ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:57.020470 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a4fe7-95db-48d1-934b-ab31dbf36ff7 admin admin] PATH_INFO: `/v3/projects/1f072171017644029f3cb6eae68bfa04/users/4bc4b76cf888457081c016f8f1aaa470/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:57.031199 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a4fe7-95db-48d1-934b-ab31dbf36ff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f072171017644029f3cb6eae68bfa04, user_id=4bc4b76cf888457081c016f8f1aaa470, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:57.032873 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a4fe7-95db-48d1-934b-ab31dbf36ff7 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:57.062913 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1306/2636] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:31:56 2022] PUT /identity/v3/projects/1f072171017644029f3cb6eae68bfa04/users/4bc4b76cf888457081c016f8f1aaa470/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:57.076429 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e51738-5908-48f5-bc39-17feff475e6b None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:57.076710 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e51738-5908-48f5-bc39-17feff475e6b None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:57.076994 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e51738-5908-48f5-bc39-17feff475e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:57.125271 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-47e51738-5908-48f5-bc39-17feff475e6b None None] MFA Rules not processed for user `4bc4b76cf888457081c016f8f1aaa470`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:57.126731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-47e51738-5908-48f5-bc39-17feff475e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:57.241072 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1331/2637] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:57.251576 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a4fe7-95db-48d1-934b-ab31dbf36ff7 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:57.257614 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-302a4fe7-95db-48d1-934b-ab31dbf36ff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:57.334567 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a4fe7-95db-48d1-934b-ab31dbf36ff7 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:57.342924 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671dd6f0-2956-4d71-b3c7-94eeabba1031 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:57.343669 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671dd6f0-2956-4d71-b3c7-94eeabba1031 service cinder] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:57.344023 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671dd6f0-2956-4d71-b3c7-94eeabba1031 service cinder] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:57.344370 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671dd6f0-2956-4d71-b3c7-94eeabba1031 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:57.354976 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671dd6f0-2956-4d71-b3c7-94eeabba1031 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:57.359508 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671dd6f0-2956-4d71-b3c7-94eeabba1031 service cinder] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:57.385557 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1307/2638] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:57 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:58.878861 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e51738-5908-48f5-bc39-17feff475e6b None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:58.910294 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:58.972951 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e51738-5908-48f5-bc39-17feff475e6b None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:58.979107 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1921e-1028-45ed-bc71-04179e23b280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:58.980000 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1921e-1028-45ed-bc71-04179e23b280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:58.980385 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1921e-1028-45ed-bc71-04179e23b280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:58.980763 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1921e-1028-45ed-bc71-04179e23b280 admin admin] PATH_INFO: `/v3/users/0720b6be68fe4229921e09ea7c791b22` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:58.982537 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1921e-1028-45ed-bc71-04179e23b280 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0720b6be68fe4229921e09ea7c791b22)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:58.987255 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1921e-1028-45ed-bc71-04179e23b280 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:59.017390 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671dd6f0-2956-4d71-b3c7-94eeabba1031 service cinder] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:59.019439 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-671dd6f0-2956-4d71-b3c7-94eeabba1031 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:59.100981 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671dd6f0-2956-4d71-b3c7-94eeabba1031 service cinder] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:59.106981 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e90d9-fa8b-468e-a4cf-4789b0ad6241 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:59.107541 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e90d9-fa8b-468e-a4cf-4789b0ad6241 service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:59.107825 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e90d9-fa8b-468e-a4cf-4789b0ad6241 service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:59.108106 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e90d9-fa8b-468e-a4cf-4789b0ad6241 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:59.109995 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-614e90d9-fa8b-468e-a4cf-4789b0ad6241 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:59.124904 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e90d9-fa8b-468e-a4cf-4789b0ad6241 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:59.126891 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e90d9-fa8b-468e-a4cf-4789b0ad6241 service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:59.139181 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1308/2639] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:31:59.270289 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-9be1921e-1028-45ed-bc71-04179e23b280 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0720b6be68fe4229921e09ea7c791b22'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:59.378889 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-9be1921e-1028-45ed-bc71-04179e23b280 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0720b6be68fe4229921e09ea7c791b22'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:59.379814 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-9be1921e-1028-45ed-bc71-04179e23b280 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0720b6be68fe4229921e09ea7c791b22'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:59.409773 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-9be1921e-1028-45ed-bc71-04179e23b280 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0720b6be68fe4229921e09ea7c791b22'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:59.436078 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-9be1921e-1028-45ed-bc71-04179e23b280 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0720b6be68fe4229921e09ea7c791b22'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:31:59.449836 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1332/2640] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:31:58 2022] DELETE /identity/v3/users/0720b6be68fe4229921e09ea7c791b22 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:31:59.454738 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f9b61-8e6d-4c1e-aeeb-f3597c64a08c None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:59.455127 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f9b61-8e6d-4c1e-aeeb-f3597c64a08c None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:59.455496 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f9b61-8e6d-4c1e-aeeb-f3597c64a08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:59.485865 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-426f9b61-8e6d-4c1e-aeeb-f3597c64a08c None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:31:59.487451 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-426f9b61-8e6d-4c1e-aeeb-f3597c64a08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:59.520432 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:59.582653 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1309/2641] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:31:59.592562 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1921e-1028-45ed-bc71-04179e23b280 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:31:59.594349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-9be1921e-1028-45ed-bc71-04179e23b280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:31:59.699155 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1921e-1028-45ed-bc71-04179e23b280 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:31:59.708189 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d846d5a-d575-40e5-abba-a4b0c6b84915 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:31:59.708889 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d846d5a-d575-40e5-abba-a4b0c6b84915 service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:31:59.709257 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d846d5a-d575-40e5-abba-a4b0c6b84915 service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:31:59.709456 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d846d5a-d575-40e5-abba-a4b0c6b84915 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:31:59.729181 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d846d5a-d575-40e5-abba-a4b0c6b84915 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:31:59.735793 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d846d5a-d575-40e5-abba-a4b0c6b84915 service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:31:59.751837 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1333/2642] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:31:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:32:00.397647 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f9b61-8e6d-4c1e-aeeb-f3597c64a08c None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:00.399157 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-426f9b61-8e6d-4c1e-aeeb-f3597c64a08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:00.411230 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f9b61-8e6d-4c1e-aeeb-f3597c64a08c None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:00.416109 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525a432-abed-4cbe-9a8f-610ebdcfdb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:00.469848 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525a432-abed-4cbe-9a8f-610ebdcfdb64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:00.469848 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525a432-abed-4cbe-9a8f-610ebdcfdb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:00.469848 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525a432-abed-4cbe-9a8f-610ebdcfdb64 admin admin] PATH_INFO: `/v3/projects/4502de59ad134bf1b8c60716c1832af7` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:00.469848 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7525a432-abed-4cbe-9a8f-610ebdcfdb64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4502de59ad134bf1b8c60716c1832af7)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:00.469848 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7525a432-abed-4cbe-9a8f-610ebdcfdb64 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:00.644070 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-7525a432-abed-4cbe-9a8f-610ebdcfdb64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4502de59ad134bf1b8c60716c1832af7', 'request_id': 'req-7525a432-abed-4cbe-9a8f-610ebdcfdb64'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:00.649788 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-7525a432-abed-4cbe-9a8f-610ebdcfdb64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4502de59ad134bf1b8c60716c1832af7', 'request_id': 'req-7525a432-abed-4cbe-9a8f-610ebdcfdb64'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:00.656843 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-7525a432-abed-4cbe-9a8f-610ebdcfdb64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4502de59ad134bf1b8c60716c1832af7', 'request_id': 'req-7525a432-abed-4cbe-9a8f-610ebdcfdb64'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:00.805158 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-7525a432-abed-4cbe-9a8f-610ebdcfdb64 admin admin] The token cache is being invalidate because project 4502de59ad134bf1b8c60716c1832af7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:32:00.805922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-7525a432-abed-4cbe-9a8f-610ebdcfdb64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:00.806525 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-7525a432-abed-4cbe-9a8f-610ebdcfdb64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:00.811751 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1310/2643] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:32:00 2022] DELETE /identity/v3/projects/4502de59ad134bf1b8c60716c1832af7 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:00.815344 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d846d5a-d575-40e5-abba-a4b0c6b84915 service neutron] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:00.826134 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d846d5a-d575-40e5-abba-a4b0c6b84915 service neutron] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:00.879937 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:00.908166 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2ab66-9ef5-41b6-aa22-a5024a38557b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:00.909071 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2ab66-9ef5-41b6-aa22-a5024a38557b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:00.909501 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2ab66-9ef5-41b6-aa22-a5024a38557b admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:00.909788 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2ab66-9ef5-41b6-aa22-a5024a38557b admin admin] PATH_INFO: `/v3/users/4bc4b76cf888457081c016f8f1aaa470` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:00.911284 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b2ab66-9ef5-41b6-aa22-a5024a38557b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bc4b76cf888457081c016f8f1aaa470)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:00.913014 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b2ab66-9ef5-41b6-aa22-a5024a38557b admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:01.103248 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-68b2ab66-9ef5-41b6-aa22-a5024a38557b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bc4b76cf888457081c016f8f1aaa470'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:01.174895 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-68b2ab66-9ef5-41b6-aa22-a5024a38557b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bc4b76cf888457081c016f8f1aaa470'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:01.175570 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-68b2ab66-9ef5-41b6-aa22-a5024a38557b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bc4b76cf888457081c016f8f1aaa470'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:01.197341 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-68b2ab66-9ef5-41b6-aa22-a5024a38557b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bc4b76cf888457081c016f8f1aaa470'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:01.232683 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-68b2ab66-9ef5-41b6-aa22-a5024a38557b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bc4b76cf888457081c016f8f1aaa470'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:01.243114 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1334/2644] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:32:00 2022] DELETE /identity/v3/users/4bc4b76cf888457081c016f8f1aaa470 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:01.770941 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525a432-abed-4cbe-9a8f-610ebdcfdb64 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:01.776632 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-7525a432-abed-4cbe-9a8f-610ebdcfdb64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:01.794233 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525a432-abed-4cbe-9a8f-610ebdcfdb64 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:01.911466 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5695855-cdf4-4033-9112-6e5b4659f1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:01.912378 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5695855-cdf4-4033-9112-6e5b4659f1d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:01.912843 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5695855-cdf4-4033-9112-6e5b4659f1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:01.913312 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5695855-cdf4-4033-9112-6e5b4659f1d8 admin admin] PATH_INFO: `/v3/projects/1f072171017644029f3cb6eae68bfa04` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:01.914886 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5695855-cdf4-4033-9112-6e5b4659f1d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f072171017644029f3cb6eae68bfa04)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:01.917039 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5695855-cdf4-4033-9112-6e5b4659f1d8 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:02.079912 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-d5695855-cdf4-4033-9112-6e5b4659f1d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f072171017644029f3cb6eae68bfa04', 'request_id': 'req-d5695855-cdf4-4033-9112-6e5b4659f1d8'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:02.088937 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:02.094058 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-d5695855-cdf4-4033-9112-6e5b4659f1d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f072171017644029f3cb6eae68bfa04', 'request_id': 'req-d5695855-cdf4-4033-9112-6e5b4659f1d8'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:02.107755 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-d5695855-cdf4-4033-9112-6e5b4659f1d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f072171017644029f3cb6eae68bfa04', 'request_id': 'req-d5695855-cdf4-4033-9112-6e5b4659f1d8'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:02.189271 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-d5695855-cdf4-4033-9112-6e5b4659f1d8 admin admin] The token cache is being invalidate because project 1f072171017644029f3cb6eae68bfa04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:32:02.190017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-d5695855-cdf4-4033-9112-6e5b4659f1d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:02.192591 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-d5695855-cdf4-4033-9112-6e5b4659f1d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:02.194543 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1311/2645] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:32:01 2022] DELETE /identity/v3/projects/1f072171017644029f3cb6eae68bfa04 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:02.201299 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9002e6d-a2b5-45db-b198-bb95a00837b6 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:02.201299 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9002e6d-a2b5-45db-b198-bb95a00837b6 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:02.201899 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9002e6d-a2b5-45db-b198-bb95a00837b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:02.230406 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-f9002e6d-a2b5-45db-b198-bb95a00837b6 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:02.232255 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-f9002e6d-a2b5-45db-b198-bb95a00837b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:02.340207 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1335/2646] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:32:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:02.350938 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565276c0-83c6-4f71-bdc6-b1d02aef8436 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:02.350938 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565276c0-83c6-4f71-bdc6-b1d02aef8436 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:02.350938 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565276c0-83c6-4f71-bdc6-b1d02aef8436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:02.407881 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-565276c0-83c6-4f71-bdc6-b1d02aef8436 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:02.413446 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-565276c0-83c6-4f71-bdc6-b1d02aef8436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:02.440049 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1312/2647] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:32:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:02.444647 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9002e6d-a2b5-45db-b198-bb95a00837b6 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:02.457669 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9002e6d-a2b5-45db-b198-bb95a00837b6 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:02.474022 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5717a7-14ce-4ed2-8af9-474e6ab30457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:02.476220 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5717a7-14ce-4ed2-8af9-474e6ab30457 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:02.476569 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5717a7-14ce-4ed2-8af9-474e6ab30457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:02.476857 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5717a7-14ce-4ed2-8af9-474e6ab30457 admin admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:02.477803 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5717a7-14ce-4ed2-8af9-474e6ab30457 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:32:02.478141 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5717a7-14ce-4ed2-8af9-474e6ab30457 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:02.480024 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5717a7-14ce-4ed2-8af9-474e6ab30457 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:02.523513 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1336/2648] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:32:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:32:02.528094 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565276c0-83c6-4f71-bdc6-b1d02aef8436 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:02.539855 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565276c0-83c6-4f71-bdc6-b1d02aef8436 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:02.559068 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eeeaca-dd9e-4dea-9dd9-3bf2b73c5b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:02.559068 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eeeaca-dd9e-4dea-9dd9-3bf2b73c5b02 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:02.559068 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eeeaca-dd9e-4dea-9dd9-3bf2b73c5b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:02.559068 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eeeaca-dd9e-4dea-9dd9-3bf2b73c5b02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:02.559651 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eeeaca-dd9e-4dea-9dd9-3bf2b73c5b02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:02.559651 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eeeaca-dd9e-4dea-9dd9-3bf2b73c5b02 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:02.702044 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1313/2649] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:32:02 2022] POST /identity/v3/projects => generated 375 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:32:02.705890 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5717a7-14ce-4ed2-8af9-474e6ab30457 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:02.720652 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5717a7-14ce-4ed2-8af9-474e6ab30457 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:02.780792 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:02.806891 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d7479-2b35-4ca3-8c00-5274c0f040f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:02.807737 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d7479-2b35-4ca3-8c00-5274c0f040f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:02.808035 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d7479-2b35-4ca3-8c00-5274c0f040f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:02.808315 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d7479-2b35-4ca3-8c00-5274c0f040f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:02.808987 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d7479-2b35-4ca3-8c00-5274c0f040f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:02.811066 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d7479-2b35-4ca3-8c00-5274c0f040f7 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:02.930798 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1337/2650] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:32:02 2022] POST /identity/v3/users => generated 288 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:32:02.938571 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eeeaca-dd9e-4dea-9dd9-3bf2b73c5b02 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:02.956089 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eeeaca-dd9e-4dea-9dd9-3bf2b73c5b02 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:02.961169 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a8a4a-67c8-4538-972f-68b99b459af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:02.969464 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a8a4a-67c8-4538-972f-68b99b459af3 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:02.969464 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a8a4a-67c8-4538-972f-68b99b459af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:02.969464 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a8a4a-67c8-4538-972f-68b99b459af3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:02.969464 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a8a4a-67c8-4538-972f-68b99b459af3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:02.969464 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a8a4a-67c8-4538-972f-68b99b459af3 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:02.999647 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1314/2651] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:32:03.006778 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d7479-2b35-4ca3-8c00-5274c0f040f7 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:03.018895 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d7479-2b35-4ca3-8c00-5274c0f040f7 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:03.030065 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff722a-61da-402a-8b78-b1e2460eef7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:03.030847 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff722a-61da-402a-8b78-b1e2460eef7e admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:03.031254 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff722a-61da-402a-8b78-b1e2460eef7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:03.031668 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff722a-61da-402a-8b78-b1e2460eef7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:03.032429 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff722a-61da-402a-8b78-b1e2460eef7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:03.037535 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff722a-61da-402a-8b78-b1e2460eef7e admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:03.059452 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1338/2652] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:32:03.064383 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a8a4a-67c8-4538-972f-68b99b459af3 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:03.080712 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a8a4a-67c8-4538-972f-68b99b459af3 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:03.090266 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91b7a6-b743-4401-80c2-a89e2cc9ff22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:03.092216 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91b7a6-b743-4401-80c2-a89e2cc9ff22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:03.101461 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91b7a6-b743-4401-80c2-a89e2cc9ff22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:03.101810 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91b7a6-b743-4401-80c2-a89e2cc9ff22 admin admin] PATH_INFO: `/v3/projects/0a1ebc790fb8445d9c9e6f3732637dfa/users/5d57a03bb5a442d3974dc2545bfa4e66/roles/5691bce246d6452990f13933e19f2825` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:03.131103 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d91b7a6-b743-4401-80c2-a89e2cc9ff22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a1ebc790fb8445d9c9e6f3732637dfa, user_id=5d57a03bb5a442d3974dc2545bfa4e66, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:03.135754 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d91b7a6-b743-4401-80c2-a89e2cc9ff22 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:03.268346 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1315/2653] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:32:03 2022] PUT /identity/v3/projects/0a1ebc790fb8445d9c9e6f3732637dfa/users/5d57a03bb5a442d3974dc2545bfa4e66/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:32:03.270370 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb1121-ce5d-44a3-b381-ccefc06000b2 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:03.270834 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb1121-ce5d-44a3-b381-ccefc06000b2 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:03.270919 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb1121-ce5d-44a3-b381-ccefc06000b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:03.332112 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-77cb1121-ce5d-44a3-b381-ccefc06000b2 None None] MFA Rules not processed for user `5d57a03bb5a442d3974dc2545bfa4e66`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:03.334092 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-77cb1121-ce5d-44a3-b381-ccefc06000b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:03.474117 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91b7a6-b743-4401-80c2-a89e2cc9ff22 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:03.485948 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1339/2654] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:32:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:03.615418 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91b7a6-b743-4401-80c2-a89e2cc9ff22 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:03.620308 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f92af8-714d-444b-b2b0-b446ad9f9630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:03.620915 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f92af8-714d-444b-b2b0-b446ad9f9630 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:03.621201 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f92af8-714d-444b-b2b0-b446ad9f9630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:03.621482 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f92af8-714d-444b-b2b0-b446ad9f9630 admin admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:03.622186 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f92af8-714d-444b-b2b0-b446ad9f9630 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:03.624132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f92af8-714d-444b-b2b0-b446ad9f9630 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:03.743871 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1316/2655] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:32:03 2022] POST /identity/v3/projects => generated 375 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:32:03.749889 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb1121-ce5d-44a3-b381-ccefc06000b2 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:03.766939 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb1121-ce5d-44a3-b381-ccefc06000b2 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:03.890411 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a7327-ab2e-40fc-943a-671f834ae113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:03.891481 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a7327-ab2e-40fc-943a-671f834ae113 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:03.891705 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a7327-ab2e-40fc-943a-671f834ae113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:03.892193 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a7327-ab2e-40fc-943a-671f834ae113 admin admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:03.892841 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a7327-ab2e-40fc-943a-671f834ae113 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:03.897613 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a7327-ab2e-40fc-943a-671f834ae113 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:03.994602 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f92af8-714d-444b-b2b0-b446ad9f9630 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:03.996692 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-57f92af8-714d-444b-b2b0-b446ad9f9630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:04.071821 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1340/2656] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:32:03 2022] POST /identity/v3/users => generated 294 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:32:04.072906 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a7327-ab2e-40fc-943a-671f834ae113 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:04.084807 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a7327-ab2e-40fc-943a-671f834ae113 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:04.090646 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b67d73-6bd5-4aa8-adc8-c9f33e404523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:04.092035 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b67d73-6bd5-4aa8-adc8-c9f33e404523 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:04.092324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b67d73-6bd5-4aa8-adc8-c9f33e404523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:04.092599 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b67d73-6bd5-4aa8-adc8-c9f33e404523 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:04.093310 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b67d73-6bd5-4aa8-adc8-c9f33e404523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:04.094920 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b67d73-6bd5-4aa8-adc8-c9f33e404523 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:04.108109 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1341/2657] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:32:04.113829 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b67d73-6bd5-4aa8-adc8-c9f33e404523 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:04.126743 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f92af8-714d-444b-b2b0-b446ad9f9630 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:04.133344 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136b20c-b8ac-4b5f-877c-73ba4fbe2389 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43a39dd539974180a8165e34de57b552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:04.134324 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136b20c-b8ac-4b5f-877c-73ba4fbe2389 service placement] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:04.134902 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136b20c-b8ac-4b5f-877c-73ba4fbe2389 service placement] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:04.135380 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136b20c-b8ac-4b5f-877c-73ba4fbe2389 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:04.137389 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-f136b20c-b8ac-4b5f-877c-73ba4fbe2389 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:04.143777 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b67d73-6bd5-4aa8-adc8-c9f33e404523 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:04.149894 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:04.155898 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f136b20c-b8ac-4b5f-877c-73ba4fbe2389 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:04.157913 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f136b20c-b8ac-4b5f-877c-73ba4fbe2389 service placement] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:04.160573 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253fd88a-7191-4b9e-a5e1-3c698bbbfa75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:04.161793 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253fd88a-7191-4b9e-a5e1-3c698bbbfa75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:04.162109 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253fd88a-7191-4b9e-a5e1-3c698bbbfa75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:04.165228 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253fd88a-7191-4b9e-a5e1-3c698bbbfa75 admin admin] PATH_INFO: `/v3/projects/57ea5030ed85426d96d07e9744db0a95/users/14b2dd5444b5422792cfade0cf773283/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:04.173348 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1317/2658] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:32:04.193737 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253fd88a-7191-4b9e-a5e1-3c698bbbfa75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57ea5030ed85426d96d07e9744db0a95, user_id=14b2dd5444b5422792cfade0cf773283, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:04.216467 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253fd88a-7191-4b9e-a5e1-3c698bbbfa75 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:04.238098 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136b20c-b8ac-4b5f-877c-73ba4fbe2389 service placement] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:04.240286 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-f136b20c-b8ac-4b5f-877c-73ba4fbe2389 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:04.265185 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136b20c-b8ac-4b5f-877c-73ba4fbe2389 service placement] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:04.276042 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93778a08-4db1-43d2-9cf2-09d4d4865199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:04.276042 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93778a08-4db1-43d2-9cf2-09d4d4865199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:04.276042 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93778a08-4db1-43d2-9cf2-09d4d4865199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:04.276042 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93778a08-4db1-43d2-9cf2-09d4d4865199 admin admin] PATH_INFO: `/v3/users/5f1629cbe3e64573bf444834d6083669` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:04.276397 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93778a08-4db1-43d2-9cf2-09d4d4865199 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f1629cbe3e64573bf444834d6083669)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:04.278024 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93778a08-4db1-43d2-9cf2-09d4d4865199 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:04.331418 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1342/2659] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:32:04 2022] PUT /identity/v3/projects/57ea5030ed85426d96d07e9744db0a95/users/14b2dd5444b5422792cfade0cf773283/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:04.333232 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253fd88a-7191-4b9e-a5e1-3c698bbbfa75 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:04.345946 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:04.414088 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253fd88a-7191-4b9e-a5e1-3c698bbbfa75 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:04.419417 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee840d3f-7e76-4ae5-9241-5ddbd1025660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:04.420131 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee840d3f-7e76-4ae5-9241-5ddbd1025660 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:04.420483 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee840d3f-7e76-4ae5-9241-5ddbd1025660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:04.420911 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee840d3f-7e76-4ae5-9241-5ddbd1025660 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:04.422456 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee840d3f-7e76-4ae5-9241-5ddbd1025660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:04.425377 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee840d3f-7e76-4ae5-9241-5ddbd1025660 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:04.439392 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1343/2660] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:32:04.443797 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee840d3f-7e76-4ae5-9241-5ddbd1025660 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:04.461275 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee840d3f-7e76-4ae5-9241-5ddbd1025660 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:04.476217 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762f63f-9598-447f-a8dc-1e71476ef809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:04.477081 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762f63f-9598-447f-a8dc-1e71476ef809 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:04.477438 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762f63f-9598-447f-a8dc-1e71476ef809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:04.477786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762f63f-9598-447f-a8dc-1e71476ef809 admin admin] PATH_INFO: `/v3/projects/57ea5030ed85426d96d07e9744db0a95/users/14b2dd5444b5422792cfade0cf773283/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:04.481960 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3762f63f-9598-447f-a8dc-1e71476ef809 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57ea5030ed85426d96d07e9744db0a95, user_id=14b2dd5444b5422792cfade0cf773283, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:04.485560 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3762f63f-9598-447f-a8dc-1e71476ef809 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:04.498803 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1344/2661] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:32:04 2022] PUT /identity/v3/projects/57ea5030ed85426d96d07e9744db0a95/users/14b2dd5444b5422792cfade0cf773283/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:04.513100 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8e7c2-32fe-4345-8a7b-59e2ac8c96a7 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:04.513706 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8e7c2-32fe-4345-8a7b-59e2ac8c96a7 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:04.514172 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8e7c2-32fe-4345-8a7b-59e2ac8c96a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:04.554583 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-b6c8e7c2-32fe-4345-8a7b-59e2ac8c96a7 None None] MFA Rules not processed for user `14b2dd5444b5422792cfade0cf773283`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:04.554583 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-b6c8e7c2-32fe-4345-8a7b-59e2ac8c96a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:04.642480 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1345/2662] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:32:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:04.654287 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8e7c2-32fe-4345-8a7b-59e2ac8c96a7 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:04.655876 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-b6c8e7c2-32fe-4345-8a7b-59e2ac8c96a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:04.725842 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8e7c2-32fe-4345-8a7b-59e2ac8c96a7 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:04.729770 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc68fa-97a9-4d57-b8b9-6c672d579336 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:04.730408 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc68fa-97a9-4d57-b8b9-6c672d579336 service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:04.730712 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc68fa-97a9-4d57-b8b9-6c672d579336 service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:04.730970 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc68fa-97a9-4d57-b8b9-6c672d579336 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:04.791144 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc68fa-97a9-4d57-b8b9-6c672d579336 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:04.792708 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc68fa-97a9-4d57-b8b9-6c672d579336 service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:04.802299 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1346/2663] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:32:05.140505 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-93778a08-4db1-43d2-9cf2-09d4d4865199 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f1629cbe3e64573bf444834d6083669'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:05.241871 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-93778a08-4db1-43d2-9cf2-09d4d4865199 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f1629cbe3e64573bf444834d6083669'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:05.242503 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-93778a08-4db1-43d2-9cf2-09d4d4865199 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f1629cbe3e64573bf444834d6083669'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:05.243222 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-93778a08-4db1-43d2-9cf2-09d4d4865199 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f1629cbe3e64573bf444834d6083669'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:05.259640 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-93778a08-4db1-43d2-9cf2-09d4d4865199 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f1629cbe3e64573bf444834d6083669'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:05.272795 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1318/2664] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:32:04 2022] DELETE /identity/v3/users/5f1629cbe3e64573bf444834d6083669 => generated 0 bytes in 1035 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:05.586558 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc68fa-97a9-4d57-b8b9-6c672d579336 service cinder] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:05.706538 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc68fa-97a9-4d57-b8b9-6c672d579336 service cinder] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:05.771325 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258a02e-3385-4aef-a406-ba63f5fd1537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:05.772018 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258a02e-3385-4aef-a406-ba63f5fd1537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:05.772321 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258a02e-3385-4aef-a406-ba63f5fd1537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:05.772618 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258a02e-3385-4aef-a406-ba63f5fd1537 admin admin] PATH_INFO: `/v3/projects/1049450b0abe4ae69da9708435f04322` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:05.773748 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258a02e-3385-4aef-a406-ba63f5fd1537 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1049450b0abe4ae69da9708435f04322)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:05.775688 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258a02e-3385-4aef-a406-ba63f5fd1537 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:05.931157 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-3258a02e-3385-4aef-a406-ba63f5fd1537 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1049450b0abe4ae69da9708435f04322', 'request_id': 'req-3258a02e-3385-4aef-a406-ba63f5fd1537'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:05.936562 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-3258a02e-3385-4aef-a406-ba63f5fd1537 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1049450b0abe4ae69da9708435f04322', 'request_id': 'req-3258a02e-3385-4aef-a406-ba63f5fd1537'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:05.943010 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-3258a02e-3385-4aef-a406-ba63f5fd1537 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1049450b0abe4ae69da9708435f04322', 'request_id': 'req-3258a02e-3385-4aef-a406-ba63f5fd1537'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:05.946061 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:06.052336 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-3258a02e-3385-4aef-a406-ba63f5fd1537 admin admin] The token cache is being invalidate because project 1049450b0abe4ae69da9708435f04322 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:32:06.052630 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-3258a02e-3385-4aef-a406-ba63f5fd1537 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:06.053236 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-3258a02e-3385-4aef-a406-ba63f5fd1537 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:06.054778 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1347/2665] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:32:05 2022] DELETE /identity/v3/projects/1049450b0abe4ae69da9708435f04322 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:06.059903 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447b00b-c7f3-4d61-90f8-4121e9334f34 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:06.060197 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447b00b-c7f3-4d61-90f8-4121e9334f34 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:06.060482 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447b00b-c7f3-4d61-90f8-4121e9334f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:06.085070 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-2447b00b-c7f3-4d61-90f8-4121e9334f34 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:06.085070 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-2447b00b-c7f3-4d61-90f8-4121e9334f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:06.143803 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1319/2666] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:32:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:06.152657 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3d5ca-38f7-45c9-8cfe-130a993ff05e None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:06.152941 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3d5ca-38f7-45c9-8cfe-130a993ff05e None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:06.153211 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3d5ca-38f7-45c9-8cfe-130a993ff05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:06.172366 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-d1b3d5ca-38f7-45c9-8cfe-130a993ff05e None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:06.173555 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-d1b3d5ca-38f7-45c9-8cfe-130a993ff05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:06.183769 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1348/2667] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:32:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:06.190982 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447b00b-c7f3-4d61-90f8-4121e9334f34 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:06.201496 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447b00b-c7f3-4d61-90f8-4121e9334f34 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:06.210022 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefca34b-8c85-4a26-95f8-2bee8e2064fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:06.210628 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefca34b-8c85-4a26-95f8-2bee8e2064fc admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:06.210915 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefca34b-8c85-4a26-95f8-2bee8e2064fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:06.211318 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefca34b-8c85-4a26-95f8-2bee8e2064fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:06.218193 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefca34b-8c85-4a26-95f8-2bee8e2064fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:32:06.218193 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefca34b-8c85-4a26-95f8-2bee8e2064fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:06.218193 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefca34b-8c85-4a26-95f8-2bee8e2064fc admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:06.226452 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1320/2668] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:32:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:32:06.230910 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3d5ca-38f7-45c9-8cfe-130a993ff05e None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:06.240932 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3d5ca-38f7-45c9-8cfe-130a993ff05e None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:06.245949 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1488df-2873-4166-9d16-4514601c5bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:06.251379 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1488df-2873-4166-9d16-4514601c5bc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:06.251379 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1488df-2873-4166-9d16-4514601c5bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:06.251379 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1488df-2873-4166-9d16-4514601c5bc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:06.251379 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1488df-2873-4166-9d16-4514601c5bc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:06.251379 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1488df-2873-4166-9d16-4514601c5bc0 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:06.386073 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1349/2669] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:32:06 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:32:06.387218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefca34b-8c85-4a26-95f8-2bee8e2064fc admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:06.397784 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefca34b-8c85-4a26-95f8-2bee8e2064fc admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:06.421930 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c4845-8e3b-4f4a-96b7-69d0c36d1c2a None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:06.422310 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c4845-8e3b-4f4a-96b7-69d0c36d1c2a None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:06.422667 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c4845-8e3b-4f4a-96b7-69d0c36d1c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:06.444274 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-c53c4845-8e3b-4f4a-96b7-69d0c36d1c2a None None] MFA Rules not processed for user `e83d227094f4419a9d98021636f8b1f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:06.445507 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-c53c4845-8e3b-4f4a-96b7-69d0c36d1c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:06.453532 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:06.463843 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dec3d3-4680-470c-ad47-1eef58c42487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:06.464496 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dec3d3-4680-470c-ad47-1eef58c42487 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:06.464732 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dec3d3-4680-470c-ad47-1eef58c42487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:06.465008 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dec3d3-4680-470c-ad47-1eef58c42487 admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:06.465633 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dec3d3-4680-470c-ad47-1eef58c42487 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:06.468239 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dec3d3-4680-470c-ad47-1eef58c42487 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:06.513292 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1350/2670] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:32:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:06.557495 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1321/2671] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:32:06 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:32:06.564269 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c4845-8e3b-4f4a-96b7-69d0c36d1c2a None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:06.573449 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c4845-8e3b-4f4a-96b7-69d0c36d1c2a None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:06.579145 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793cf405-0978-4344-ac7e-437be9d7605a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:06.579915 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793cf405-0978-4344-ac7e-437be9d7605a admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:06.580518 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793cf405-0978-4344-ac7e-437be9d7605a admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:06.580621 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793cf405-0978-4344-ac7e-437be9d7605a admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:06.581333 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793cf405-0978-4344-ac7e-437be9d7605a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:06.583106 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793cf405-0978-4344-ac7e-437be9d7605a admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:06.594844 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1351/2672] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:32:06.598770 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dec3d3-4680-470c-ad47-1eef58c42487 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:06.609217 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dec3d3-4680-470c-ad47-1eef58c42487 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:06.614236 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc73dbd-a2c2-4337-aa11-4a3cd1ac2882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:06.614842 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc73dbd-a2c2-4337-aa11-4a3cd1ac2882 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:06.615330 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc73dbd-a2c2-4337-aa11-4a3cd1ac2882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:06.615645 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc73dbd-a2c2-4337-aa11-4a3cd1ac2882 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:06.616355 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc73dbd-a2c2-4337-aa11-4a3cd1ac2882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:06.617987 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc73dbd-a2c2-4337-aa11-4a3cd1ac2882 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:06.629575 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1322/2673] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:32:06.633753 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793cf405-0978-4344-ac7e-437be9d7605a admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:06.647931 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793cf405-0978-4344-ac7e-437be9d7605a admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:06.649269 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08daf6df-21a4-44eb-a8a3-066b8f6adfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:06.649923 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daf6df-21a4-44eb-a8a3-066b8f6adfe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:06.650208 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daf6df-21a4-44eb-a8a3-066b8f6adfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:06.650486 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daf6df-21a4-44eb-a8a3-066b8f6adfe2 admin admin] PATH_INFO: `/v3/projects/055a9daa616849278614af86c08c9e4a/users/05a2213b7b08457da87caa8aec9b41d6/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:06.665945 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08daf6df-21a4-44eb-a8a3-066b8f6adfe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=055a9daa616849278614af86c08c9e4a, user_id=05a2213b7b08457da87caa8aec9b41d6, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:06.668650 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08daf6df-21a4-44eb-a8a3-066b8f6adfe2 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:06.757428 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:06.775326 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc73dbd-a2c2-4337-aa11-4a3cd1ac2882 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:06.777119 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-fcc73dbd-a2c2-4337-aa11-4a3cd1ac2882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:06.793120 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1352/2674] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:32:06 2022] PUT /identity/v3/projects/055a9daa616849278614af86c08c9e4a/users/05a2213b7b08457da87caa8aec9b41d6/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:32:06.803955 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf530e-78e7-4c4e-b736-0f103221d38a None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:06.804361 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf530e-78e7-4c4e-b736-0f103221d38a None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:06.804736 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf530e-78e7-4c4e-b736-0f103221d38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:06.834533 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-31cf530e-78e7-4c4e-b736-0f103221d38a None None] MFA Rules not processed for user `05a2213b7b08457da87caa8aec9b41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:06.836125 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-31cf530e-78e7-4c4e-b736-0f103221d38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:06.842218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc73dbd-a2c2-4337-aa11-4a3cd1ac2882 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:06.902939 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2435569-4965-4380-8e9f-6a04f031883c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:06.904201 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2435569-4965-4380-8e9f-6a04f031883c service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:06.905425 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2435569-4965-4380-8e9f-6a04f031883c service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:06.905425 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2435569-4965-4380-8e9f-6a04f031883c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:06.907051 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-a2435569-4965-4380-8e9f-6a04f031883c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:06.916781 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2435569-4965-4380-8e9f-6a04f031883c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:06.918207 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2435569-4965-4380-8e9f-6a04f031883c service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:06.925499 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1353/2675] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:32:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:32:06.928617 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1323/2676] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:32:06.937051 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf530e-78e7-4c4e-b736-0f103221d38a None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:06.938670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-31cf530e-78e7-4c4e-b736-0f103221d38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:07.015292 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf530e-78e7-4c4e-b736-0f103221d38a None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:07.021434 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4bbec-2de5-40f8-a29f-8954e733cef9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:07.022095 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4bbec-2de5-40f8-a29f-8954e733cef9 service nova] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:07.022380 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4bbec-2de5-40f8-a29f-8954e733cef9 service nova] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:07.022657 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4bbec-2de5-40f8-a29f-8954e733cef9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:07.031276 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac4bbec-2de5-40f8-a29f-8954e733cef9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:07.032883 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac4bbec-2de5-40f8-a29f-8954e733cef9 service nova] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:07.041768 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1354/2677] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:32:08.614459 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2435569-4965-4380-8e9f-6a04f031883c service neutron] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:08.615936 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-a2435569-4965-4380-8e9f-6a04f031883c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:08.683461 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2435569-4965-4380-8e9f-6a04f031883c service neutron] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:08.689175 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ee62f-2f0d-43a9-82c9-5b5671da32c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:08.689802 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ee62f-2f0d-43a9-82c9-5b5671da32c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:08.690079 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ee62f-2f0d-43a9-82c9-5b5671da32c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:08.690361 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ee62f-2f0d-43a9-82c9-5b5671da32c1 admin admin] PATH_INFO: `/v3/users/5d57a03bb5a442d3974dc2545bfa4e66` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:08.691700 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ee62f-2f0d-43a9-82c9-5b5671da32c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d57a03bb5a442d3974dc2545bfa4e66)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:08.693608 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ee62f-2f0d-43a9-82c9-5b5671da32c1 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:08.901364 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:08.913092 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-a62ee62f-2f0d-43a9-82c9-5b5671da32c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d57a03bb5a442d3974dc2545bfa4e66'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:08.990317 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-a62ee62f-2f0d-43a9-82c9-5b5671da32c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d57a03bb5a442d3974dc2545bfa4e66'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:08.991028 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-a62ee62f-2f0d-43a9-82c9-5b5671da32c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d57a03bb5a442d3974dc2545bfa4e66'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:08.991802 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-a62ee62f-2f0d-43a9-82c9-5b5671da32c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d57a03bb5a442d3974dc2545bfa4e66'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:09.005723 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-a62ee62f-2f0d-43a9-82c9-5b5671da32c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d57a03bb5a442d3974dc2545bfa4e66'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:09.017597 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1324/2678] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:32:08 2022] DELETE /identity/v3/users/5d57a03bb5a442d3974dc2545bfa4e66 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:09.021973 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46661596-f6ae-4fa2-88fe-986518b0bcb7 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:09.022468 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46661596-f6ae-4fa2-88fe-986518b0bcb7 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:09.022573 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46661596-f6ae-4fa2-88fe-986518b0bcb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:09.041896 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-46661596-f6ae-4fa2-88fe-986518b0bcb7 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:09.043151 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-46661596-f6ae-4fa2-88fe-986518b0bcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:09.106462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1355/2679] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:32:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:09.118119 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ee62f-2f0d-43a9-82c9-5b5671da32c1 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:09.120232 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-a62ee62f-2f0d-43a9-82c9-5b5671da32c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:09.183835 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ee62f-2f0d-43a9-82c9-5b5671da32c1 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:09.187494 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce221c04-2099-4894-bfb5-a7c3311673bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:09.188096 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce221c04-2099-4894-bfb5-a7c3311673bb service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:09.188377 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce221c04-2099-4894-bfb5-a7c3311673bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:09.188658 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce221c04-2099-4894-bfb5-a7c3311673bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:09.197603 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce221c04-2099-4894-bfb5-a7c3311673bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:09.199014 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce221c04-2099-4894-bfb5-a7c3311673bb service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:09.208317 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1325/2680] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:32:09.221955 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:09.324012 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c071d2c-0ee2-470d-94a3-b3292fddce4c None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:09.324322 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c071d2c-0ee2-470d-94a3-b3292fddce4c None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:09.324601 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c071d2c-0ee2-470d-94a3-b3292fddce4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:09.379467 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-1c071d2c-0ee2-470d-94a3-b3292fddce4c None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:09.380670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-1c071d2c-0ee2-470d-94a3-b3292fddce4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:09.389386 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1356/2681] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Aug 8 02:32:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:09.430557 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce221c04-2099-4894-bfb5-a7c3311673bb service neutron] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:09.432902 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-ce221c04-2099-4894-bfb5-a7c3311673bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:09.508369 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce221c04-2099-4894-bfb5-a7c3311673bb service neutron] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:09.515255 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10bfa5-a39f-4aae-873b-e755c7bf6abf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:09.516542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10bfa5-a39f-4aae-873b-e755c7bf6abf service nova] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:09.516542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10bfa5-a39f-4aae-873b-e755c7bf6abf service nova] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:09.516741 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10bfa5-a39f-4aae-873b-e755c7bf6abf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:09.529093 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10bfa5-a39f-4aae-873b-e755c7bf6abf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:09.530929 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10bfa5-a39f-4aae-873b-e755c7bf6abf service nova] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:09.543895 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1326/2682] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:32:09.670780 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c071d2c-0ee2-470d-94a3-b3292fddce4c None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:09.672330 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-1c071d2c-0ee2-470d-94a3-b3292fddce4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:09.686625 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c071d2c-0ee2-470d-94a3-b3292fddce4c None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:09.692177 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad8b37-b350-4cc1-be62-606dd66075d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:09.692932 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad8b37-b350-4cc1-be62-606dd66075d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:09.693281 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad8b37-b350-4cc1-be62-606dd66075d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:09.693630 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad8b37-b350-4cc1-be62-606dd66075d2 admin admin] PATH_INFO: `/v3/projects/0a1ebc790fb8445d9c9e6f3732637dfa` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:09.694881 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad8b37-b350-4cc1-be62-606dd66075d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a1ebc790fb8445d9c9e6f3732637dfa)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:09.696928 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad8b37-b350-4cc1-be62-606dd66075d2 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:09.821237 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-bdad8b37-b350-4cc1-be62-606dd66075d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a1ebc790fb8445d9c9e6f3732637dfa', 'request_id': 'req-bdad8b37-b350-4cc1-be62-606dd66075d2'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:09.831015 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-bdad8b37-b350-4cc1-be62-606dd66075d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a1ebc790fb8445d9c9e6f3732637dfa', 'request_id': 'req-bdad8b37-b350-4cc1-be62-606dd66075d2'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:09.837597 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-bdad8b37-b350-4cc1-be62-606dd66075d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a1ebc790fb8445d9c9e6f3732637dfa', 'request_id': 'req-bdad8b37-b350-4cc1-be62-606dd66075d2'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:09.956333 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-bdad8b37-b350-4cc1-be62-606dd66075d2 admin admin] The token cache is being invalidate because project 0a1ebc790fb8445d9c9e6f3732637dfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:32:09.956333 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-bdad8b37-b350-4cc1-be62-606dd66075d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:09.956333 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-bdad8b37-b350-4cc1-be62-606dd66075d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:09.957086 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1357/2683] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:32:09 2022] DELETE /identity/v3/projects/0a1ebc790fb8445d9c9e6f3732637dfa => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:09.961472 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10bfa5-a39f-4aae-873b-e755c7bf6abf service nova] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:09.971510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10bfa5-a39f-4aae-873b-e755c7bf6abf service nova] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:10.028754 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9587873e-42a3-4f19-b965-686b2568f434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:10.029370 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587873e-42a3-4f19-b965-686b2568f434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:10.029651 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587873e-42a3-4f19-b965-686b2568f434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:10.029928 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587873e-42a3-4f19-b965-686b2568f434 admin admin] PATH_INFO: `/v3/users/14b2dd5444b5422792cfade0cf773283` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:10.031039 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9587873e-42a3-4f19-b965-686b2568f434 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14b2dd5444b5422792cfade0cf773283)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:10.032964 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9587873e-42a3-4f19-b965-686b2568f434 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:10.284257 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-9587873e-42a3-4f19-b965-686b2568f434 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14b2dd5444b5422792cfade0cf773283'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:10.393138 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-9587873e-42a3-4f19-b965-686b2568f434 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14b2dd5444b5422792cfade0cf773283'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:10.402801 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-9587873e-42a3-4f19-b965-686b2568f434 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14b2dd5444b5422792cfade0cf773283'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:10.402801 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-9587873e-42a3-4f19-b965-686b2568f434 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14b2dd5444b5422792cfade0cf773283'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:10.412495 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:10.421193 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-9587873e-42a3-4f19-b965-686b2568f434 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14b2dd5444b5422792cfade0cf773283'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:10.441897 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1327/2684] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:32:09 2022] DELETE /identity/v3/users/14b2dd5444b5422792cfade0cf773283 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:32:10.928358 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad8b37-b350-4cc1-be62-606dd66075d2 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:10.933357 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-bdad8b37-b350-4cc1-be62-606dd66075d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:10.944398 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad8b37-b350-4cc1-be62-606dd66075d2 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:10.986207 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:11.001902 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef8776-18d0-4169-adb3-1206ee0c7896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:11.002567 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef8776-18d0-4169-adb3-1206ee0c7896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:11.002850 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef8776-18d0-4169-adb3-1206ee0c7896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:11.003122 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef8776-18d0-4169-adb3-1206ee0c7896 admin admin] PATH_INFO: `/v3/projects/57ea5030ed85426d96d07e9744db0a95` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:11.004249 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef8776-18d0-4169-adb3-1206ee0c7896 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57ea5030ed85426d96d07e9744db0a95)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:11.006134 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef8776-18d0-4169-adb3-1206ee0c7896 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:11.145045 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-bcef8776-18d0-4169-adb3-1206ee0c7896 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57ea5030ed85426d96d07e9744db0a95', 'request_id': 'req-bcef8776-18d0-4169-adb3-1206ee0c7896'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:11.150367 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-bcef8776-18d0-4169-adb3-1206ee0c7896 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57ea5030ed85426d96d07e9744db0a95', 'request_id': 'req-bcef8776-18d0-4169-adb3-1206ee0c7896'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:11.157648 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-bcef8776-18d0-4169-adb3-1206ee0c7896 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57ea5030ed85426d96d07e9744db0a95', 'request_id': 'req-bcef8776-18d0-4169-adb3-1206ee0c7896'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:11.292639 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-bcef8776-18d0-4169-adb3-1206ee0c7896 admin admin] The token cache is being invalidate because project 57ea5030ed85426d96d07e9744db0a95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:32:11.293010 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-bcef8776-18d0-4169-adb3-1206ee0c7896 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:11.293559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-bcef8776-18d0-4169-adb3-1206ee0c7896 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:11.295136 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1358/2685] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:32:10 2022] DELETE /identity/v3/projects/57ea5030ed85426d96d07e9744db0a95 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:11.357273 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50deb5-5bf9-40ae-a489-bf3952248574 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:11.357827 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50deb5-5bf9-40ae-a489-bf3952248574 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:11.357827 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50deb5-5bf9-40ae-a489-bf3952248574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:11.378396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-2b50deb5-5bf9-40ae-a489-bf3952248574 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:11.379650 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-2b50deb5-5bf9-40ae-a489-bf3952248574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:11.446058 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1328/2686] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:11.454015 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5c639-9e85-4807-b843-6d6888adbe3e None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:11.454334 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5c639-9e85-4807-b843-6d6888adbe3e None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:11.454614 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5c639-9e85-4807-b843-6d6888adbe3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:11.474377 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-04a5c639-9e85-4807-b843-6d6888adbe3e None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:11.475629 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-04a5c639-9e85-4807-b843-6d6888adbe3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:11.483931 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1359/2687] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:11.488104 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50deb5-5bf9-40ae-a489-bf3952248574 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:11.498268 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50deb5-5bf9-40ae-a489-bf3952248574 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:11.502958 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af6a47-f195-4d68-99a0-d6289182d953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:11.503585 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af6a47-f195-4d68-99a0-d6289182d953 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:11.503873 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af6a47-f195-4d68-99a0-d6289182d953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:11.504153 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af6a47-f195-4d68-99a0-d6289182d953 admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:11.504804 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af6a47-f195-4d68-99a0-d6289182d953 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:32:11.505112 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af6a47-f195-4d68-99a0-d6289182d953 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:11.506712 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af6a47-f195-4d68-99a0-d6289182d953 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:11.522988 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1329/2688] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:32:11.525065 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5c639-9e85-4807-b843-6d6888adbe3e None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:11.535539 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5c639-9e85-4807-b843-6d6888adbe3e None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:11.540314 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09771a27-6966-4043-ae59-88a25d14c65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:11.540927 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09771a27-6966-4043-ae59-88a25d14c65e admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:11.541208 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09771a27-6966-4043-ae59-88a25d14c65e admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:11.541479 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09771a27-6966-4043-ae59-88a25d14c65e admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:11.542104 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09771a27-6966-4043-ae59-88a25d14c65e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:11.544137 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09771a27-6966-4043-ae59-88a25d14c65e admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:11.713795 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1360/2689] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:32:11 2022] POST /identity/v3/projects => generated 375 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:32:11.714974 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af6a47-f195-4d68-99a0-d6289182d953 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:11.725231 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af6a47-f195-4d68-99a0-d6289182d953 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:11.773577 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:11.790704 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0315c3-7696-4663-a9b7-7edb8764f6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:11.791309 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0315c3-7696-4663-a9b7-7edb8764f6c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:11.791803 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0315c3-7696-4663-a9b7-7edb8764f6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:11.792016 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0315c3-7696-4663-a9b7-7edb8764f6c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:11.792521 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0315c3-7696-4663-a9b7-7edb8764f6c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:11.795107 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0315c3-7696-4663-a9b7-7edb8764f6c5 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:11.897195 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1330/2690] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:32:11 2022] POST /identity/v3/users => generated 288 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:32:11.902228 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09771a27-6966-4043-ae59-88a25d14c65e admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:11.913530 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09771a27-6966-4043-ae59-88a25d14c65e admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:11.918158 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caae99f-13c5-49ce-a3b7-91e60f8faed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:11.918934 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caae99f-13c5-49ce-a3b7-91e60f8faed5 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:11.919220 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caae99f-13c5-49ce-a3b7-91e60f8faed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:11.919557 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caae99f-13c5-49ce-a3b7-91e60f8faed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:11.920199 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caae99f-13c5-49ce-a3b7-91e60f8faed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:11.921867 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caae99f-13c5-49ce-a3b7-91e60f8faed5 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:11.932818 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1361/2691] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:32:11.936736 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0315c3-7696-4663-a9b7-7edb8764f6c5 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:11.947266 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0315c3-7696-4663-a9b7-7edb8764f6c5 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:11.953346 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17ab3f-ca30-4273-b0ca-1b0b45a88bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:11.953948 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17ab3f-ca30-4273-b0ca-1b0b45a88bec admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:11.954226 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17ab3f-ca30-4273-b0ca-1b0b45a88bec admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:11.954529 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17ab3f-ca30-4273-b0ca-1b0b45a88bec admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:11.955204 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17ab3f-ca30-4273-b0ca-1b0b45a88bec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:11.956909 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17ab3f-ca30-4273-b0ca-1b0b45a88bec admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:11.968627 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1331/2692] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:32:11.972857 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caae99f-13c5-49ce-a3b7-91e60f8faed5 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:11.983309 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caae99f-13c5-49ce-a3b7-91e60f8faed5 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:11.988144 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc835d2a-7796-4902-9b09-d9d7bd846e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:11.988735 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc835d2a-7796-4902-9b09-d9d7bd846e9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:11.989021 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc835d2a-7796-4902-9b09-d9d7bd846e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:11.989298 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc835d2a-7796-4902-9b09-d9d7bd846e9c admin admin] PATH_INFO: `/v3/projects/8627701b93a64e9db98de2464ce15998/users/91e9c2927fb545e18503294a2abd964d/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:12.005476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc835d2a-7796-4902-9b09-d9d7bd846e9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8627701b93a64e9db98de2464ce15998, user_id=91e9c2927fb545e18503294a2abd964d, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:12.008340 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc835d2a-7796-4902-9b09-d9d7bd846e9c admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:12.097204 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1362/2693] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:32:11 2022] PUT /identity/v3/projects/8627701b93a64e9db98de2464ce15998/users/91e9c2927fb545e18503294a2abd964d/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:12.107769 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c50b7-2ac3-4bc9-b9c6-e898d5631d07 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:12.108057 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c50b7-2ac3-4bc9-b9c6-e898d5631d07 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:12.108355 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c50b7-2ac3-4bc9-b9c6-e898d5631d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:12.136646 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-f55c50b7-2ac3-4bc9-b9c6-e898d5631d07 None None] MFA Rules not processed for user `91e9c2927fb545e18503294a2abd964d`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:12.138453 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-f55c50b7-2ac3-4bc9-b9c6-e898d5631d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:12.207953 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1332/2694] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:32:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:12.212354 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc835d2a-7796-4902-9b09-d9d7bd846e9c admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:12.278833 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc835d2a-7796-4902-9b09-d9d7bd846e9c admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:12.283658 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac126dee-2bc1-411e-8983-2a216487a088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:12.284266 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac126dee-2bc1-411e-8983-2a216487a088 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:12.284547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac126dee-2bc1-411e-8983-2a216487a088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:12.284821 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac126dee-2bc1-411e-8983-2a216487a088 admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:12.285439 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac126dee-2bc1-411e-8983-2a216487a088 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:12.287333 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac126dee-2bc1-411e-8983-2a216487a088 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:12.302474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:12.445312 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1363/2695] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:32:12 2022] POST /identity/v3/projects => generated 375 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:32:12.446472 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c50b7-2ac3-4bc9-b9c6-e898d5631d07 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:12.460650 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c50b7-2ac3-4bc9-b9c6-e898d5631d07 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:12.483570 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bc692-ff82-4388-be8a-53255ed3851e None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:12.484029 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bc692-ff82-4388-be8a-53255ed3851e None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:12.484708 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bc692-ff82-4388-be8a-53255ed3851e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:12.520923 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-451bc692-ff82-4388-be8a-53255ed3851e None None] MFA Rules not processed for user `1d39439278814d4faac4cfb1e71aa4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:12.522211 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-451bc692-ff82-4388-be8a-53255ed3851e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:12.528682 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18cd2e-5318-463d-8a5f-573e81e85695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:12.528999 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18cd2e-5318-463d-8a5f-573e81e85695 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:12.529333 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18cd2e-5318-463d-8a5f-573e81e85695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:12.529734 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18cd2e-5318-463d-8a5f-573e81e85695 admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:12.530483 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18cd2e-5318-463d-8a5f-573e81e85695 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:12.532670 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18cd2e-5318-463d-8a5f-573e81e85695 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:12.579802 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1364/2696] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 8 02:32:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:32:12.595199 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451bc692-ff82-4388-be8a-53255ed3851e None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:12.595199 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-451bc692-ff82-4388-be8a-53255ed3851e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:12.656246 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1333/2697] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:32:12 2022] POST /identity/v3/users => generated 288 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:32:12.660908 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18cd2e-5318-463d-8a5f-573e81e85695 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:12.665283 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451bc692-ff82-4388-be8a-53255ed3851e None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:12.673014 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b7a47-98ec-42ca-8e0f-c1f36f329615 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c212009b6a44e1bad92769630116408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:12.673857 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b7a47-98ec-42ca-8e0f-c1f36f329615 service swift] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:12.674109 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b7a47-98ec-42ca-8e0f-c1f36f329615 service swift] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:12.674327 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18cd2e-5318-463d-8a5f-573e81e85695 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:12.674448 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b7a47-98ec-42ca-8e0f-c1f36f329615 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:12.682345 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae29cf8-910d-4dbf-b256-8d05c8ff1f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:12.683548 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae29cf8-910d-4dbf-b256-8d05c8ff1f3f admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:12.683951 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae29cf8-910d-4dbf-b256-8d05c8ff1f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:12.684075 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3b7a47-98ec-42ca-8e0f-c1f36f329615 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:12.684409 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae29cf8-910d-4dbf-b256-8d05c8ff1f3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:12.686006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae29cf8-910d-4dbf-b256-8d05c8ff1f3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:12.686260 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3b7a47-98ec-42ca-8e0f-c1f36f329615 service swift] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:12.688014 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae29cf8-910d-4dbf-b256-8d05c8ff1f3f admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:12.697352 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1365/2698] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 8 02:32:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 08 02:32:12.704992 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1334/2699] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:32:12.709063 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b7a47-98ec-42ca-8e0f-c1f36f329615 service swift] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:12.721943 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b7a47-98ec-42ca-8e0f-c1f36f329615 service swift] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:12.730528 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f3601-2c34-4fcc-a72d-c12df5b0d0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:12.731161 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f3601-2c34-4fcc-a72d-c12df5b0d0d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:12.732356 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f3601-2c34-4fcc-a72d-c12df5b0d0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:12.732642 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f3601-2c34-4fcc-a72d-c12df5b0d0d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:12.733291 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f3601-2c34-4fcc-a72d-c12df5b0d0d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:12.738641 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f3601-2c34-4fcc-a72d-c12df5b0d0d2 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:12.747089 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1366/2700] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:32:12.752050 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae29cf8-910d-4dbf-b256-8d05c8ff1f3f admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:12.766045 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae29cf8-910d-4dbf-b256-8d05c8ff1f3f admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:12.772753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8795f-e7d2-4d1d-a5eb-ba34b5cd0d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:12.772753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8795f-e7d2-4d1d-a5eb-ba34b5cd0d7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:12.772753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8795f-e7d2-4d1d-a5eb-ba34b5cd0d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:12.772753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8795f-e7d2-4d1d-a5eb-ba34b5cd0d7f admin admin] PATH_INFO: `/v3/projects/73d66c8a07cf40f3bad781dcb118e38e/users/e55da65a5a2c438f8fbec363e0933b5b/roles/5691bce246d6452990f13933e19f2825` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:12.789019 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8795f-e7d2-4d1d-a5eb-ba34b5cd0d7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=73d66c8a07cf40f3bad781dcb118e38e, user_id=e55da65a5a2c438f8fbec363e0933b5b, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:12.791627 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8795f-e7d2-4d1d-a5eb-ba34b5cd0d7f admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:12.937957 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1335/2701] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:32:12 2022] PUT /identity/v3/projects/73d66c8a07cf40f3bad781dcb118e38e/users/e55da65a5a2c438f8fbec363e0933b5b/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:12.956188 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666868f-a325-4ea1-85ce-3509afa0e46e None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:12.956188 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666868f-a325-4ea1-85ce-3509afa0e46e None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:12.956776 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666868f-a325-4ea1-85ce-3509afa0e46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:13.010068 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-9666868f-a325-4ea1-85ce-3509afa0e46e None None] MFA Rules not processed for user `e55da65a5a2c438f8fbec363e0933b5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:13.012887 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-9666868f-a325-4ea1-85ce-3509afa0e46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:13.165322 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1367/2702] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:32:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:13.170405 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8795f-e7d2-4d1d-a5eb-ba34b5cd0d7f admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:13.188811 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:13.327753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8795f-e7d2-4d1d-a5eb-ba34b5cd0d7f admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:13.334467 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074d8ca-5f97-41f1-b4b0-52198ffbc1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:13.335215 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074d8ca-5f97-41f1-b4b0-52198ffbc1cf admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:13.335902 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074d8ca-5f97-41f1-b4b0-52198ffbc1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:13.336226 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074d8ca-5f97-41f1-b4b0-52198ffbc1cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:13.337021 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074d8ca-5f97-41f1-b4b0-52198ffbc1cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:13.343739 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074d8ca-5f97-41f1-b4b0-52198ffbc1cf admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:13.511734 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1336/2703] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:32:13 2022] POST /identity/v3/projects => generated 377 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:32:13.512919 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666868f-a325-4ea1-85ce-3509afa0e46e None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:13.528876 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666868f-a325-4ea1-85ce-3509afa0e46e None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:13.544038 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:13.644194 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e90b81-cb7c-4977-a17b-8d976c972937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:13.644761 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e90b81-cb7c-4977-a17b-8d976c972937 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:13.645050 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e90b81-cb7c-4977-a17b-8d976c972937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:13.645365 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e90b81-cb7c-4977-a17b-8d976c972937 admin admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:13.646023 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e90b81-cb7c-4977-a17b-8d976c972937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:13.648506 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e90b81-cb7c-4977-a17b-8d976c972937 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:13.790041 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1368/2704] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:32:13 2022] POST /identity/v3/users => generated 295 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:32:13.794923 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074d8ca-5f97-41f1-b4b0-52198ffbc1cf admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:13.806952 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074d8ca-5f97-41f1-b4b0-52198ffbc1cf admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:13.812621 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47b015-7b9f-404e-9609-1a44b59d8d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:13.813269 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47b015-7b9f-404e-9609-1a44b59d8d4b admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:13.813557 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47b015-7b9f-404e-9609-1a44b59d8d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:13.813838 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47b015-7b9f-404e-9609-1a44b59d8d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:13.814489 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47b015-7b9f-404e-9609-1a44b59d8d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:13.816131 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47b015-7b9f-404e-9609-1a44b59d8d4b admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:13.823392 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f60197-3f6e-4799-8e99-d446e3f9aaf6 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:13.823757 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f60197-3f6e-4799-8e99-d446e3f9aaf6 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:13.824051 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f60197-3f6e-4799-8e99-d446e3f9aaf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:13.836244 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1337/2705] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:32:13.844625 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47b015-7b9f-404e-9609-1a44b59d8d4b admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:13.845956 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-53f60197-3f6e-4799-8e99-d446e3f9aaf6 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:13.847384 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-53f60197-3f6e-4799-8e99-d446e3f9aaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:13.860317 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1369/2706] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Aug 8 02:32:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:32:13.875947 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f60197-3f6e-4799-8e99-d446e3f9aaf6 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:13.879484 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47b015-7b9f-404e-9609-1a44b59d8d4b admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:13.879771 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-53f60197-3f6e-4799-8e99-d446e3f9aaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:13.884433 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7a052-b7a2-4083-9b56-b074b1f944b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:13.895003 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7a052-b7a2-4083-9b56-b074b1f944b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:13.895003 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7a052-b7a2-4083-9b56-b074b1f944b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:13.895003 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7a052-b7a2-4083-9b56-b074b1f944b0 admin admin] PATH_INFO: `/v3/projects/8060efdd352842658b8e65c74f9251fc/users/87b893573a0a409e962f511871eed628/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:13.952198 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7a052-b7a2-4083-9b56-b074b1f944b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8060efdd352842658b8e65c74f9251fc, user_id=87b893573a0a409e962f511871eed628, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:13.952198 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7a052-b7a2-4083-9b56-b074b1f944b0 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:13.968862 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f60197-3f6e-4799-8e99-d446e3f9aaf6 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:13.983493 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422e0ae-d5ae-4a0a-8987-279b938c7a9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:13.984126 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422e0ae-d5ae-4a0a-8987-279b938c7a9f service nova] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:13.984647 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422e0ae-d5ae-4a0a-8987-279b938c7a9f service nova] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:13.985145 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422e0ae-d5ae-4a0a-8987-279b938c7a9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:14.001698 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422e0ae-d5ae-4a0a-8987-279b938c7a9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:14.003766 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422e0ae-d5ae-4a0a-8987-279b938c7a9f service nova] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:14.016328 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1370/2707] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:32:14.067216 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1338/2708] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:32:13 2022] PUT /identity/v3/projects/8060efdd352842658b8e65c74f9251fc/users/87b893573a0a409e962f511871eed628/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:14.072948 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422e0ae-d5ae-4a0a-8987-279b938c7a9f service nova] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:14.096034 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422e0ae-d5ae-4a0a-8987-279b938c7a9f service nova] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:14.205673 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1bd47-df8f-42df-8c7e-7d91c2990a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:14.207123 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1bd47-df8f-42df-8c7e-7d91c2990a73 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:14.207588 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1bd47-df8f-42df-8c7e-7d91c2990a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:14.208227 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1bd47-df8f-42df-8c7e-7d91c2990a73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:14.209291 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1bd47-df8f-42df-8c7e-7d91c2990a73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:14.211596 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1bd47-df8f-42df-8c7e-7d91c2990a73 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:14.228192 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1371/2709] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:32:14.236443 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7a052-b7a2-4083-9b56-b074b1f944b0 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:14.249247 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7a052-b7a2-4083-9b56-b074b1f944b0 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:14.284962 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3545e-21e0-4305-b30c-7358f2d5e6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:14.284962 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3545e-21e0-4305-b30c-7358f2d5e6ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:14.284962 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3545e-21e0-4305-b30c-7358f2d5e6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:14.284962 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3545e-21e0-4305-b30c-7358f2d5e6ff admin admin] PATH_INFO: `/v3/projects/8060efdd352842658b8e65c74f9251fc/users/87b893573a0a409e962f511871eed628/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:14.286412 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df3545e-21e0-4305-b30c-7358f2d5e6ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=8060efdd352842658b8e65c74f9251fc, user_id=87b893573a0a409e962f511871eed628, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:14.286412 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df3545e-21e0-4305-b30c-7358f2d5e6ff admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:14.299405 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1339/2710] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:32:14 2022] PUT /identity/v3/projects/8060efdd352842658b8e65c74f9251fc/users/87b893573a0a409e962f511871eed628/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:14.315800 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0f661-e2e5-4df9-b2b9-7ea1b486e1f4 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:14.316195 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0f661-e2e5-4df9-b2b9-7ea1b486e1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:14.316422 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0f661-e2e5-4df9-b2b9-7ea1b486e1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:14.343867 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:14.355604 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-67a0f661-e2e5-4df9-b2b9-7ea1b486e1f4 None None] MFA Rules not processed for user `87b893573a0a409e962f511871eed628`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:14.358488 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-67a0f661-e2e5-4df9-b2b9-7ea1b486e1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:14.434310 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3545e-21e0-4305-b30c-7358f2d5e6ff admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:14.439083 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-5df3545e-21e0-4305-b30c-7358f2d5e6ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:14.485310 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1372/2711] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:32:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:14.506284 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0f661-e2e5-4df9-b2b9-7ea1b486e1f4 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:14.513357 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-67a0f661-e2e5-4df9-b2b9-7ea1b486e1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:14.553690 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3545e-21e0-4305-b30c-7358f2d5e6ff admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:14.580297 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21baf230-3d50-4639-b938-5dc6376fb535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:14.581145 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21baf230-3d50-4639-b938-5dc6376fb535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:14.583551 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21baf230-3d50-4639-b938-5dc6376fb535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:14.583866 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21baf230-3d50-4639-b938-5dc6376fb535 admin admin] PATH_INFO: `/v3/users/05a2213b7b08457da87caa8aec9b41d6` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:14.586921 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21baf230-3d50-4639-b938-5dc6376fb535 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05a2213b7b08457da87caa8aec9b41d6)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:14.597111 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21baf230-3d50-4639-b938-5dc6376fb535 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:14.629340 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0f661-e2e5-4df9-b2b9-7ea1b486e1f4 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:14.646349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f37a02-1a0f-4c6b-9a59-f0b849888029 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:14.647159 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f37a02-1a0f-4c6b-9a59-f0b849888029 service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:14.647478 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f37a02-1a0f-4c6b-9a59-f0b849888029 service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:14.647775 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f37a02-1a0f-4c6b-9a59-f0b849888029 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:14.733795 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f37a02-1a0f-4c6b-9a59-f0b849888029 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:14.735128 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f37a02-1a0f-4c6b-9a59-f0b849888029 service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:14.744213 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1373/2712] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:32:14.886589 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:14.889449 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-21baf230-3d50-4639-b938-5dc6376fb535 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05a2213b7b08457da87caa8aec9b41d6'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:15.062181 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-21baf230-3d50-4639-b938-5dc6376fb535 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05a2213b7b08457da87caa8aec9b41d6'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:15.067836 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-21baf230-3d50-4639-b938-5dc6376fb535 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05a2213b7b08457da87caa8aec9b41d6'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:15.071688 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-21baf230-3d50-4639-b938-5dc6376fb535 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05a2213b7b08457da87caa8aec9b41d6'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:15.097322 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-21baf230-3d50-4639-b938-5dc6376fb535 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05a2213b7b08457da87caa8aec9b41d6'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:15.113735 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1340/2713] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:32:14 2022] DELETE /identity/v3/users/05a2213b7b08457da87caa8aec9b41d6 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:15.118709 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30dab82-6f77-4552-8bdf-a6340ca37f8b None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:15.119584 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30dab82-6f77-4552-8bdf-a6340ca37f8b None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:15.120024 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30dab82-6f77-4552-8bdf-a6340ca37f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:15.153844 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-a30dab82-6f77-4552-8bdf-a6340ca37f8b None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:15.155875 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-a30dab82-6f77-4552-8bdf-a6340ca37f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:15.228674 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:15.247834 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1374/2714] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:32:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:15.257856 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21baf230-3d50-4639-b938-5dc6376fb535 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:15.259695 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-21baf230-3d50-4639-b938-5dc6376fb535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:15.365040 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21baf230-3d50-4639-b938-5dc6376fb535 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:15.372548 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb79d09-da38-4c56-b924-6e8a32ed58a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:15.373717 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb79d09-da38-4c56-b924-6e8a32ed58a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:15.377213 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb79d09-da38-4c56-b924-6e8a32ed58a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:15.377213 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb79d09-da38-4c56-b924-6e8a32ed58a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:15.408891 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb79d09-da38-4c56-b924-6e8a32ed58a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:15.410566 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb79d09-da38-4c56-b924-6e8a32ed58a4 service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:15.421671 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1341/2715] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:32:15.878855 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30dab82-6f77-4552-8bdf-a6340ca37f8b None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:15.880491 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-a30dab82-6f77-4552-8bdf-a6340ca37f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:15.894806 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30dab82-6f77-4552-8bdf-a6340ca37f8b None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:15.900439 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209297d9-184b-42dd-a16c-8d3406d85dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:15.905670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209297d9-184b-42dd-a16c-8d3406d85dd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:15.906085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209297d9-184b-42dd-a16c-8d3406d85dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:15.906513 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209297d9-184b-42dd-a16c-8d3406d85dd1 admin admin] PATH_INFO: `/v3/projects/055a9daa616849278614af86c08c9e4a` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:15.908084 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209297d9-184b-42dd-a16c-8d3406d85dd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=055a9daa616849278614af86c08c9e4a)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:15.910368 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209297d9-184b-42dd-a16c-8d3406d85dd1 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:16.025384 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-209297d9-184b-42dd-a16c-8d3406d85dd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '055a9daa616849278614af86c08c9e4a', 'request_id': 'req-209297d9-184b-42dd-a16c-8d3406d85dd1'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:16.031082 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-209297d9-184b-42dd-a16c-8d3406d85dd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '055a9daa616849278614af86c08c9e4a', 'request_id': 'req-209297d9-184b-42dd-a16c-8d3406d85dd1'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:16.040064 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-209297d9-184b-42dd-a16c-8d3406d85dd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '055a9daa616849278614af86c08c9e4a', 'request_id': 'req-209297d9-184b-42dd-a16c-8d3406d85dd1'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:16.132014 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-209297d9-184b-42dd-a16c-8d3406d85dd1 admin admin] The token cache is being invalidate because project 055a9daa616849278614af86c08c9e4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:32:16.132964 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-209297d9-184b-42dd-a16c-8d3406d85dd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:16.133955 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-209297d9-184b-42dd-a16c-8d3406d85dd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:16.137476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1375/2716] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:32:15 2022] DELETE /identity/v3/projects/055a9daa616849278614af86c08c9e4a => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:16.142716 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f476551-2ea2-4bac-9dd5-5192e93e519a None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:16.143275 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f476551-2ea2-4bac-9dd5-5192e93e519a None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:16.143275 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f476551-2ea2-4bac-9dd5-5192e93e519a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:16.164118 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-8f476551-2ea2-4bac-9dd5-5192e93e519a None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:16.165379 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-8f476551-2ea2-4bac-9dd5-5192e93e519a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:16.253748 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1342/2717] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:32:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:16.267921 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a29c6-41b4-400e-be8d-cfa8eabe4c54 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:16.268269 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a29c6-41b4-400e-be8d-cfa8eabe4c54 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:16.268534 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a29c6-41b4-400e-be8d-cfa8eabe4c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:16.292446 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-e70a29c6-41b4-400e-be8d-cfa8eabe4c54 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:16.294296 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-e70a29c6-41b4-400e-be8d-cfa8eabe4c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:16.302899 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1376/2718] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:32:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:16.306870 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f476551-2ea2-4bac-9dd5-5192e93e519a None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:16.322356 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f476551-2ea2-4bac-9dd5-5192e93e519a None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:16.327397 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63ab26-6a16-46ae-be41-07b7d4f04a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:16.328009 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63ab26-6a16-46ae-be41-07b7d4f04a7c admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:16.328293 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63ab26-6a16-46ae-be41-07b7d4f04a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:16.328575 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63ab26-6a16-46ae-be41-07b7d4f04a7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:16.329236 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63ab26-6a16-46ae-be41-07b7d4f04a7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:32:16.329544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63ab26-6a16-46ae-be41-07b7d4f04a7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:16.331153 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63ab26-6a16-46ae-be41-07b7d4f04a7c admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:16.344729 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1343/2719] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:32:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:32:16.349634 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a29c6-41b4-400e-be8d-cfa8eabe4c54 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:16.362670 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a29c6-41b4-400e-be8d-cfa8eabe4c54 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:16.367802 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a7cd5-bf19-4f98-bc60-fdead4996201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:16.368458 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a7cd5-bf19-4f98-bc60-fdead4996201 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:16.368756 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a7cd5-bf19-4f98-bc60-fdead4996201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:16.369032 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a7cd5-bf19-4f98-bc60-fdead4996201 admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:16.369654 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a7cd5-bf19-4f98-bc60-fdead4996201 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:16.371700 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a7cd5-bf19-4f98-bc60-fdead4996201 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:16.566810 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1377/2720] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:32:16 2022] POST /identity/v3/projects => generated 393 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:32:16.570997 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63ab26-6a16-46ae-be41-07b7d4f04a7c admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:16.593522 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63ab26-6a16-46ae-be41-07b7d4f04a7c admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:16.687165 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:16.703234 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0059d36-4297-4bb5-b06d-eea7ddacd8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:16.703467 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0059d36-4297-4bb5-b06d-eea7ddacd8ec admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:16.703705 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0059d36-4297-4bb5-b06d-eea7ddacd8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:16.704012 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0059d36-4297-4bb5-b06d-eea7ddacd8ec admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:16.704639 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0059d36-4297-4bb5-b06d-eea7ddacd8ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:16.706697 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0059d36-4297-4bb5-b06d-eea7ddacd8ec admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:16.849646 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1344/2721] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:32:16 2022] POST /identity/v3/users => generated 297 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:32:16.853474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a7cd5-bf19-4f98-bc60-fdead4996201 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:16.865885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a7cd5-bf19-4f98-bc60-fdead4996201 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:16.870625 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e807af8-63ba-4ee2-a478-7be25ad22a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:16.871433 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e807af8-63ba-4ee2-a478-7be25ad22a27 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:16.871817 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e807af8-63ba-4ee2-a478-7be25ad22a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:16.872202 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e807af8-63ba-4ee2-a478-7be25ad22a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:16.872943 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e807af8-63ba-4ee2-a478-7be25ad22a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:16.874644 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e807af8-63ba-4ee2-a478-7be25ad22a27 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:16.886704 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1378/2722] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:32:16.891949 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0059d36-4297-4bb5-b06d-eea7ddacd8ec admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:16.905511 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0059d36-4297-4bb5-b06d-eea7ddacd8ec admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:16.910447 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d11b7e-2456-4f8d-8ee2-cac412efcdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:16.911062 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d11b7e-2456-4f8d-8ee2-cac412efcdbe admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:16.911603 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d11b7e-2456-4f8d-8ee2-cac412efcdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:16.911718 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d11b7e-2456-4f8d-8ee2-cac412efcdbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:16.912322 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d11b7e-2456-4f8d-8ee2-cac412efcdbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:16.914622 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d11b7e-2456-4f8d-8ee2-cac412efcdbe admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:16.929790 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1345/2723] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:32:16.940115 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e807af8-63ba-4ee2-a478-7be25ad22a27 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:16.949036 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d11b7e-2456-4f8d-8ee2-cac412efcdbe admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:16.951164 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e807af8-63ba-4ee2-a478-7be25ad22a27 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:16.951301 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-d4d11b7e-2456-4f8d-8ee2-cac412efcdbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:16.955830 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65a825-aefe-4685-9828-fcfd7d59a6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:16.956488 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65a825-aefe-4685-9828-fcfd7d59a6a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:16.956774 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65a825-aefe-4685-9828-fcfd7d59a6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:16.957059 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65a825-aefe-4685-9828-fcfd7d59a6a8 admin admin] PATH_INFO: `/v3/projects/9123c3d2eda44847a8d9f5b71bf3fd85/users/8816dbb6ceeb4116954290252737c770/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:16.975041 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b65a825-aefe-4685-9828-fcfd7d59a6a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9123c3d2eda44847a8d9f5b71bf3fd85, user_id=8816dbb6ceeb4116954290252737c770, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:16.978383 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b65a825-aefe-4685-9828-fcfd7d59a6a8 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:17.026776 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d11b7e-2456-4f8d-8ee2-cac412efcdbe admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:17.031204 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be18f3-68c3-4eef-be7d-21769a842425 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:17.031843 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be18f3-68c3-4eef-be7d-21769a842425 service cinder] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:17.032124 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be18f3-68c3-4eef-be7d-21769a842425 service cinder] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:17.032404 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be18f3-68c3-4eef-be7d-21769a842425 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:17.034184 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-83be18f3-68c3-4eef-be7d-21769a842425 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:17.054970 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1379/2724] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:32:16 2022] PUT /identity/v3/projects/9123c3d2eda44847a8d9f5b71bf3fd85/users/8816dbb6ceeb4116954290252737c770/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:17.067079 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d3f33-51bc-44ce-ac9a-a8921ddd6817 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:17.067400 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d3f33-51bc-44ce-ac9a-a8921ddd6817 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:17.067696 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d3f33-51bc-44ce-ac9a-a8921ddd6817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:17.105517 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-9e7d3f33-51bc-44ce-ac9a-a8921ddd6817 None None] MFA Rules not processed for user `8816dbb6ceeb4116954290252737c770`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:17.106874 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-9e7d3f33-51bc-44ce-ac9a-a8921ddd6817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:17.119047 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83be18f3-68c3-4eef-be7d-21769a842425 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:17.121338 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83be18f3-68c3-4eef-be7d-21769a842425 service cinder] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:17.144055 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1346/2725] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:32:17.183936 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:17.188431 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1380/2726] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:32:17 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:32:17.192648 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be18f3-68c3-4eef-be7d-21769a842425 service cinder] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:17.206045 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be18f3-68c3-4eef-be7d-21769a842425 service cinder] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:17.313346 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169cf2d4-56c1-4839-a6e8-e15fa0d5f007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:17.313981 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cf2d4-56c1-4839-a6e8-e15fa0d5f007 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:17.314259 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cf2d4-56c1-4839-a6e8-e15fa0d5f007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:17.314534 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cf2d4-56c1-4839-a6e8-e15fa0d5f007 admin admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:17.315158 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169cf2d4-56c1-4839-a6e8-e15fa0d5f007 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:17.317296 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169cf2d4-56c1-4839-a6e8-e15fa0d5f007 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:17.469672 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1347/2727] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:32:17 2022] POST /identity/v3/projects => generated 391 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:32:17.480232 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d3f33-51bc-44ce-ac9a-a8921ddd6817 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:17.488252 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d3f33-51bc-44ce-ac9a-a8921ddd6817 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:17.549779 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e823f2-b6d0-45eb-9ebe-60b580e260cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:17.550539 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e823f2-b6d0-45eb-9ebe-60b580e260cb admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:17.550892 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e823f2-b6d0-45eb-9ebe-60b580e260cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:17.551260 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e823f2-b6d0-45eb-9ebe-60b580e260cb admin admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:17.552003 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e823f2-b6d0-45eb-9ebe-60b580e260cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:17.554002 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e823f2-b6d0-45eb-9ebe-60b580e260cb admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:17.683787 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1381/2728] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:32:17 2022] POST /identity/v3/users => generated 302 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:32:17.687596 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169cf2d4-56c1-4839-a6e8-e15fa0d5f007 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:17.698213 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169cf2d4-56c1-4839-a6e8-e15fa0d5f007 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:17.703250 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca6770-fdaf-43fa-9d99-0d3cc2d8455d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:17.703882 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca6770-fdaf-43fa-9d99-0d3cc2d8455d admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:17.704168 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca6770-fdaf-43fa-9d99-0d3cc2d8455d admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:17.704447 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca6770-fdaf-43fa-9d99-0d3cc2d8455d admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:17.705090 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca6770-fdaf-43fa-9d99-0d3cc2d8455d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:17.706670 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca6770-fdaf-43fa-9d99-0d3cc2d8455d admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:17.712046 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:17.719574 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1348/2729] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:32:17.729225 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e823f2-b6d0-45eb-9ebe-60b580e260cb admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:17.740109 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e823f2-b6d0-45eb-9ebe-60b580e260cb admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:17.753239 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008b087-92c2-43fe-87ad-808cb2c6c415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:17.756641 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008b087-92c2-43fe-87ad-808cb2c6c415 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:17.756641 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008b087-92c2-43fe-87ad-808cb2c6c415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:17.759745 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008b087-92c2-43fe-87ad-808cb2c6c415 admin admin] PATH_INFO: `/v3/projects/60de2c9fa291456cb2280963d17b446b/users/8a523b41aa5a4e14be3c0d282ca9da18/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:17.773262 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4008b087-92c2-43fe-87ad-808cb2c6c415 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60de2c9fa291456cb2280963d17b446b, user_id=8a523b41aa5a4e14be3c0d282ca9da18, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:17.776095 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4008b087-92c2-43fe-87ad-808cb2c6c415 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:17.930063 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1382/2730] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:32:17 2022] PUT /identity/v3/projects/60de2c9fa291456cb2280963d17b446b/users/8a523b41aa5a4e14be3c0d282ca9da18/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:17.931299 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca6770-fdaf-43fa-9d99-0d3cc2d8455d admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:17.943327 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca6770-fdaf-43fa-9d99-0d3cc2d8455d admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:18.008827 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73922719-73cc-440c-81d7-b7ec666f7eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:18.009644 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73922719-73cc-440c-81d7-b7ec666f7eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:18.010028 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73922719-73cc-440c-81d7-b7ec666f7eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:18.010402 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73922719-73cc-440c-81d7-b7ec666f7eb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:18.011253 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73922719-73cc-440c-81d7-b7ec666f7eb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:18.014125 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73922719-73cc-440c-81d7-b7ec666f7eb7 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:18.030365 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1349/2731] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:32:18.031759 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008b087-92c2-43fe-87ad-808cb2c6c415 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:18.043811 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008b087-92c2-43fe-87ad-808cb2c6c415 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:18.048574 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f731a-96e6-4e96-b405-467ccb246e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:18.049220 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f731a-96e6-4e96-b405-467ccb246e5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:18.049498 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f731a-96e6-4e96-b405-467ccb246e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:18.053826 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f731a-96e6-4e96-b405-467ccb246e5b admin admin] PATH_INFO: `/v3/projects/60de2c9fa291456cb2280963d17b446b/users/8a523b41aa5a4e14be3c0d282ca9da18/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:18.053826 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f731a-96e6-4e96-b405-467ccb246e5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=60de2c9fa291456cb2280963d17b446b, user_id=8a523b41aa5a4e14be3c0d282ca9da18, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:18.054678 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f731a-96e6-4e96-b405-467ccb246e5b admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:18.067079 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1383/2732] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:32:18 2022] PUT /identity/v3/projects/60de2c9fa291456cb2280963d17b446b/users/8a523b41aa5a4e14be3c0d282ca9da18/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:18.077929 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee13fe-668d-4084-9ec7-011eccbba83d None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:18.082621 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee13fe-668d-4084-9ec7-011eccbba83d None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:18.082621 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee13fe-668d-4084-9ec7-011eccbba83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:18.112114 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-05ee13fe-668d-4084-9ec7-011eccbba83d None None] MFA Rules not processed for user `8a523b41aa5a4e14be3c0d282ca9da18`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:18.113343 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-05ee13fe-668d-4084-9ec7-011eccbba83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:18.200645 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1350/2733] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:32:18 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:18.212672 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f731a-96e6-4e96-b405-467ccb246e5b admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:18.215250 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-f60f731a-96e6-4e96-b405-467ccb246e5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:18.300528 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f731a-96e6-4e96-b405-467ccb246e5b admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:18.304910 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c44671-8df5-4e6a-af55-2d2bb7f1af08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:18.305689 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c44671-8df5-4e6a-af55-2d2bb7f1af08 service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:18.305979 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c44671-8df5-4e6a-af55-2d2bb7f1af08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:18.306259 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c44671-8df5-4e6a-af55-2d2bb7f1af08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:18.317803 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c44671-8df5-4e6a-af55-2d2bb7f1af08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:18.319514 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c44671-8df5-4e6a-af55-2d2bb7f1af08 service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:18.331204 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1384/2734] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:18 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:32:18.408471 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee13fe-668d-4084-9ec7-011eccbba83d None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:18.426057 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee13fe-668d-4084-9ec7-011eccbba83d None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:18.431434 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808d2e0-7295-4e52-9399-84cb503e4540 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:18.432050 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808d2e0-7295-4e52-9399-84cb503e4540 service cinder] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:18.432333 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808d2e0-7295-4e52-9399-84cb503e4540 service cinder] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:18.432607 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808d2e0-7295-4e52-9399-84cb503e4540 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:18.540772 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c808d2e0-7295-4e52-9399-84cb503e4540 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:18.541028 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c808d2e0-7295-4e52-9399-84cb503e4540 service cinder] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:18.553183 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1351/2735] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:18 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:32:18.902101 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c44671-8df5-4e6a-af55-2d2bb7f1af08 service cinder] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:18.911123 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c44671-8df5-4e6a-af55-2d2bb7f1af08 service cinder] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:18.915320 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c0ad6-70f9-4764-b15e-13c4c01b05ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:18.916034 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c0ad6-70f9-4764-b15e-13c4c01b05ae service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:18.916312 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c0ad6-70f9-4764-b15e-13c4c01b05ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:18.916658 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c0ad6-70f9-4764-b15e-13c4c01b05ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:18.918455 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-b73c0ad6-70f9-4764-b15e-13c4c01b05ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:18.992671 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:19.007851 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c0ad6-70f9-4764-b15e-13c4c01b05ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:19.009627 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c0ad6-70f9-4764-b15e-13c4c01b05ae service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:19.022159 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1385/2736] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:32:24.773535 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf121e0-a64a-476a-a84d-a17388e4d2dc None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:24.774199 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf121e0-a64a-476a-a84d-a17388e4d2dc None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:24.774199 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf121e0-a64a-476a-a84d-a17388e4d2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:24.797888 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-2cf121e0-a64a-476a-a84d-a17388e4d2dc None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:24.801545 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-2cf121e0-a64a-476a-a84d-a17388e4d2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:24.816134 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:24.866743 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1352/2737] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Aug 8 02:32:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:24.886274 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c0ad6-70f9-4764-b15e-13c4c01b05ae service cinder] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:24.887935 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-b73c0ad6-70f9-4764-b15e-13c4c01b05ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:24.967007 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c0ad6-70f9-4764-b15e-13c4c01b05ae service cinder] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:24.973197 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e16663-5288-4e42-8740-b71174e8db23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:24.973808 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e16663-5288-4e42-8740-b71174e8db23 service nova] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:24.974088 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e16663-5288-4e42-8740-b71174e8db23 service nova] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:24.974365 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e16663-5288-4e42-8740-b71174e8db23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:24.983112 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e16663-5288-4e42-8740-b71174e8db23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:24.984739 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e16663-5288-4e42-8740-b71174e8db23 service nova] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:24.994923 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1386/2738] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:32:25.242353 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf121e0-a64a-476a-a84d-a17388e4d2dc None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:25.254038 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf121e0-a64a-476a-a84d-a17388e4d2dc None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:25.259595 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86b2e3-df7e-426c-bdcd-ac897d9ce98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:25.260287 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86b2e3-df7e-426c-bdcd-ac897d9ce98e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:25.260566 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86b2e3-df7e-426c-bdcd-ac897d9ce98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:25.260841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86b2e3-df7e-426c-bdcd-ac897d9ce98e admin admin] PATH_INFO: `/v3/users/8816dbb6ceeb4116954290252737c770` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:25.262074 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86b2e3-df7e-426c-bdcd-ac897d9ce98e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8816dbb6ceeb4116954290252737c770)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:25.264771 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86b2e3-df7e-426c-bdcd-ac897d9ce98e admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:25.339197 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e16663-5288-4e42-8740-b71174e8db23 service nova] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:25.340658 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-b5e16663-5288-4e42-8740-b71174e8db23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:25.353342 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e16663-5288-4e42-8740-b71174e8db23 service nova] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:25.357897 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e5f178-c83f-4be7-924b-b8044e4ac1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:25.358520 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e5f178-c83f-4be7-924b-b8044e4ac1b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:25.358808 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e5f178-c83f-4be7-924b-b8044e4ac1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:25.359083 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e5f178-c83f-4be7-924b-b8044e4ac1b0 admin admin] PATH_INFO: `/v3/users/91e9c2927fb545e18503294a2abd964d` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:25.360223 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e5f178-c83f-4be7-924b-b8044e4ac1b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91e9c2927fb545e18503294a2abd964d)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:25.362126 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e5f178-c83f-4be7-924b-b8044e4ac1b0 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:25.465182 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-ca86b2e3-df7e-426c-bdcd-ac897d9ce98e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8816dbb6ceeb4116954290252737c770'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:25.534851 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c4e5f178-c83f-4be7-924b-b8044e4ac1b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91e9c2927fb545e18503294a2abd964d'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:25.555609 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-ca86b2e3-df7e-426c-bdcd-ac897d9ce98e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8816dbb6ceeb4116954290252737c770'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:25.556228 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-ca86b2e3-df7e-426c-bdcd-ac897d9ce98e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8816dbb6ceeb4116954290252737c770'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:25.556832 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-ca86b2e3-df7e-426c-bdcd-ac897d9ce98e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8816dbb6ceeb4116954290252737c770'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:25.569433 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-ca86b2e3-df7e-426c-bdcd-ac897d9ce98e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8816dbb6ceeb4116954290252737c770'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:25.581757 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1353/2739] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:32:25 2022] DELETE /identity/v3/users/8816dbb6ceeb4116954290252737c770 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:25.586086 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff2191-7bb1-403f-b6d0-2257e493623a None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:25.586367 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff2191-7bb1-403f-b6d0-2257e493623a None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:25.586640 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff2191-7bb1-403f-b6d0-2257e493623a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:25.605199 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-24ff2191-7bb1-403f-b6d0-2257e493623a None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:25.606499 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-24ff2191-7bb1-403f-b6d0-2257e493623a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:25.666029 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1354/2740] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:32:25.676811 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff2191-7bb1-403f-b6d0-2257e493623a None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:25.678209 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-24ff2191-7bb1-403f-b6d0-2257e493623a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:25.698720 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c4e5f178-c83f-4be7-924b-b8044e4ac1b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91e9c2927fb545e18503294a2abd964d'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:25.699523 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c4e5f178-c83f-4be7-924b-b8044e4ac1b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91e9c2927fb545e18503294a2abd964d'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:25.712314 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c4e5f178-c83f-4be7-924b-b8044e4ac1b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91e9c2927fb545e18503294a2abd964d'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:25.713957 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:25.719503 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c4e5f178-c83f-4be7-924b-b8044e4ac1b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91e9c2927fb545e18503294a2abd964d'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:25.725447 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1387/2741] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:32:25 2022] DELETE /identity/v3/users/91e9c2927fb545e18503294a2abd964d => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:32:25.729806 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6e7c5-1920-47a4-973d-412e87014838 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:25.730097 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6e7c5-1920-47a4-973d-412e87014838 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:25.730377 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6e7c5-1920-47a4-973d-412e87014838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:25.736614 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff2191-7bb1-403f-b6d0-2257e493623a None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:25.749862 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-37b6e7c5-1920-47a4-973d-412e87014838 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:25.755313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-37b6e7c5-1920-47a4-973d-412e87014838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:25.812588 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0da0a-9d2a-4ee1-880c-729739d0e629 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:25.812588 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0da0a-9d2a-4ee1-880c-729739d0e629 service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:25.812588 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0da0a-9d2a-4ee1-880c-729739d0e629 service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:25.812588 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0da0a-9d2a-4ee1-880c-729739d0e629 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:25.813883 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-d6d0da0a-9d2a-4ee1-880c-729739d0e629 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:25.813997 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:25.816576 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1388/2742] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:32:25.826689 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6e7c5-1920-47a4-973d-412e87014838 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:25.828382 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-37b6e7c5-1920-47a4-973d-412e87014838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:25.842155 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6e7c5-1920-47a4-973d-412e87014838 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:25.846251 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2002b2-b765-4b82-8b79-447e200be1dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:25.846991 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2002b2-b765-4b82-8b79-447e200be1dc service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:25.847456 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2002b2-b765-4b82-8b79-447e200be1dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:25.847843 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2002b2-b765-4b82-8b79-447e200be1dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:25.864381 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2002b2-b765-4b82-8b79-447e200be1dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:25.864381 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2002b2-b765-4b82-8b79-447e200be1dc service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:25.870683 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1389/2743] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:32:25.874990 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d0da0a-9d2a-4ee1-880c-729739d0e629 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:25.876474 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d0da0a-9d2a-4ee1-880c-729739d0e629 service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:25.886627 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1355/2744] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:32:26.364460 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2002b2-b765-4b82-8b79-447e200be1dc service neutron] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:26.364460 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-8e2002b2-b765-4b82-8b79-447e200be1dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:26.371812 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2002b2-b765-4b82-8b79-447e200be1dc service neutron] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:26.376512 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07d458-25ea-4cf9-a43e-95ec85f2ce87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:26.377145 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07d458-25ea-4cf9-a43e-95ec85f2ce87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:26.377434 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07d458-25ea-4cf9-a43e-95ec85f2ce87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:26.377872 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07d458-25ea-4cf9-a43e-95ec85f2ce87 admin admin] PATH_INFO: `/v3/projects/9123c3d2eda44847a8d9f5b71bf3fd85` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:26.392316 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d07d458-25ea-4cf9-a43e-95ec85f2ce87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9123c3d2eda44847a8d9f5b71bf3fd85)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:26.392316 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d07d458-25ea-4cf9-a43e-95ec85f2ce87 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:26.393226 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0da0a-9d2a-4ee1-880c-729739d0e629 service neutron] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:26.394574 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-d6d0da0a-9d2a-4ee1-880c-729739d0e629 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:26.415094 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0da0a-9d2a-4ee1-880c-729739d0e629 service neutron] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:26.421551 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f390b-bdb6-4fdf-92cd-de3ca213c984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:26.424017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f390b-bdb6-4fdf-92cd-de3ca213c984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:26.424017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f390b-bdb6-4fdf-92cd-de3ca213c984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:26.424017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f390b-bdb6-4fdf-92cd-de3ca213c984 admin admin] PATH_INFO: `/v3/projects/8627701b93a64e9db98de2464ce15998` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:26.424017 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f390b-bdb6-4fdf-92cd-de3ca213c984 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8627701b93a64e9db98de2464ce15998)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:26.425873 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f390b-bdb6-4fdf-92cd-de3ca213c984 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:26.544720 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-5d07d458-25ea-4cf9-a43e-95ec85f2ce87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9123c3d2eda44847a8d9f5b71bf3fd85', 'request_id': 'req-5d07d458-25ea-4cf9-a43e-95ec85f2ce87'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:26.550248 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-5d07d458-25ea-4cf9-a43e-95ec85f2ce87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9123c3d2eda44847a8d9f5b71bf3fd85', 'request_id': 'req-5d07d458-25ea-4cf9-a43e-95ec85f2ce87'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:26.556353 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-5d07d458-25ea-4cf9-a43e-95ec85f2ce87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9123c3d2eda44847a8d9f5b71bf3fd85', 'request_id': 'req-5d07d458-25ea-4cf9-a43e-95ec85f2ce87'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:26.585153 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-001f390b-bdb6-4fdf-92cd-de3ca213c984 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8627701b93a64e9db98de2464ce15998', 'request_id': 'req-001f390b-bdb6-4fdf-92cd-de3ca213c984'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:26.594128 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-001f390b-bdb6-4fdf-92cd-de3ca213c984 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8627701b93a64e9db98de2464ce15998', 'request_id': 'req-001f390b-bdb6-4fdf-92cd-de3ca213c984'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:26.600568 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-001f390b-bdb6-4fdf-92cd-de3ca213c984 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8627701b93a64e9db98de2464ce15998', 'request_id': 'req-001f390b-bdb6-4fdf-92cd-de3ca213c984'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:26.644308 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-5d07d458-25ea-4cf9-a43e-95ec85f2ce87 admin admin] The token cache is being invalidate because project 9123c3d2eda44847a8d9f5b71bf3fd85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:32:26.644606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-5d07d458-25ea-4cf9-a43e-95ec85f2ce87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:26.645238 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-5d07d458-25ea-4cf9-a43e-95ec85f2ce87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:26.646730 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1390/2745] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:32:26 2022] DELETE /identity/v3/projects/9123c3d2eda44847a8d9f5b71bf3fd85 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:26.650554 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07d458-25ea-4cf9-a43e-95ec85f2ce87 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:26.651907 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-5d07d458-25ea-4cf9-a43e-95ec85f2ce87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:26.718169 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07d458-25ea-4cf9-a43e-95ec85f2ce87 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:26.772007 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f85bd5-a36f-476f-a889-a90cb76a882d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:26.772639 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f85bd5-a36f-476f-a889-a90cb76a882d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:26.772924 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f85bd5-a36f-476f-a889-a90cb76a882d admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:26.773199 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f85bd5-a36f-476f-a889-a90cb76a882d admin admin] PATH_INFO: `/v3/users/8a523b41aa5a4e14be3c0d282ca9da18` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:26.774313 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f85bd5-a36f-476f-a889-a90cb76a882d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a523b41aa5a4e14be3c0d282ca9da18)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:26.776288 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f85bd5-a36f-476f-a889-a90cb76a882d admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:26.781628 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:26.789527 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-001f390b-bdb6-4fdf-92cd-de3ca213c984 admin admin] The token cache is being invalidate because project 8627701b93a64e9db98de2464ce15998 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:32:26.789818 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-001f390b-bdb6-4fdf-92cd-de3ca213c984 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:26.790435 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-001f390b-bdb6-4fdf-92cd-de3ca213c984 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:26.791935 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1356/2746] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:32:26 2022] DELETE /identity/v3/projects/8627701b93a64e9db98de2464ce15998 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:26.796267 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f390b-bdb6-4fdf-92cd-de3ca213c984 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:26.797782 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-001f390b-bdb6-4fdf-92cd-de3ca213c984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:26.811249 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f390b-bdb6-4fdf-92cd-de3ca213c984 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:26.815832 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5cd4af-14e0-437f-996b-6c9a73b0da47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:26.816470 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cd4af-14e0-437f-996b-6c9a73b0da47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:26.816756 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cd4af-14e0-437f-996b-6c9a73b0da47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:26.817036 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cd4af-14e0-437f-996b-6c9a73b0da47 admin admin] PATH_INFO: `/v3/users/e55da65a5a2c438f8fbec363e0933b5b` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:26.818161 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5cd4af-14e0-437f-996b-6c9a73b0da47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e55da65a5a2c438f8fbec363e0933b5b)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:26.820117 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5cd4af-14e0-437f-996b-6c9a73b0da47 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:26.835846 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:26.966289 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-e5f85bd5-a36f-476f-a889-a90cb76a882d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a523b41aa5a4e14be3c0d282ca9da18'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:26.989535 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-ea5cd4af-14e0-437f-996b-6c9a73b0da47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e55da65a5a2c438f8fbec363e0933b5b'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:27.056167 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-e5f85bd5-a36f-476f-a889-a90cb76a882d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a523b41aa5a4e14be3c0d282ca9da18'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:27.056925 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-e5f85bd5-a36f-476f-a889-a90cb76a882d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a523b41aa5a4e14be3c0d282ca9da18'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:27.070130 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-e5f85bd5-a36f-476f-a889-a90cb76a882d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a523b41aa5a4e14be3c0d282ca9da18'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:27.077764 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-e5f85bd5-a36f-476f-a889-a90cb76a882d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a523b41aa5a4e14be3c0d282ca9da18'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:27.083889 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1391/2747] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:32:26 2022] DELETE /identity/v3/users/8a523b41aa5a4e14be3c0d282ca9da18 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:32:27.107265 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-ea5cd4af-14e0-437f-996b-6c9a73b0da47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e55da65a5a2c438f8fbec363e0933b5b'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:27.108126 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-ea5cd4af-14e0-437f-996b-6c9a73b0da47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e55da65a5a2c438f8fbec363e0933b5b'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:27.108892 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-ea5cd4af-14e0-437f-996b-6c9a73b0da47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e55da65a5a2c438f8fbec363e0933b5b'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:27.123731 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-ea5cd4af-14e0-437f-996b-6c9a73b0da47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e55da65a5a2c438f8fbec363e0933b5b'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:27.139559 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1357/2748] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:32:26 2022] DELETE /identity/v3/users/e55da65a5a2c438f8fbec363e0933b5b => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:27.591255 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f85bd5-a36f-476f-a889-a90cb76a882d admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:27.592388 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5cd4af-14e0-437f-996b-6c9a73b0da47 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:27.592785 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-e5f85bd5-a36f-476f-a889-a90cb76a882d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:27.593964 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-ea5cd4af-14e0-437f-996b-6c9a73b0da47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:27.663441 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5cd4af-14e0-437f-996b-6c9a73b0da47 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:27.668415 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ae156-afee-4dcd-bb92-00a026db985a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:27.669610 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ae156-afee-4dcd-bb92-00a026db985a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:27.669899 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ae156-afee-4dcd-bb92-00a026db985a admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:27.670179 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ae156-afee-4dcd-bb92-00a026db985a admin admin] PATH_INFO: `/v3/projects/60de2c9fa291456cb2280963d17b446b` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:27.671522 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ae156-afee-4dcd-bb92-00a026db985a admin admin] RBAC: Authorizing `identity:delete_project(project_id=60de2c9fa291456cb2280963d17b446b)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:27.673527 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ae156-afee-4dcd-bb92-00a026db985a admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:27.686098 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f85bd5-a36f-476f-a889-a90cb76a882d admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:27.691075 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ea779-2088-458d-adc0-05833ca239f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:27.691759 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ea779-2088-458d-adc0-05833ca239f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:27.692044 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ea779-2088-458d-adc0-05833ca239f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:27.692324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ea779-2088-458d-adc0-05833ca239f9 admin admin] PATH_INFO: `/v3/projects/73d66c8a07cf40f3bad781dcb118e38e` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:27.693462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ea779-2088-458d-adc0-05833ca239f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73d66c8a07cf40f3bad781dcb118e38e)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:27.695380 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ea779-2088-458d-adc0-05833ca239f9 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:27.830174 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-cf3ae156-afee-4dcd-bb92-00a026db985a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60de2c9fa291456cb2280963d17b446b', 'request_id': 'req-cf3ae156-afee-4dcd-bb92-00a026db985a'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:27.835417 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-cf3ae156-afee-4dcd-bb92-00a026db985a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60de2c9fa291456cb2280963d17b446b', 'request_id': 'req-cf3ae156-afee-4dcd-bb92-00a026db985a'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:27.842423 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-cf3ae156-afee-4dcd-bb92-00a026db985a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60de2c9fa291456cb2280963d17b446b', 'request_id': 'req-cf3ae156-afee-4dcd-bb92-00a026db985a'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:27.859838 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-d11ea779-2088-458d-adc0-05833ca239f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73d66c8a07cf40f3bad781dcb118e38e', 'request_id': 'req-d11ea779-2088-458d-adc0-05833ca239f9'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:27.865211 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-d11ea779-2088-458d-adc0-05833ca239f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73d66c8a07cf40f3bad781dcb118e38e', 'request_id': 'req-d11ea779-2088-458d-adc0-05833ca239f9'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:27.871420 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-d11ea779-2088-458d-adc0-05833ca239f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73d66c8a07cf40f3bad781dcb118e38e', 'request_id': 'req-d11ea779-2088-458d-adc0-05833ca239f9'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:28.016357 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-cf3ae156-afee-4dcd-bb92-00a026db985a admin admin] The token cache is being invalidate because project 60de2c9fa291456cb2280963d17b446b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:32:28.016657 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-cf3ae156-afee-4dcd-bb92-00a026db985a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:28.017285 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-cf3ae156-afee-4dcd-bb92-00a026db985a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:28.018835 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1358/2749] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:32:27 2022] DELETE /identity/v3/projects/60de2c9fa291456cb2280963d17b446b => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:32:28.023562 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff4bc1-f556-4a27-a65d-91c9f2f29508 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:28.023851 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff4bc1-f556-4a27-a65d-91c9f2f29508 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:28.024136 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff4bc1-f556-4a27-a65d-91c9f2f29508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:28.043219 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-97ff4bc1-f556-4a27-a65d-91c9f2f29508 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:28.045132 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-97ff4bc1-f556-4a27-a65d-91c9f2f29508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:28.064738 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:28.106716 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1359/2750] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:32:28.110151 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-d11ea779-2088-458d-adc0-05833ca239f9 admin admin] The token cache is being invalidate because project 73d66c8a07cf40f3bad781dcb118e38e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:32:28.110448 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-d11ea779-2088-458d-adc0-05833ca239f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:28.111087 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-d11ea779-2088-458d-adc0-05833ca239f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:28.112595 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1392/2751] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:32:27 2022] DELETE /identity/v3/projects/73d66c8a07cf40f3bad781dcb118e38e => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:28.115588 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545cfbcf-c1c0-4ccf-acb7-edadb9daf63e None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:28.115870 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545cfbcf-c1c0-4ccf-acb7-edadb9daf63e None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:28.116142 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545cfbcf-c1c0-4ccf-acb7-edadb9daf63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:28.118058 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff4bc1-f556-4a27-a65d-91c9f2f29508 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:28.119537 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-97ff4bc1-f556-4a27-a65d-91c9f2f29508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:28.135850 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff4bc1-f556-4a27-a65d-91c9f2f29508 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:28.138326 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-545cfbcf-c1c0-4ccf-acb7-edadb9daf63e None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:28.139585 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-545cfbcf-c1c0-4ccf-acb7-edadb9daf63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:28.141505 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdaa2a6-27d6-45bb-ac98-bf7387ce2f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:28.142139 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdaa2a6-27d6-45bb-ac98-bf7387ce2f0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:28.142427 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdaa2a6-27d6-45bb-ac98-bf7387ce2f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:28.142741 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdaa2a6-27d6-45bb-ac98-bf7387ce2f0a admin admin] PATH_INFO: `/v3/users/87b893573a0a409e962f511871eed628` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:28.143892 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdaa2a6-27d6-45bb-ac98-bf7387ce2f0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=87b893573a0a409e962f511871eed628)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:28.145847 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdaa2a6-27d6-45bb-ac98-bf7387ce2f0a admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:28.149394 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1393/2752] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:32:28.164306 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545cfbcf-c1c0-4ccf-acb7-edadb9daf63e None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:28.186623 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545cfbcf-c1c0-4ccf-acb7-edadb9daf63e None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:28.191688 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537daf8b-4f67-4c4a-b0f4-7875da165a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:28.192498 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537daf8b-4f67-4c4a-b0f4-7875da165a11 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:28.192836 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537daf8b-4f67-4c4a-b0f4-7875da165a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:28.193174 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537daf8b-4f67-4c4a-b0f4-7875da165a11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:28.194907 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537daf8b-4f67-4c4a-b0f4-7875da165a11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:32:28.195287 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537daf8b-4f67-4c4a-b0f4-7875da165a11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:28.197430 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537daf8b-4f67-4c4a-b0f4-7875da165a11 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:28.199580 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:28.211575 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1394/2753] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:32:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:32:28.216176 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537daf8b-4f67-4c4a-b0f4-7875da165a11 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:28.228413 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537daf8b-4f67-4c4a-b0f4-7875da165a11 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:28.234543 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69eb7c-1faf-4a5e-9cee-9cebcf25581c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:28.235496 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69eb7c-1faf-4a5e-9cee-9cebcf25581c admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:28.236689 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69eb7c-1faf-4a5e-9cee-9cebcf25581c admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:28.236689 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69eb7c-1faf-4a5e-9cee-9cebcf25581c admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:28.236689 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69eb7c-1faf-4a5e-9cee-9cebcf25581c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:28.238975 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69eb7c-1faf-4a5e-9cee-9cebcf25581c admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:28.351234 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1395/2754] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:32:28 2022] POST /identity/v3/projects => generated 389 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:32:28.355406 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69eb7c-1faf-4a5e-9cee-9cebcf25581c admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:28.419648 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69eb7c-1faf-4a5e-9cee-9cebcf25581c admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:28.425477 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da38a9-81fb-4f16-afa4-a75b7fda6d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:28.426325 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da38a9-81fb-4f16-afa4-a75b7fda6d6e admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:28.426612 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da38a9-81fb-4f16-afa4-a75b7fda6d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:28.426896 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da38a9-81fb-4f16-afa4-a75b7fda6d6e admin admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:28.433912 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da38a9-81fb-4f16-afa4-a75b7fda6d6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:28.433912 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da38a9-81fb-4f16-afa4-a75b7fda6d6e admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:28.440630 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-4fdaa2a6-27d6-45bb-ac98-bf7387ce2f0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87b893573a0a409e962f511871eed628'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:28.524753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-4fdaa2a6-27d6-45bb-ac98-bf7387ce2f0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87b893573a0a409e962f511871eed628'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:28.525449 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-4fdaa2a6-27d6-45bb-ac98-bf7387ce2f0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87b893573a0a409e962f511871eed628'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:28.526220 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-4fdaa2a6-27d6-45bb-ac98-bf7387ce2f0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87b893573a0a409e962f511871eed628'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:28.531429 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1396/2755] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:32:28 2022] POST /identity/v3/users => generated 295 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:32:28.535576 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da38a9-81fb-4f16-afa4-a75b7fda6d6e admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:28.537337 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-f2da38a9-81fb-4f16-afa4-a75b7fda6d6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:28.540623 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-4fdaa2a6-27d6-45bb-ac98-bf7387ce2f0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87b893573a0a409e962f511871eed628'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:28.552481 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da38a9-81fb-4f16-afa4-a75b7fda6d6e admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:28.554912 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1360/2756] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:32:28 2022] DELETE /identity/v3/users/87b893573a0a409e962f511871eed628 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:28.559955 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e562e-549c-453c-9ef4-5c750da57402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:28.559955 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e562e-549c-453c-9ef4-5c750da57402 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:28.560201 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e562e-549c-453c-9ef4-5c750da57402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:28.560480 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e562e-549c-453c-9ef4-5c750da57402 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:28.561121 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e562e-549c-453c-9ef4-5c750da57402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:28.563110 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e562e-549c-453c-9ef4-5c750da57402 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:28.604929 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1397/2757] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:32:28.606060 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdaa2a6-27d6-45bb-ac98-bf7387ce2f0a admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:28.629971 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84546a-3070-4a99-8a1b-6dd36b4dc875 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:28.630344 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84546a-3070-4a99-8a1b-6dd36b4dc875 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:28.631476 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84546a-3070-4a99-8a1b-6dd36b4dc875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:28.662681 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-3b84546a-3070-4a99-8a1b-6dd36b4dc875 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:28.664028 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-3b84546a-3070-4a99-8a1b-6dd36b4dc875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:28.680907 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdaa2a6-27d6-45bb-ac98-bf7387ce2f0a admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:28.685804 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368df31f-db4e-47b3-a297-945a3891d304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:28.686308 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368df31f-db4e-47b3-a297-945a3891d304 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:28.686591 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368df31f-db4e-47b3-a297-945a3891d304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:28.686869 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368df31f-db4e-47b3-a297-945a3891d304 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:28.687548 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368df31f-db4e-47b3-a297-945a3891d304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:28.689137 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368df31f-db4e-47b3-a297-945a3891d304 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:28.699342 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1361/2758] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:32:28.703917 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368df31f-db4e-47b3-a297-945a3891d304 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:28.713856 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368df31f-db4e-47b3-a297-945a3891d304 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:28.719201 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f277a-c53a-4a9b-aa1b-4060cce1b018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:28.719914 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f277a-c53a-4a9b-aa1b-4060cce1b018 admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:28.720293 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f277a-c53a-4a9b-aa1b-4060cce1b018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:28.720477 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f277a-c53a-4a9b-aa1b-4060cce1b018 admin admin] PATH_INFO: `/v3/projects/cd3aa900036c4e5f8fc72244cfc9ec5d/users/f5490be3126a42debade4fa5827f8c55/roles/5691bce246d6452990f13933e19f2825` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:28.729296 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1398/2759] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Aug 8 02:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:28.735106 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f277a-c53a-4a9b-aa1b-4060cce1b018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd3aa900036c4e5f8fc72244cfc9ec5d, user_id=f5490be3126a42debade4fa5827f8c55, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:28.737829 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f277a-c53a-4a9b-aa1b-4060cce1b018 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:28.757898 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84546a-3070-4a99-8a1b-6dd36b4dc875 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:28.759283 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-3b84546a-3070-4a99-8a1b-6dd36b4dc875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:28.837582 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84546a-3070-4a99-8a1b-6dd36b4dc875 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:28.844884 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607eb91-f627-457f-bdb2-7816bb5eb10a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:28.845535 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607eb91-f627-457f-bdb2-7816bb5eb10a service nova] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:28.845828 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607eb91-f627-457f-bdb2-7816bb5eb10a service nova] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:28.846103 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607eb91-f627-457f-bdb2-7816bb5eb10a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:28.859281 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1362/2760] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:32:28 2022] PUT /identity/v3/projects/cd3aa900036c4e5f8fc72244cfc9ec5d/users/f5490be3126a42debade4fa5827f8c55/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:32:28.865070 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2607eb91-f627-457f-bdb2-7816bb5eb10a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:28.865070 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2607eb91-f627-457f-bdb2-7816bb5eb10a service nova] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:28.874387 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f37b5-eb43-4b3e-b7d9-153ac2d9804d None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:28.874992 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f37b5-eb43-4b3e-b7d9-153ac2d9804d None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:28.875489 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f37b5-eb43-4b3e-b7d9-153ac2d9804d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:28.876534 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1399/2761] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:32:28.904457 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-685f37b5-eb43-4b3e-b7d9-153ac2d9804d None None] MFA Rules not processed for user `f5490be3126a42debade4fa5827f8c55`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:28.905747 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-685f37b5-eb43-4b3e-b7d9-153ac2d9804d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:28.975897 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1363/2762] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:32:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:32:28.980434 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607eb91-f627-457f-bdb2-7816bb5eb10a service nova] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:28.990923 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607eb91-f627-457f-bdb2-7816bb5eb10a service nova] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:29.044886 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221987b6-be81-4ede-9f56-04067dcd749b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:29.045505 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221987b6-be81-4ede-9f56-04067dcd749b admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:29.045789 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221987b6-be81-4ede-9f56-04067dcd749b admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:29.046062 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221987b6-be81-4ede-9f56-04067dcd749b admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:29.046689 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221987b6-be81-4ede-9f56-04067dcd749b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:29.048625 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221987b6-be81-4ede-9f56-04067dcd749b admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:29.100692 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f37b5-eb43-4b3e-b7d9-153ac2d9804d None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:29.102417 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-685f37b5-eb43-4b3e-b7d9-153ac2d9804d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:29.117150 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f37b5-eb43-4b3e-b7d9-153ac2d9804d None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:29.122073 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6737c02-641f-41fa-92f2-3721ec847b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:29.130654 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6737c02-641f-41fa-92f2-3721ec847b6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:29.130654 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6737c02-641f-41fa-92f2-3721ec847b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:29.130654 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6737c02-641f-41fa-92f2-3721ec847b6c admin admin] PATH_INFO: `/v3/projects/8060efdd352842658b8e65c74f9251fc` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:29.130654 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6737c02-641f-41fa-92f2-3721ec847b6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8060efdd352842658b8e65c74f9251fc)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:29.130654 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6737c02-641f-41fa-92f2-3721ec847b6c admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:29.160859 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1400/2763] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:32:28 2022] POST /identity/v3/projects => generated 387 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:32:29.164546 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221987b6-be81-4ede-9f56-04067dcd749b admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:29.223827 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221987b6-be81-4ede-9f56-04067dcd749b admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:29.228632 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd4024-36a0-48de-bc0b-81a2ad9936bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:29.229219 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd4024-36a0-48de-bc0b-81a2ad9936bf admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:29.229499 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd4024-36a0-48de-bc0b-81a2ad9936bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:29.229770 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd4024-36a0-48de-bc0b-81a2ad9936bf admin admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:29.230373 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd4024-36a0-48de-bc0b-81a2ad9936bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:29.233070 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd4024-36a0-48de-bc0b-81a2ad9936bf admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:29.257055 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-f6737c02-641f-41fa-92f2-3721ec847b6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8060efdd352842658b8e65c74f9251fc', 'request_id': 'req-f6737c02-641f-41fa-92f2-3721ec847b6c'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:29.262559 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-f6737c02-641f-41fa-92f2-3721ec847b6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8060efdd352842658b8e65c74f9251fc', 'request_id': 'req-f6737c02-641f-41fa-92f2-3721ec847b6c'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:29.269281 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-f6737c02-641f-41fa-92f2-3721ec847b6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8060efdd352842658b8e65c74f9251fc', 'request_id': 'req-f6737c02-641f-41fa-92f2-3721ec847b6c'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:29.340102 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1401/2764] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:32:29 2022] POST /identity/v3/users => generated 300 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:32:29.341583 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd4024-36a0-48de-bc0b-81a2ad9936bf admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:29.352456 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd4024-36a0-48de-bc0b-81a2ad9936bf admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:29.367995 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-f6737c02-641f-41fa-92f2-3721ec847b6c admin admin] The token cache is being invalidate because project 8060efdd352842658b8e65c74f9251fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:32:29.373506 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-f6737c02-641f-41fa-92f2-3721ec847b6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:29.373506 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-f6737c02-641f-41fa-92f2-3721ec847b6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:29.373506 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1364/2765] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:32:29 2022] DELETE /identity/v3/projects/8060efdd352842658b8e65c74f9251fc => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:32:29.377100 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202493be-fc9e-4970-a673-39641095ec23 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:29.377392 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202493be-fc9e-4970-a673-39641095ec23 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:29.377666 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202493be-fc9e-4970-a673-39641095ec23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:29.404971 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-202493be-fc9e-4970-a673-39641095ec23 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:29.406191 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-202493be-fc9e-4970-a673-39641095ec23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:29.427250 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f9395-378b-48c3-ac70-decbc994530d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:29.428165 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f9395-378b-48c3-ac70-decbc994530d admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:29.428609 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f9395-378b-48c3-ac70-decbc994530d admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:29.429062 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f9395-378b-48c3-ac70-decbc994530d admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:29.429882 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f9395-378b-48c3-ac70-decbc994530d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:29.432215 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f9395-378b-48c3-ac70-decbc994530d admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:29.443775 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1402/2766] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:32:29.449624 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f9395-378b-48c3-ac70-decbc994530d admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:29.452301 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-707f9395-378b-48c3-ac70-decbc994530d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:29.458258 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:29.468332 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f9395-378b-48c3-ac70-decbc994530d admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:29.473542 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb01b6-eb3c-4b44-96ac-ecd6b3e75652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:29.474202 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb01b6-eb3c-4b44-96ac-ecd6b3e75652 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:29.474486 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb01b6-eb3c-4b44-96ac-ecd6b3e75652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:29.474988 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb01b6-eb3c-4b44-96ac-ecd6b3e75652 admin admin] PATH_INFO: `/v3/projects/507bd42a0f4f447086b7ad68337b7492/users/58a4104ca4f6453ea0c1a4bf4720808d/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:29.475105 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1365/2767] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:32:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:29.483688 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489415ee-374e-4e00-91b1-a0fb82379f49 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:29.484066 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489415ee-374e-4e00-91b1-a0fb82379f49 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:29.484424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489415ee-374e-4e00-91b1-a0fb82379f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:29.492006 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb01b6-eb3c-4b44-96ac-ecd6b3e75652 admin admin] RBAC: Authorizing `identity:create_grant(project_id=507bd42a0f4f447086b7ad68337b7492, user_id=58a4104ca4f6453ea0c1a4bf4720808d, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:29.495231 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb01b6-eb3c-4b44-96ac-ecd6b3e75652 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:29.506123 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-489415ee-374e-4e00-91b1-a0fb82379f49 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:29.507451 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-489415ee-374e-4e00-91b1-a0fb82379f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:29.509878 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:29.516407 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1366/2768] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:32:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:32:29.520614 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489415ee-374e-4e00-91b1-a0fb82379f49 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:29.530038 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489415ee-374e-4e00-91b1-a0fb82379f49 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:29.534691 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168567e1-af5a-4bc7-9e1f-c4f7959ca1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:29.535268 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168567e1-af5a-4bc7-9e1f-c4f7959ca1f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:29.535591 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168567e1-af5a-4bc7-9e1f-c4f7959ca1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:29.535897 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168567e1-af5a-4bc7-9e1f-c4f7959ca1f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:29.536538 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168567e1-af5a-4bc7-9e1f-c4f7959ca1f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:32:29.536842 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168567e1-af5a-4bc7-9e1f-c4f7959ca1f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:29.538454 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168567e1-af5a-4bc7-9e1f-c4f7959ca1f3 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:29.549808 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1367/2769] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:32:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:32:29.553889 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168567e1-af5a-4bc7-9e1f-c4f7959ca1f3 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:29.565658 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168567e1-af5a-4bc7-9e1f-c4f7959ca1f3 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:29.567838 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1403/2770] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:32:29 2022] PUT /identity/v3/projects/507bd42a0f4f447086b7ad68337b7492/users/58a4104ca4f6453ea0c1a4bf4720808d/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:29.572343 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb01b6-eb3c-4b44-96ac-ecd6b3e75652 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:29.641216 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb01b6-eb3c-4b44-96ac-ecd6b3e75652 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:29.646117 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64beb1c3-bf21-4332-ba0e-0553686d0990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:29.646681 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64beb1c3-bf21-4332-ba0e-0553686d0990 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:29.646968 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64beb1c3-bf21-4332-ba0e-0553686d0990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:29.647243 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64beb1c3-bf21-4332-ba0e-0553686d0990 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:29.647390 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac22c3c-e0d7-4728-aa28-e006cc362c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:29.647919 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64beb1c3-bf21-4332-ba0e-0553686d0990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:29.648034 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac22c3c-e0d7-4728-aa28-e006cc362c32 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:29.648250 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac22c3c-e0d7-4728-aa28-e006cc362c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:29.648697 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac22c3c-e0d7-4728-aa28-e006cc362c32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:29.649324 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac22c3c-e0d7-4728-aa28-e006cc362c32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:29.649515 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64beb1c3-bf21-4332-ba0e-0553686d0990 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:29.651247 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac22c3c-e0d7-4728-aa28-e006cc362c32 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:29.663379 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1404/2771] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:32:29.664453 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64beb1c3-bf21-4332-ba0e-0553686d0990 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:29.674160 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64beb1c3-bf21-4332-ba0e-0553686d0990 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:29.678880 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc2b31-0f14-4cae-88b2-cea6c66d73cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:29.679548 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc2b31-0f14-4cae-88b2-cea6c66d73cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:29.679835 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc2b31-0f14-4cae-88b2-cea6c66d73cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:29.680116 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc2b31-0f14-4cae-88b2-cea6c66d73cf admin admin] PATH_INFO: `/v3/projects/507bd42a0f4f447086b7ad68337b7492/users/58a4104ca4f6453ea0c1a4bf4720808d/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:29.682034 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc2b31-0f14-4cae-88b2-cea6c66d73cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=507bd42a0f4f447086b7ad68337b7492, user_id=58a4104ca4f6453ea0c1a4bf4720808d, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:29.684746 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc2b31-0f14-4cae-88b2-cea6c66d73cf admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:29.694742 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1405/2772] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:32:29 2022] PUT /identity/v3/projects/507bd42a0f4f447086b7ad68337b7492/users/58a4104ca4f6453ea0c1a4bf4720808d/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:29.705283 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495420d-3e72-4129-90c1-5aa1dc54563b None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:29.705584 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495420d-3e72-4129-90c1-5aa1dc54563b None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:29.705854 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495420d-3e72-4129-90c1-5aa1dc54563b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:29.732790 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-1495420d-3e72-4129-90c1-5aa1dc54563b None None] MFA Rules not processed for user `58a4104ca4f6453ea0c1a4bf4720808d`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:29.734061 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-1495420d-3e72-4129-90c1-5aa1dc54563b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:29.742722 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1368/2773] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:32:29 2022] POST /identity/v3/projects => generated 369 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:32:29.746896 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac22c3c-e0d7-4728-aa28-e006cc362c32 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:29.802407 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1406/2774] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:32:29 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:32:29.808710 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac22c3c-e0d7-4728-aa28-e006cc362c32 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:29.813618 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495420d-3e72-4129-90c1-5aa1dc54563b None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:29.815005 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-1495420d-3e72-4129-90c1-5aa1dc54563b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:29.815127 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5764543-625a-4c0b-b95d-a22d1159cf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:29.815840 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5764543-625a-4c0b-b95d-a22d1159cf3c admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:29.816126 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5764543-625a-4c0b-b95d-a22d1159cf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:29.816483 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5764543-625a-4c0b-b95d-a22d1159cf3c admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:29.817102 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5764543-625a-4c0b-b95d-a22d1159cf3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:29.819204 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5764543-625a-4c0b-b95d-a22d1159cf3c admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:29.839778 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:29.873731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495420d-3e72-4129-90c1-5aa1dc54563b None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:29.918965 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1369/2775] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:32:29 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:32:29.923474 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5764543-625a-4c0b-b95d-a22d1159cf3c admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:29.924150 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c007c397-aad3-47ed-9162-44f9c78313ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:29.924825 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007c397-aad3-47ed-9162-44f9c78313ca service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:29.925109 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007c397-aad3-47ed-9162-44f9c78313ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:29.925412 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007c397-aad3-47ed-9162-44f9c78313ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:29.937478 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:29.943492 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5764543-625a-4c0b-b95d-a22d1159cf3c admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:29.950983 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd023036-5d5e-41b4-83cf-31750e6b8020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:29.951718 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd023036-5d5e-41b4-83cf-31750e6b8020 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:29.952310 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd023036-5d5e-41b4-83cf-31750e6b8020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:29.952435 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd023036-5d5e-41b4-83cf-31750e6b8020 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:29.953083 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd023036-5d5e-41b4-83cf-31750e6b8020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:29.954875 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd023036-5d5e-41b4-83cf-31750e6b8020 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:29.966329 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1370/2776] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:32:29.969737 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd023036-5d5e-41b4-83cf-31750e6b8020 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:29.983709 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd023036-5d5e-41b4-83cf-31750e6b8020 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:29.990164 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4680a0-f097-4d85-9a0c-6abe28ab0e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:29.991187 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4680a0-f097-4d85-9a0c-6abe28ab0e6f admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:29.991503 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4680a0-f097-4d85-9a0c-6abe28ab0e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:29.991933 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4680a0-f097-4d85-9a0c-6abe28ab0e6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:29.992582 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4680a0-f097-4d85-9a0c-6abe28ab0e6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:29.994308 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4680a0-f097-4d85-9a0c-6abe28ab0e6f admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:30.005103 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c007c397-aad3-47ed-9162-44f9c78313ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:30.006047 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1371/2777] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 02:32:30.006544 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c007c397-aad3-47ed-9162-44f9c78313ca service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:30.010038 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4680a0-f097-4d85-9a0c-6abe28ab0e6f admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:30.017374 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1407/2778] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:29 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:32:30.020528 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4680a0-f097-4d85-9a0c-6abe28ab0e6f admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:30.025572 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ed530-6005-40f5-90ca-5ba033b7158f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:30.026242 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ed530-6005-40f5-90ca-5ba033b7158f admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:30.026508 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ed530-6005-40f5-90ca-5ba033b7158f admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:30.026923 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ed530-6005-40f5-90ca-5ba033b7158f admin admin] PATH_INFO: `/v3/projects/9d85ba94a7564567bf60b7d6f1e34ac2/users/e8edd20541614a6783ec448a1aef92d5/roles/5691bce246d6452990f13933e19f2825` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:30.042287 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ed530-6005-40f5-90ca-5ba033b7158f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d85ba94a7564567bf60b7d6f1e34ac2, user_id=e8edd20541614a6783ec448a1aef92d5, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:30.045018 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ed530-6005-40f5-90ca-5ba033b7158f admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:30.154332 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c007c397-aad3-47ed-9162-44f9c78313ca service cinder] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:30.164317 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1372/2779] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:32:30 2022] PUT /identity/v3/projects/9d85ba94a7564567bf60b7d6f1e34ac2/users/e8edd20541614a6783ec448a1aef92d5/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:32:30.164736 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c007c397-aad3-47ed-9162-44f9c78313ca service cinder] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:30.183240 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2883b6-987d-4c36-a15b-c3156ca3f8ff None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:30.183575 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2883b6-987d-4c36-a15b-c3156ca3f8ff None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:30.183863 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2883b6-987d-4c36-a15b-c3156ca3f8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:30.198847 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:30.211765 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-4c2883b6-987d-4c36-a15b-c3156ca3f8ff None None] MFA Rules not processed for user `e8edd20541614a6783ec448a1aef92d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:30.212990 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-4c2883b6-987d-4c36-a15b-c3156ca3f8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:30.225798 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99de7c3-089f-434f-97d5-e4578b4cf013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:30.226427 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99de7c3-089f-434f-97d5-e4578b4cf013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:30.226713 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99de7c3-089f-434f-97d5-e4578b4cf013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:30.226986 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99de7c3-089f-434f-97d5-e4578b4cf013 admin admin] PATH_INFO: `/v3/users/f5490be3126a42debade4fa5827f8c55` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:30.228157 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99de7c3-089f-434f-97d5-e4578b4cf013 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5490be3126a42debade4fa5827f8c55)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:30.230059 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99de7c3-089f-434f-97d5-e4578b4cf013 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:30.277037 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1373/2780] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:32:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:32:30.288471 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2883b6-987d-4c36-a15b-c3156ca3f8ff None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:30.352648 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2883b6-987d-4c36-a15b-c3156ca3f8ff None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:30.356814 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730aab4-f1e4-4852-acc4-9ba931a064b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:30.357501 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730aab4-f1e4-4852-acc4-9ba931a064b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:30.357784 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730aab4-f1e4-4852-acc4-9ba931a064b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:30.358060 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730aab4-f1e4-4852-acc4-9ba931a064b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:30.366104 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a730aab4-f1e4-4852-acc4-9ba931a064b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:30.367549 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a730aab4-f1e4-4852-acc4-9ba931a064b5 service cinder] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:30.384677 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1374/2781] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:32:30.409742 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730aab4-f1e4-4852-acc4-9ba931a064b5 service cinder] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:30.420841 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730aab4-f1e4-4852-acc4-9ba931a064b5 service cinder] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:30.425445 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334783c-1628-4738-80df-75586297e762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:30.430621 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334783c-1628-4738-80df-75586297e762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:30.430621 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334783c-1628-4738-80df-75586297e762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:30.430621 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334783c-1628-4738-80df-75586297e762 admin admin] PATH_INFO: `/v3/users/e8edd20541614a6783ec448a1aef92d5` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:30.430621 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334783c-1628-4738-80df-75586297e762 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8edd20541614a6783ec448a1aef92d5)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:30.430621 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334783c-1628-4738-80df-75586297e762 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:30.471552 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c99de7c3-089f-434f-97d5-e4578b4cf013 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5490be3126a42debade4fa5827f8c55'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:30.599395 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c99de7c3-089f-434f-97d5-e4578b4cf013 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5490be3126a42debade4fa5827f8c55'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:30.599584 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:30.602005 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c99de7c3-089f-434f-97d5-e4578b4cf013 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5490be3126a42debade4fa5827f8c55'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:30.613256 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c99de7c3-089f-434f-97d5-e4578b4cf013 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5490be3126a42debade4fa5827f8c55'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:30.620012 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-c99de7c3-089f-434f-97d5-e4578b4cf013 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5490be3126a42debade4fa5827f8c55'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:30.626143 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1408/2782] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:32:30 2022] DELETE /identity/v3/users/f5490be3126a42debade4fa5827f8c55 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:32:30.630716 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ade0f3-e718-4273-a911-29b079e523f3 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:30.630716 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ade0f3-e718-4273-a911-29b079e523f3 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:30.631179 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ade0f3-e718-4273-a911-29b079e523f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:30.664448 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-a5ade0f3-e718-4273-a911-29b079e523f3 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:30.665679 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-a5ade0f3-e718-4273-a911-29b079e523f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:30.669670 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-e334783c-1628-4738-80df-75586297e762 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8edd20541614a6783ec448a1aef92d5'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:30.729423 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1409/2783] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:32:30.739882 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ade0f3-e718-4273-a911-29b079e523f3 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:30.741267 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-a5ade0f3-e718-4273-a911-29b079e523f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:30.747374 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-e334783c-1628-4738-80df-75586297e762 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8edd20541614a6783ec448a1aef92d5'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:30.748218 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-e334783c-1628-4738-80df-75586297e762 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8edd20541614a6783ec448a1aef92d5'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:30.748968 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-e334783c-1628-4738-80df-75586297e762 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8edd20541614a6783ec448a1aef92d5'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:30.762101 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-e334783c-1628-4738-80df-75586297e762 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8edd20541614a6783ec448a1aef92d5'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:30.774917 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1375/2784] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:32:30 2022] DELETE /identity/v3/users/e8edd20541614a6783ec448a1aef92d5 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:32:30.779516 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2323bc1-8b77-4863-8527-4ba8d54a6320 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:30.779873 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2323bc1-8b77-4863-8527-4ba8d54a6320 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:30.780205 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2323bc1-8b77-4863-8527-4ba8d54a6320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:30.799246 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-b2323bc1-8b77-4863-8527-4ba8d54a6320 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:30.800622 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-b2323bc1-8b77-4863-8527-4ba8d54a6320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:30.808679 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ade0f3-e718-4273-a911-29b079e523f3 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:30.823282 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:30.867606 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1376/2785] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:32:30.876926 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2323bc1-8b77-4863-8527-4ba8d54a6320 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:30.878293 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-b2323bc1-8b77-4863-8527-4ba8d54a6320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:30.887570 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e668d40-240d-446d-b041-c398c435d59e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:30.888250 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e668d40-240d-446d-b041-c398c435d59e service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:30.888480 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e668d40-240d-446d-b041-c398c435d59e service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:30.888751 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e668d40-240d-446d-b041-c398c435d59e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:30.890850 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-8e668d40-240d-446d-b041-c398c435d59e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:30.904259 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e668d40-240d-446d-b041-c398c435d59e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:30.910486 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e668d40-240d-446d-b041-c398c435d59e service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:30.916426 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1410/2786] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:32:30.944125 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2323bc1-8b77-4863-8527-4ba8d54a6320 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:30.949158 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e061340-f88f-4d31-a6c9-e584b7eb8180 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:30.949765 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e061340-f88f-4d31-a6c9-e584b7eb8180 service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:30.950693 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e061340-f88f-4d31-a6c9-e584b7eb8180 service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:30.951477 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e061340-f88f-4d31-a6c9-e584b7eb8180 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:30.961542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e061340-f88f-4d31-a6c9-e584b7eb8180 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:30.963226 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e061340-f88f-4d31-a6c9-e584b7eb8180 service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:30.975298 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1377/2787] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:32:31.096543 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:31.540458 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e668d40-240d-446d-b041-c398c435d59e service neutron] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:31.543533 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-8e668d40-240d-446d-b041-c398c435d59e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:31.555302 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e668d40-240d-446d-b041-c398c435d59e service neutron] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:31.561065 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71f272-ed01-42c8-864c-8b08a2aea76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:31.561695 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71f272-ed01-42c8-864c-8b08a2aea76d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:31.561974 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71f272-ed01-42c8-864c-8b08a2aea76d admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:31.562250 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71f272-ed01-42c8-864c-8b08a2aea76d admin admin] PATH_INFO: `/v3/projects/cd3aa900036c4e5f8fc72244cfc9ec5d` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:31.563422 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d71f272-ed01-42c8-864c-8b08a2aea76d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd3aa900036c4e5f8fc72244cfc9ec5d)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:31.565338 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d71f272-ed01-42c8-864c-8b08a2aea76d admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:31.581721 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e061340-f88f-4d31-a6c9-e584b7eb8180 service neutron] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:31.583486 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-9e061340-f88f-4d31-a6c9-e584b7eb8180 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:31.588294 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:31.604284 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e061340-f88f-4d31-a6c9-e584b7eb8180 service neutron] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:31.609048 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed0221-f8c3-4ba6-aaf2-951921cac29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:31.609653 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed0221-f8c3-4ba6-aaf2-951921cac29d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:31.609933 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed0221-f8c3-4ba6-aaf2-951921cac29d admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:31.610208 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed0221-f8c3-4ba6-aaf2-951921cac29d admin admin] PATH_INFO: `/v3/projects/9d85ba94a7564567bf60b7d6f1e34ac2` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:31.611315 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed0221-f8c3-4ba6-aaf2-951921cac29d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d85ba94a7564567bf60b7d6f1e34ac2)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:31.613368 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed0221-f8c3-4ba6-aaf2-951921cac29d admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:31.759525 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-7d71f272-ed01-42c8-864c-8b08a2aea76d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd3aa900036c4e5f8fc72244cfc9ec5d', 'request_id': 'req-7d71f272-ed01-42c8-864c-8b08a2aea76d'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:31.764891 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-7d71f272-ed01-42c8-864c-8b08a2aea76d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd3aa900036c4e5f8fc72244cfc9ec5d', 'request_id': 'req-7d71f272-ed01-42c8-864c-8b08a2aea76d'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:31.771243 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-7d71f272-ed01-42c8-864c-8b08a2aea76d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd3aa900036c4e5f8fc72244cfc9ec5d', 'request_id': 'req-7d71f272-ed01-42c8-864c-8b08a2aea76d'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:31.878963 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-83ed0221-f8c3-4ba6-aaf2-951921cac29d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d85ba94a7564567bf60b7d6f1e34ac2', 'request_id': 'req-83ed0221-f8c3-4ba6-aaf2-951921cac29d'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:31.884643 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-83ed0221-f8c3-4ba6-aaf2-951921cac29d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d85ba94a7564567bf60b7d6f1e34ac2', 'request_id': 'req-83ed0221-f8c3-4ba6-aaf2-951921cac29d'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:31.891383 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-83ed0221-f8c3-4ba6-aaf2-951921cac29d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d85ba94a7564567bf60b7d6f1e34ac2', 'request_id': 'req-83ed0221-f8c3-4ba6-aaf2-951921cac29d'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:31.903772 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-7d71f272-ed01-42c8-864c-8b08a2aea76d admin admin] The token cache is being invalidate because project cd3aa900036c4e5f8fc72244cfc9ec5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:32:31.904071 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-7d71f272-ed01-42c8-864c-8b08a2aea76d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:31.904691 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-7d71f272-ed01-42c8-864c-8b08a2aea76d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:31.906171 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1411/2788] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:32:31 2022] DELETE /identity/v3/projects/cd3aa900036c4e5f8fc72244cfc9ec5d => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:31.909998 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71f272-ed01-42c8-864c-8b08a2aea76d admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:31.911472 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-7d71f272-ed01-42c8-864c-8b08a2aea76d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:31.973016 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71f272-ed01-42c8-864c-8b08a2aea76d admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:32.028157 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd8c8a-3b33-4147-beda-cb1ecf110275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:32.028784 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd8c8a-3b33-4147-beda-cb1ecf110275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:32.029067 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd8c8a-3b33-4147-beda-cb1ecf110275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:32.029341 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd8c8a-3b33-4147-beda-cb1ecf110275 admin admin] PATH_INFO: `/v3/users/58a4104ca4f6453ea0c1a4bf4720808d` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:32.030465 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd8c8a-3b33-4147-beda-cb1ecf110275 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58a4104ca4f6453ea0c1a4bf4720808d)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:32.032441 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd8c8a-3b33-4147-beda-cb1ecf110275 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:32.038622 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-83ed0221-f8c3-4ba6-aaf2-951921cac29d admin admin] The token cache is being invalidate because project 9d85ba94a7564567bf60b7d6f1e34ac2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:32:32.039117 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-83ed0221-f8c3-4ba6-aaf2-951921cac29d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:32.040537 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-83ed0221-f8c3-4ba6-aaf2-951921cac29d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:32.043230 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1378/2789] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:32:31 2022] DELETE /identity/v3/projects/9d85ba94a7564567bf60b7d6f1e34ac2 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:32.048419 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0efc54-9198-4b9f-beef-fc76f9185203 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:32.048801 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0efc54-9198-4b9f-beef-fc76f9185203 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:32.049088 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0efc54-9198-4b9f-beef-fc76f9185203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:32.068995 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-ab0efc54-9198-4b9f-beef-fc76f9185203 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:32.070233 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-ab0efc54-9198-4b9f-beef-fc76f9185203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:32.078219 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1379/2790] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:32:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:32.085654 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f4e3c-9c1b-48f9-8637-aea679cd0a72 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:32.085945 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f4e3c-9c1b-48f9-8637-aea679cd0a72 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:32.086226 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f4e3c-9c1b-48f9-8637-aea679cd0a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:32.107333 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-3d3f4e3c-9c1b-48f9-8637-aea679cd0a72 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:32.108544 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-3d3f4e3c-9c1b-48f9-8637-aea679cd0a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:32.116378 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1380/2791] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:32:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:32:32.120352 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f4e3c-9c1b-48f9-8637-aea679cd0a72 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:32.129415 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f4e3c-9c1b-48f9-8637-aea679cd0a72 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:32.148322 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f168f-06e9-4963-9a20-059f88b34018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:32.148322 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f168f-06e9-4963-9a20-059f88b34018 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:32.148322 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f168f-06e9-4963-9a20-059f88b34018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:32.148322 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f168f-06e9-4963-9a20-059f88b34018 admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:32.149709 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f168f-06e9-4963-9a20-059f88b34018 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:32:32.149709 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f168f-06e9-4963-9a20-059f88b34018 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:32.149709 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f168f-06e9-4963-9a20-059f88b34018 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:32.151223 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1381/2792] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:32:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:32:32.161845 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f168f-06e9-4963-9a20-059f88b34018 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:32.172283 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f168f-06e9-4963-9a20-059f88b34018 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:32.176883 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0d475-334f-4164-8238-c3f6c397b259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:32.177495 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0d475-334f-4164-8238-c3f6c397b259 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:32.177783 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0d475-334f-4164-8238-c3f6c397b259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:32.178075 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0d475-334f-4164-8238-c3f6c397b259 admin admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:32.178692 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0d475-334f-4164-8238-c3f6c397b259 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:32.180644 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0d475-334f-4164-8238-c3f6c397b259 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:32.241468 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-27cd8c8a-3b33-4147-beda-cb1ecf110275 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58a4104ca4f6453ea0c1a4bf4720808d'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:32.270344 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1382/2793] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:32:32 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:32:32.274298 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0d475-334f-4164-8238-c3f6c397b259 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:32.289214 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:32.332633 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-27cd8c8a-3b33-4147-beda-cb1ecf110275 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58a4104ca4f6453ea0c1a4bf4720808d'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:32.333331 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-27cd8c8a-3b33-4147-beda-cb1ecf110275 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58a4104ca4f6453ea0c1a4bf4720808d'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:32.338978 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0d475-334f-4164-8238-c3f6c397b259 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:32.344294 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c70cc1-76a2-4d3d-b046-774970640bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:32.344923 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c70cc1-76a2-4d3d-b046-774970640bed admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:32.345236 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c70cc1-76a2-4d3d-b046-774970640bed admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:32.345514 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c70cc1-76a2-4d3d-b046-774970640bed admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:32.346136 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c70cc1-76a2-4d3d-b046-774970640bed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:32.346834 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-27cd8c8a-3b33-4147-beda-cb1ecf110275 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58a4104ca4f6453ea0c1a4bf4720808d'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:32.348074 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c70cc1-76a2-4d3d-b046-774970640bed admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:32.354469 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-27cd8c8a-3b33-4147-beda-cb1ecf110275 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58a4104ca4f6453ea0c1a4bf4720808d'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:32.361347 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1412/2794] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:32:31 2022] DELETE /identity/v3/users/58a4104ca4f6453ea0c1a4bf4720808d => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:32:32.468349 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:32.507637 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1383/2795] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:32:32 2022] POST /identity/v3/users => generated 288 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:32:32.511620 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd8c8a-3b33-4147-beda-cb1ecf110275 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:32.513536 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-27cd8c8a-3b33-4147-beda-cb1ecf110275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:32.586231 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd8c8a-3b33-4147-beda-cb1ecf110275 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:32.592336 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a066ef81-e817-4db4-81f2-67b460cfb473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:32.592952 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066ef81-e817-4db4-81f2-67b460cfb473 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:32.593240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066ef81-e817-4db4-81f2-67b460cfb473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:32.593518 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066ef81-e817-4db4-81f2-67b460cfb473 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:32.594167 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a066ef81-e817-4db4-81f2-67b460cfb473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:32.595800 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a066ef81-e817-4db4-81f2-67b460cfb473 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:32.609452 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1413/2796] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:32:32.610480 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c70cc1-76a2-4d3d-b046-774970640bed admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:32.621352 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c70cc1-76a2-4d3d-b046-774970640bed admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:32.626186 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea897dd-cfbb-4f53-a0b8-4da130917daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:32.626813 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea897dd-cfbb-4f53-a0b8-4da130917daf admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:32.627094 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea897dd-cfbb-4f53-a0b8-4da130917daf admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:32.627453 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea897dd-cfbb-4f53-a0b8-4da130917daf admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:32.628698 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea897dd-cfbb-4f53-a0b8-4da130917daf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:32.630163 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea897dd-cfbb-4f53-a0b8-4da130917daf admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:32.643895 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1384/2797] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:32:32.645646 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a066ef81-e817-4db4-81f2-67b460cfb473 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:32.661729 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a066ef81-e817-4db4-81f2-67b460cfb473 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:32.661729 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae50c25-ef6e-4c5e-be67-6aa6cfc65d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:32.662151 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae50c25-ef6e-4c5e-be67-6aa6cfc65d60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:32.662443 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae50c25-ef6e-4c5e-be67-6aa6cfc65d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:32.662720 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae50c25-ef6e-4c5e-be67-6aa6cfc65d60 admin admin] PATH_INFO: `/v3/projects/2930b32d1eec41f79195cf50c2f724d3/users/e3125d45a380477b8380c2ea8a94ccc0/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:32.677391 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae50c25-ef6e-4c5e-be67-6aa6cfc65d60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2930b32d1eec41f79195cf50c2f724d3, user_id=e3125d45a380477b8380c2ea8a94ccc0, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:32.680192 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae50c25-ef6e-4c5e-be67-6aa6cfc65d60 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:32.817860 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea897dd-cfbb-4f53-a0b8-4da130917daf admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:32.818841 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1414/2798] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:32:32 2022] PUT /identity/v3/projects/2930b32d1eec41f79195cf50c2f724d3/users/e3125d45a380477b8380c2ea8a94ccc0/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:32.820465 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-dea897dd-cfbb-4f53-a0b8-4da130917daf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:32.831233 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8b628-3743-450b-a9f4-a851fc7da52f None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:32.831616 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8b628-3743-450b-a9f4-a851fc7da52f None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:32.831887 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8b628-3743-450b-a9f4-a851fc7da52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:32.837571 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea897dd-cfbb-4f53-a0b8-4da130917daf admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:32.868074 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-c3b8b628-3743-450b-a9f4-a851fc7da52f None None] MFA Rules not processed for user `e3125d45a380477b8380c2ea8a94ccc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:32.869311 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-c3b8b628-3743-450b-a9f4-a851fc7da52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:32.909649 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0ba05-4a4b-4f6d-b34b-b247963fe099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:32.910279 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0ba05-4a4b-4f6d-b34b-b247963fe099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:32.910565 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0ba05-4a4b-4f6d-b34b-b247963fe099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:32.910843 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0ba05-4a4b-4f6d-b34b-b247963fe099 admin admin] PATH_INFO: `/v3/projects/507bd42a0f4f447086b7ad68337b7492` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:32.912072 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0ba05-4a4b-4f6d-b34b-b247963fe099 admin admin] RBAC: Authorizing `identity:delete_project(project_id=507bd42a0f4f447086b7ad68337b7492)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:32.913999 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0ba05-4a4b-4f6d-b34b-b247963fe099 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:32.939069 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1415/2799] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:32:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:32:32.940579 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e4473-4ef3-4e55-82cb-47b4c730400f None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:32.940933 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e4473-4ef3-4e55-82cb-47b4c730400f None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:32.941265 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e4473-4ef3-4e55-82cb-47b4c730400f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:32.962246 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-822e4473-4ef3-4e55-82cb-47b4c730400f None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:32.963731 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-822e4473-4ef3-4e55-82cb-47b4c730400f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:32.971647 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1416/2800] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Aug 8 02:32:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:32.972481 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e4473-4ef3-4e55-82cb-47b4c730400f None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:32.973679 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-822e4473-4ef3-4e55-82cb-47b4c730400f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:33.029918 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e4473-4ef3-4e55-82cb-47b4c730400f None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:33.035862 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-8ca0ba05-4a4b-4f6d-b34b-b247963fe099 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '507bd42a0f4f447086b7ad68337b7492', 'request_id': 'req-8ca0ba05-4a4b-4f6d-b34b-b247963fe099'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:33.041572 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-8ca0ba05-4a4b-4f6d-b34b-b247963fe099 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '507bd42a0f4f447086b7ad68337b7492', 'request_id': 'req-8ca0ba05-4a4b-4f6d-b34b-b247963fe099'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:33.047890 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-8ca0ba05-4a4b-4f6d-b34b-b247963fe099 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '507bd42a0f4f447086b7ad68337b7492', 'request_id': 'req-8ca0ba05-4a4b-4f6d-b34b-b247963fe099'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:33.077913 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e492c8aa-4969-41bb-af6f-5f2d94d4b9d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:33.078438 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492c8aa-4969-41bb-af6f-5f2d94d4b9d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:33.078718 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492c8aa-4969-41bb-af6f-5f2d94d4b9d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:33.078989 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492c8aa-4969-41bb-af6f-5f2d94d4b9d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:33.115477 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-8ca0ba05-4a4b-4f6d-b34b-b247963fe099 admin admin] The token cache is being invalidate because project 507bd42a0f4f447086b7ad68337b7492 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:32:33.115895 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-8ca0ba05-4a4b-4f6d-b34b-b247963fe099 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:33.116628 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-8ca0ba05-4a4b-4f6d-b34b-b247963fe099 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:33.118244 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1385/2801] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:32:32 2022] DELETE /identity/v3/projects/507bd42a0f4f447086b7ad68337b7492 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:32:33.122800 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0ba05-4a4b-4f6d-b34b-b247963fe099 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:33.124163 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-8ca0ba05-4a4b-4f6d-b34b-b247963fe099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:33.133761 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e492c8aa-4969-41bb-af6f-5f2d94d4b9d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:33.135202 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e492c8aa-4969-41bb-af6f-5f2d94d4b9d0 service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:33.144799 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1417/2802] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:32:33.145932 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd9fca-53b2-4b1a-a85f-e7febf2589ef None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:33.146286 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd9fca-53b2-4b1a-a85f-e7febf2589ef None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:33.146571 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd9fca-53b2-4b1a-a85f-e7febf2589ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:33.165902 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-94cd9fca-53b2-4b1a-a85f-e7febf2589ef None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:33.167125 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-94cd9fca-53b2-4b1a-a85f-e7febf2589ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:33.198649 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:33.203814 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0ba05-4a4b-4f6d-b34b-b247963fe099 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:33.209316 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8ec0d-d6cb-48de-b6cf-0b78a41fc519 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:33.209922 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8ec0d-d6cb-48de-b6cf-0b78a41fc519 service nova] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:33.210205 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8ec0d-d6cb-48de-b6cf-0b78a41fc519 service nova] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:33.210606 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8ec0d-d6cb-48de-b6cf-0b78a41fc519 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:33.214362 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-2bb8ec0d-d6cb-48de-b6cf-0b78a41fc519 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:33.228347 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:33.235796 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1418/2803] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:32:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:33.245377 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac9aee-b787-4028-9bc2-cc88c264e831 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:33.245744 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac9aee-b787-4028-9bc2-cc88c264e831 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:33.246094 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac9aee-b787-4028-9bc2-cc88c264e831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:33.276407 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-f8ac9aee-b787-4028-9bc2-cc88c264e831 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:33.277622 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-f8ac9aee-b787-4028-9bc2-cc88c264e831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:33.289566 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1419/2804] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:32:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:33.293216 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac9aee-b787-4028-9bc2-cc88c264e831 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:33.306374 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac9aee-b787-4028-9bc2-cc88c264e831 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:33.316978 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969517c9-a09b-4b7a-8c20-959885168cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:33.317673 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969517c9-a09b-4b7a-8c20-959885168cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:33.318080 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969517c9-a09b-4b7a-8c20-959885168cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:33.318331 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb8ec0d-d6cb-48de-b6cf-0b78a41fc519 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:33.318479 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969517c9-a09b-4b7a-8c20-959885168cd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:33.319179 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969517c9-a09b-4b7a-8c20-959885168cd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:32:33.319681 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969517c9-a09b-4b7a-8c20-959885168cd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:33.320206 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb8ec0d-d6cb-48de-b6cf-0b78a41fc519 service nova] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:33.321309 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969517c9-a09b-4b7a-8c20-959885168cd7 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:33.331102 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1386/2805] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:32:33.334382 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1420/2806] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:32:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:32:33.339054 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8ec0d-d6cb-48de-b6cf-0b78a41fc519 service nova] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:33.349797 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8ec0d-d6cb-48de-b6cf-0b78a41fc519 service nova] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:33.355318 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ca2bb-54b0-4df7-92a0-2559ac6d623a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:33.355318 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ca2bb-54b0-4df7-92a0-2559ac6d623a admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:33.355898 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ca2bb-54b0-4df7-92a0-2559ac6d623a admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:33.356131 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ca2bb-54b0-4df7-92a0-2559ac6d623a admin admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:33.356795 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ca2bb-54b0-4df7-92a0-2559ac6d623a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:33.358853 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ca2bb-54b0-4df7-92a0-2559ac6d623a admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:33.515156 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1387/2807] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:32:33 2022] POST /identity/v3/projects => generated 377 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:32:33.516250 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969517c9-a09b-4b7a-8c20-959885168cd7 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:33.526139 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969517c9-a09b-4b7a-8c20-959885168cd7 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:33.585075 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed86e9a-cba0-4414-9e4c-609147290ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:33.585649 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed86e9a-cba0-4414-9e4c-609147290ed9 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:33.585943 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed86e9a-cba0-4414-9e4c-609147290ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:33.586222 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed86e9a-cba0-4414-9e4c-609147290ed9 admin admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:33.586858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed86e9a-cba0-4414-9e4c-609147290ed9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:33.589076 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed86e9a-cba0-4414-9e4c-609147290ed9 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:33.684775 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1421/2808] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:32:33 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:32:33.689274 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ca2bb-54b0-4df7-92a0-2559ac6d623a admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:33.699394 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ca2bb-54b0-4df7-92a0-2559ac6d623a admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:33.704520 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01b92d-61de-4a3b-90db-95c5dbc550f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:33.705210 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01b92d-61de-4a3b-90db-95c5dbc550f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:33.705491 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01b92d-61de-4a3b-90db-95c5dbc550f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:33.705840 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01b92d-61de-4a3b-90db-95c5dbc550f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:33.706469 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01b92d-61de-4a3b-90db-95c5dbc550f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:33.708082 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01b92d-61de-4a3b-90db-95c5dbc550f5 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:33.718815 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1388/2809] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:32:33.722649 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed86e9a-cba0-4414-9e4c-609147290ed9 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:33.732506 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed86e9a-cba0-4414-9e4c-609147290ed9 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:33.737243 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c9000-4060-41d5-aa0a-25341c8a1aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:33.737825 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c9000-4060-41d5-aa0a-25341c8a1aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:33.738106 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c9000-4060-41d5-aa0a-25341c8a1aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:33.738379 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c9000-4060-41d5-aa0a-25341c8a1aa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:33.739009 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c9000-4060-41d5-aa0a-25341c8a1aa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:33.740627 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c9000-4060-41d5-aa0a-25341c8a1aa5 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:33.752149 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1422/2810] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:32:33.756152 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01b92d-61de-4a3b-90db-95c5dbc550f5 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:33.766619 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01b92d-61de-4a3b-90db-95c5dbc550f5 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:33.771135 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8487e-6f3a-41f0-9754-03b283fec85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:33.771976 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8487e-6f3a-41f0-9754-03b283fec85b admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:33.772254 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8487e-6f3a-41f0-9754-03b283fec85b admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:33.772529 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8487e-6f3a-41f0-9754-03b283fec85b admin admin] PATH_INFO: `/v3/projects/619a78bbe99040b485a5f3ed6d094c1f/users/2ecb9556dca94aa18fec28930f104420/roles/5691bce246d6452990f13933e19f2825` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:33.773379 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:33.786630 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f8487e-6f3a-41f0-9754-03b283fec85b admin admin] RBAC: Authorizing `identity:create_grant(project_id=619a78bbe99040b485a5f3ed6d094c1f, user_id=2ecb9556dca94aa18fec28930f104420, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:33.789339 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f8487e-6f3a-41f0-9754-03b283fec85b admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:33.884716 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1389/2811] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:32:33 2022] PUT /identity/v3/projects/619a78bbe99040b485a5f3ed6d094c1f/users/2ecb9556dca94aa18fec28930f104420/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:33.897403 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee186030-0e91-4d15-9602-9f56445ec4d0 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:33.897854 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee186030-0e91-4d15-9602-9f56445ec4d0 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:33.898223 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee186030-0e91-4d15-9602-9f56445ec4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:33.927156 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-ee186030-0e91-4d15-9602-9f56445ec4d0 None None] MFA Rules not processed for user `2ecb9556dca94aa18fec28930f104420`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:33.928405 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-ee186030-0e91-4d15-9602-9f56445ec4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:33.996689 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1423/2812] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:32:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:34.004554 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8487e-6f3a-41f0-9754-03b283fec85b admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:34.006303 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-31f8487e-6f3a-41f0-9754-03b283fec85b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:34.066269 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8487e-6f3a-41f0-9754-03b283fec85b admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:34.070099 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd6ab2-ed44-42d7-96bf-f1042c081ca2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aae574170d6f4eb8ab70805d8b5f4f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:34.070706 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd6ab2-ed44-42d7-96bf-f1042c081ca2 service glance] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:34.070986 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd6ab2-ed44-42d7-96bf-f1042c081ca2 service glance] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:34.071263 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd6ab2-ed44-42d7-96bf-f1042c081ca2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:34.080074 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd6ab2-ed44-42d7-96bf-f1042c081ca2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:34.081497 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd6ab2-ed44-42d7-96bf-f1042c081ca2 service glance] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:34.085956 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:34.090596 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1390/2813] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:32:34.979187 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c3dc9-e514-44b2-a5ef-906865407f7a None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:34.979883 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c3dc9-e514-44b2-a5ef-906865407f7a None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:34.980189 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c3dc9-e514-44b2-a5ef-906865407f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:35.024338 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-161c3dc9-e514-44b2-a5ef-906865407f7a None None] MFA Rules not processed for user `e3125d45a380477b8380c2ea8a94ccc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:35.025681 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-161c3dc9-e514-44b2-a5ef-906865407f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:35.107432 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1424/2814] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:32:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:36.216356 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b07dd6-0ab0-4440-b167-fd4781bae247 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:36.217204 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b07dd6-0ab0-4440-b167-fd4781bae247 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:36.217477 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b07dd6-0ab0-4440-b167-fd4781bae247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:36.243938 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-d0b07dd6-0ab0-4440-b167-fd4781bae247 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:36.245221 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-d0b07dd6-0ab0-4440-b167-fd4781bae247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:36.311373 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1391/2815] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Aug 8 02:32:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:36.327671 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c3dc9-e514-44b2-a5ef-906865407f7a None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:36.356526 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:36.399974 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c3dc9-e514-44b2-a5ef-906865407f7a None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:36.406199 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c2a3b-d5e2-46d2-89a5-810bc2a7b53f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:36.406825 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c2a3b-d5e2-46d2-89a5-810bc2a7b53f service nova] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:36.407109 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c2a3b-d5e2-46d2-89a5-810bc2a7b53f service nova] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:36.407471 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c2a3b-d5e2-46d2-89a5-810bc2a7b53f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:36.416421 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c2a3b-d5e2-46d2-89a5-810bc2a7b53f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:36.418077 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c2a3b-d5e2-46d2-89a5-810bc2a7b53f service nova] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:36.429058 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1425/2816] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:32:38.613064 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b07dd6-0ab0-4440-b167-fd4781bae247 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:38.614510 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-d0b07dd6-0ab0-4440-b167-fd4781bae247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:38.672725 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b07dd6-0ab0-4440-b167-fd4781bae247 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:38.676267 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0159d40-26c8-46eb-96d9-eb1a6e2ef335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:38.676911 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0159d40-26c8-46eb-96d9-eb1a6e2ef335 service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:38.677144 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0159d40-26c8-46eb-96d9-eb1a6e2ef335 service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:38.677428 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0159d40-26c8-46eb-96d9-eb1a6e2ef335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:38.679248 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-f0159d40-26c8-46eb-96d9-eb1a6e2ef335 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:38.744603 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0159d40-26c8-46eb-96d9-eb1a6e2ef335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:38.746157 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0159d40-26c8-46eb-96d9-eb1a6e2ef335 service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:38.755997 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1392/2817] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:38 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:32:46.527162 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=23 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:48.751407 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=77 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:50.576827 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c2a3b-d5e2-46d2-89a5-810bc2a7b53f service nova] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:50.586826 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c2a3b-d5e2-46d2-89a5-810bc2a7b53f service nova] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:50.592334 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e175dd6-1434-4f7a-b301-9ee3567605e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:50.601858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e175dd6-1434-4f7a-b301-9ee3567605e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:50.601858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e175dd6-1434-4f7a-b301-9ee3567605e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:50.601858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e175dd6-1434-4f7a-b301-9ee3567605e8 admin admin] PATH_INFO: `/v3/users/2ecb9556dca94aa18fec28930f104420` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:50.601858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e175dd6-1434-4f7a-b301-9ee3567605e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ecb9556dca94aa18fec28930f104420)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:50.601858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e175dd6-1434-4f7a-b301-9ee3567605e8 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:50.926711 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-6e175dd6-1434-4f7a-b301-9ee3567605e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ecb9556dca94aa18fec28930f104420'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:51.063780 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-6e175dd6-1434-4f7a-b301-9ee3567605e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ecb9556dca94aa18fec28930f104420'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:51.064433 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-6e175dd6-1434-4f7a-b301-9ee3567605e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ecb9556dca94aa18fec28930f104420'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:51.078485 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-6e175dd6-1434-4f7a-b301-9ee3567605e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ecb9556dca94aa18fec28930f104420'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:51.085929 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-6e175dd6-1434-4f7a-b301-9ee3567605e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ecb9556dca94aa18fec28930f104420'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:51.093028 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1426/2818] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:32:50 2022] DELETE /identity/v3/users/2ecb9556dca94aa18fec28930f104420 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:32:51.098812 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf1c67-1677-4d89-bd1f-4c5444762cd8 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:51.099314 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf1c67-1677-4d89-bd1f-4c5444762cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:51.099494 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf1c67-1677-4d89-bd1f-4c5444762cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:51.118868 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-fbdf1c67-1677-4d89-bd1f-4c5444762cd8 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:51.143391 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-fbdf1c67-1677-4d89-bd1f-4c5444762cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:51.181303 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1393/2819] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:51.245664 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e175dd6-1434-4f7a-b301-9ee3567605e8 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:51.248295 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-6e175dd6-1434-4f7a-b301-9ee3567605e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:51.317278 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e175dd6-1434-4f7a-b301-9ee3567605e8 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:51.320973 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c53d54-e9c7-48e7-b762-e2f8a667f45b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:51.321660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c53d54-e9c7-48e7-b762-e2f8a667f45b service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:51.321966 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c53d54-e9c7-48e7-b762-e2f8a667f45b service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:51.322273 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c53d54-e9c7-48e7-b762-e2f8a667f45b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:51.332051 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c53d54-e9c7-48e7-b762-e2f8a667f45b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:51.333649 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c53d54-e9c7-48e7-b762-e2f8a667f45b service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:51.344718 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1427/2820] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:32:51.911905 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf1c67-1677-4d89-bd1f-4c5444762cd8 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:51.915474 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-fbdf1c67-1677-4d89-bd1f-4c5444762cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:51.930768 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf1c67-1677-4d89-bd1f-4c5444762cd8 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:51.936867 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905ec52-6199-4a8b-8192-188dc8561317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:51.937592 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905ec52-6199-4a8b-8192-188dc8561317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:51.938015 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905ec52-6199-4a8b-8192-188dc8561317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:51.938125 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905ec52-6199-4a8b-8192-188dc8561317 admin admin] PATH_INFO: `/v3/projects/619a78bbe99040b485a5f3ed6d094c1f` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:51.939424 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905ec52-6199-4a8b-8192-188dc8561317 admin admin] RBAC: Authorizing `identity:delete_project(project_id=619a78bbe99040b485a5f3ed6d094c1f)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:51.941460 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905ec52-6199-4a8b-8192-188dc8561317 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:52.088446 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-f905ec52-6199-4a8b-8192-188dc8561317 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '619a78bbe99040b485a5f3ed6d094c1f', 'request_id': 'req-f905ec52-6199-4a8b-8192-188dc8561317'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:52.094876 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-f905ec52-6199-4a8b-8192-188dc8561317 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '619a78bbe99040b485a5f3ed6d094c1f', 'request_id': 'req-f905ec52-6199-4a8b-8192-188dc8561317'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:52.101739 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-f905ec52-6199-4a8b-8192-188dc8561317 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '619a78bbe99040b485a5f3ed6d094c1f', 'request_id': 'req-f905ec52-6199-4a8b-8192-188dc8561317'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:52.243868 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-f905ec52-6199-4a8b-8192-188dc8561317 admin admin] The token cache is being invalidate because project 619a78bbe99040b485a5f3ed6d094c1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:32:52.247644 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-f905ec52-6199-4a8b-8192-188dc8561317 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:52.247644 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-f905ec52-6199-4a8b-8192-188dc8561317 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:32:52.247644 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1394/2821] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:32:51 2022] DELETE /identity/v3/projects/619a78bbe99040b485a5f3ed6d094c1f => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:32:52.251041 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc0848-179f-4fd3-b20a-62ff367dc1a9 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:52.251535 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc0848-179f-4fd3-b20a-62ff367dc1a9 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:52.251873 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc0848-179f-4fd3-b20a-62ff367dc1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:52.272122 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-15cc0848-179f-4fd3-b20a-62ff367dc1a9 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:52.273424 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-15cc0848-179f-4fd3-b20a-62ff367dc1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:52.340961 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1428/2822] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:32:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:52.351557 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e50483-b74d-4d56-be13-0d59d320a342 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:52.351557 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e50483-b74d-4d56-be13-0d59d320a342 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:52.351557 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e50483-b74d-4d56-be13-0d59d320a342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:52.372472 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-89e50483-b74d-4d56-be13-0d59d320a342 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:52.373726 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-89e50483-b74d-4d56-be13-0d59d320a342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:52.382022 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1395/2823] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:32:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:52.386565 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc0848-179f-4fd3-b20a-62ff367dc1a9 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:52.396633 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc0848-179f-4fd3-b20a-62ff367dc1a9 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:52.402458 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1885b-0c6b-49f7-9787-c339549e1981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:52.404115 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1885b-0c6b-49f7-9787-c339549e1981 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:52.404115 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1885b-0c6b-49f7-9787-c339549e1981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:52.404339 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1885b-0c6b-49f7-9787-c339549e1981 admin admin] PATH_INFO: `/v3/domains` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:52.404898 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1885b-0c6b-49f7-9787-c339549e1981 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:32:52.405211 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1885b-0c6b-49f7-9787-c339549e1981 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:52.406952 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1885b-0c6b-49f7-9787-c339549e1981 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:52.420885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1429/2824] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:32:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 02:32:52.425377 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e50483-b74d-4d56-be13-0d59d320a342 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:52.435517 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e50483-b74d-4d56-be13-0d59d320a342 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:52.440385 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ebb62-dff1-49a8-a86c-f6c30a243e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:52.440988 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ebb62-dff1-49a8-a86c-f6c30a243e8a admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:52.441319 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ebb62-dff1-49a8-a86c-f6c30a243e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:52.441539 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ebb62-dff1-49a8-a86c-f6c30a243e8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:52.442171 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ebb62-dff1-49a8-a86c-f6c30a243e8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:52.444095 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ebb62-dff1-49a8-a86c-f6c30a243e8a admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:52.568727 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1396/2825] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:32:52 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:32:52.573022 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1885b-0c6b-49f7-9787-c339549e1981 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:52.578671 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:52.583944 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1885b-0c6b-49f7-9787-c339549e1981 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:52.640690 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae08718-365e-4e0a-a3fa-0ccb46cae1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:52.646148 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae08718-365e-4e0a-a3fa-0ccb46cae1ea admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:52.646148 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae08718-365e-4e0a-a3fa-0ccb46cae1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:52.646148 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae08718-365e-4e0a-a3fa-0ccb46cae1ea admin admin] PATH_INFO: `/v3/users` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:52.646148 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae08718-365e-4e0a-a3fa-0ccb46cae1ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:52.646148 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae08718-365e-4e0a-a3fa-0ccb46cae1ea admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:52.856944 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1430/2826] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:32:52 2022] POST /identity/v3/users => generated 292 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:32:52.864004 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ebb62-dff1-49a8-a86c-f6c30a243e8a admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:52.874153 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ebb62-dff1-49a8-a86c-f6c30a243e8a admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:52.879690 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb964f6-4bce-4d73-889b-769f5f111ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:52.880391 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb964f6-4bce-4d73-889b-769f5f111ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:52.880670 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb964f6-4bce-4d73-889b-769f5f111ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:52.881025 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb964f6-4bce-4d73-889b-769f5f111ed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:52.881717 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb964f6-4bce-4d73-889b-769f5f111ed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:52.883493 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb964f6-4bce-4d73-889b-769f5f111ed1 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:52.894307 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1397/2827] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:32:52.908482 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae08718-365e-4e0a-a3fa-0ccb46cae1ea admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:52.918522 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae08718-365e-4e0a-a3fa-0ccb46cae1ea admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:52.923007 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c5263-992f-4d79-9ea0-7a06d6a34f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:52.923626 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c5263-992f-4d79-9ea0-7a06d6a34f28 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:52.923911 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c5263-992f-4d79-9ea0-7a06d6a34f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:52.924187 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c5263-992f-4d79-9ea0-7a06d6a34f28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:52.924820 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841c5263-992f-4d79-9ea0-7a06d6a34f28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:52.926421 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841c5263-992f-4d79-9ea0-7a06d6a34f28 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:52.937432 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1431/2828] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:32:52.941216 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb964f6-4bce-4d73-889b-769f5f111ed1 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:52.951788 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb964f6-4bce-4d73-889b-769f5f111ed1 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:52.956212 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17d92a-7d36-4d7d-9999-cd08156742bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:52.956842 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17d92a-7d36-4d7d-9999-cd08156742bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:52.957206 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17d92a-7d36-4d7d-9999-cd08156742bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:52.957496 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17d92a-7d36-4d7d-9999-cd08156742bb admin admin] PATH_INFO: `/v3/projects/5f2d474033444b6fad24850db0337226/users/3fa8d9463b5240be8dba856b4724ff0f/roles/5691bce246d6452990f13933e19f2825` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:52.973083 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17d92a-7d36-4d7d-9999-cd08156742bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f2d474033444b6fad24850db0337226, user_id=3fa8d9463b5240be8dba856b4724ff0f, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:52.976006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17d92a-7d36-4d7d-9999-cd08156742bb admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:53.078579 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1398/2829] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:32:52 2022] PUT /identity/v3/projects/5f2d474033444b6fad24850db0337226/users/3fa8d9463b5240be8dba856b4724ff0f/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:32:53.089304 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def9c7c-1326-4f1b-859a-8ba9578a5457 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:53.089460 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def9c7c-1326-4f1b-859a-8ba9578a5457 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:53.089652 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def9c7c-1326-4f1b-859a-8ba9578a5457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:53.116156 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-9def9c7c-1326-4f1b-859a-8ba9578a5457 None None] MFA Rules not processed for user `3fa8d9463b5240be8dba856b4724ff0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:53.117369 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-9def9c7c-1326-4f1b-859a-8ba9578a5457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:53.179298 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1432/2830] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:32:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:32:53.190393 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17d92a-7d36-4d7d-9999-cd08156742bb admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:32:53.192098 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-da17d92a-7d36-4d7d-9999-cd08156742bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:53.213755 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:53.250145 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17d92a-7d36-4d7d-9999-cd08156742bb admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:32:53.253831 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b170ae-1171-40ae-ad85-18198a5d45db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:32:53.254429 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b170ae-1171-40ae-ad85-18198a5d45db service cinder] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:53.254708 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b170ae-1171-40ae-ad85-18198a5d45db service cinder] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:53.254982 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b170ae-1171-40ae-ad85-18198a5d45db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:53.263938 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b170ae-1171-40ae-ad85-18198a5d45db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:32:53.267367 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b170ae-1171-40ae-ad85-18198a5d45db service cinder] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:32:53.274792 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1399/2831] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:32:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:32:54.907107 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c81db7-98af-4d62-9342-a0c9f00e0c0c None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:32:54.910774 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c81db7-98af-4d62-9342-a0c9f00e0c0c None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:32:54.910774 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c81db7-98af-4d62-9342-a0c9f00e0c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:32:54.926732 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-d3c81db7-98af-4d62-9342-a0c9f00e0c0c None None] MFA Rules not processed for user `06d56cf3a0314eb194e44ff2c9ca4b3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:32:54.927952 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-d3c81db7-98af-4d62-9342-a0c9f00e0c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:32:54.982334 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1433/2832] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:32:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:00.969753 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b170ae-1171-40ae-ad85-18198a5d45db service cinder] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:01.046873 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b170ae-1171-40ae-ad85-18198a5d45db service cinder] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:01.046873 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1cf0c-e683-4c4c-90d5-3a63d5075f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:01.046873 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1cf0c-e683-4c4c-90d5-3a63d5075f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:01.046873 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1cf0c-e683-4c4c-90d5-3a63d5075f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:01.047248 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1cf0c-e683-4c4c-90d5-3a63d5075f70 admin admin] PATH_INFO: `/v3/users/3fa8d9463b5240be8dba856b4724ff0f` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:01.047765 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1cf0c-e683-4c4c-90d5-3a63d5075f70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fa8d9463b5240be8dba856b4724ff0f)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:01.049805 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1cf0c-e683-4c4c-90d5-3a63d5075f70 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:01.179181 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c47f42-f610-45a5-97c3-f05dee92c1f5 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:01.179689 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c47f42-f610-45a5-97c3-f05dee92c1f5 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:01.179806 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c47f42-f610-45a5-97c3-f05dee92c1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:01.200191 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-67c47f42-f610-45a5-97c3-f05dee92c1f5 None None] MFA Rules not processed for user `1d39439278814d4faac4cfb1e71aa4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:01.201986 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-67c47f42-f610-45a5-97c3-f05dee92c1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:01.213593 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:01.260689 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c5f1cf0c-e683-4c4c-90d5-3a63d5075f70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fa8d9463b5240be8dba856b4724ff0f'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:01.276383 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1434/2833] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 8 02:33:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:33:01.298240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c47f42-f610-45a5-97c3-f05dee92c1f5 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:01.299773 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-67c47f42-f610-45a5-97c3-f05dee92c1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:01.344290 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c5f1cf0c-e683-4c4c-90d5-3a63d5075f70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fa8d9463b5240be8dba856b4724ff0f'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:01.345535 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c5f1cf0c-e683-4c4c-90d5-3a63d5075f70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fa8d9463b5240be8dba856b4724ff0f'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:01.346466 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c5f1cf0c-e683-4c4c-90d5-3a63d5075f70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fa8d9463b5240be8dba856b4724ff0f'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:01.361108 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-c5f1cf0c-e683-4c4c-90d5-3a63d5075f70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fa8d9463b5240be8dba856b4724ff0f'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:01.380455 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1400/2834] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:33:00 2022] DELETE /identity/v3/users/3fa8d9463b5240be8dba856b4724ff0f => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:01.382137 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16322ef3-ea67-45bd-83f7-92b954e18235 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:01.382746 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16322ef3-ea67-45bd-83f7-92b954e18235 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:01.383023 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16322ef3-ea67-45bd-83f7-92b954e18235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:01.390894 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c47f42-f610-45a5-97c3-f05dee92c1f5 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:01.403204 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-16322ef3-ea67-45bd-83f7-92b954e18235 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:01.404988 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-16322ef3-ea67-45bd-83f7-92b954e18235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:01.446083 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:01.457067 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5551c-79fb-44ac-8368-ac399f0329e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c212009b6a44e1bad92769630116408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:01.457678 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5551c-79fb-44ac-8368-ac399f0329e8 service swift] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:01.457958 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5551c-79fb-44ac-8368-ac399f0329e8 service swift] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:01.458240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5551c-79fb-44ac-8368-ac399f0329e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:01.460074 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-02a5551c-79fb-44ac-8368-ac399f0329e8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:01.468186 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1401/2835] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:33:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:01.478058 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16322ef3-ea67-45bd-83f7-92b954e18235 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:01.479568 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-16322ef3-ea67-45bd-83f7-92b954e18235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:01.523797 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5551c-79fb-44ac-8368-ac399f0329e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:01.525382 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5551c-79fb-44ac-8368-ac399f0329e8 service swift] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:01.533571 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1435/2836] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 8 02:33:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 08 02:33:01.536961 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16322ef3-ea67-45bd-83f7-92b954e18235 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:01.540701 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17dc37-c050-4b23-854f-8cb381d0c8cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:01.541338 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17dc37-c050-4b23-854f-8cb381d0c8cb service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:01.541671 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17dc37-c050-4b23-854f-8cb381d0c8cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:01.541946 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17dc37-c050-4b23-854f-8cb381d0c8cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:01.558531 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17dc37-c050-4b23-854f-8cb381d0c8cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:01.558531 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17dc37-c050-4b23-854f-8cb381d0c8cb service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:01.568159 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1402/2837] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:33:02.042135 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5551c-79fb-44ac-8368-ac399f0329e8 service swift] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:02.044350 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-02a5551c-79fb-44ac-8368-ac399f0329e8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:02.055226 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=100 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:02.063829 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5551c-79fb-44ac-8368-ac399f0329e8 service swift] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:02.068772 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af406f7-3e2b-450d-b95b-aa1380a59563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:02.069408 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af406f7-3e2b-450d-b95b-aa1380a59563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:02.069681 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af406f7-3e2b-450d-b95b-aa1380a59563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:02.069963 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af406f7-3e2b-450d-b95b-aa1380a59563 admin admin] PATH_INFO: `/v3/projects/5f2d474033444b6fad24850db0337226` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:02.071094 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af406f7-3e2b-450d-b95b-aa1380a59563 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f2d474033444b6fad24850db0337226)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:02.073259 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af406f7-3e2b-450d-b95b-aa1380a59563 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:02.185946 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-5af406f7-3e2b-450d-b95b-aa1380a59563 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f2d474033444b6fad24850db0337226', 'request_id': 'req-5af406f7-3e2b-450d-b95b-aa1380a59563'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:02.191712 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-5af406f7-3e2b-450d-b95b-aa1380a59563 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f2d474033444b6fad24850db0337226', 'request_id': 'req-5af406f7-3e2b-450d-b95b-aa1380a59563'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:02.197959 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-5af406f7-3e2b-450d-b95b-aa1380a59563 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f2d474033444b6fad24850db0337226', 'request_id': 'req-5af406f7-3e2b-450d-b95b-aa1380a59563'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:02.270035 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-5af406f7-3e2b-450d-b95b-aa1380a59563 admin admin] The token cache is being invalidate because project 5f2d474033444b6fad24850db0337226 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:33:02.270489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-5af406f7-3e2b-450d-b95b-aa1380a59563 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:02.271074 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-5af406f7-3e2b-450d-b95b-aa1380a59563 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:02.272521 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1436/2838] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:33:02 2022] DELETE /identity/v3/projects/5f2d474033444b6fad24850db0337226 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:02.277396 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e5b27-389e-4d51-bf0d-7e0cb76ee51b None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:02.278212 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e5b27-389e-4d51-bf0d-7e0cb76ee51b None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:02.278656 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e5b27-389e-4d51-bf0d-7e0cb76ee51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:02.298542 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-b83e5b27-389e-4d51-bf0d-7e0cb76ee51b None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:02.299773 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-b83e5b27-389e-4d51-bf0d-7e0cb76ee51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:02.360000 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1403/2839] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:33:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:02.368114 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c1d5d-e491-4c1a-aaed-9af20c2b5bec None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:02.368407 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c1d5d-e491-4c1a-aaed-9af20c2b5bec None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:02.368682 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c1d5d-e491-4c1a-aaed-9af20c2b5bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:02.392475 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-346c1d5d-e491-4c1a-aaed-9af20c2b5bec None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:02.393704 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-346c1d5d-e491-4c1a-aaed-9af20c2b5bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:02.402332 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1437/2840] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:33:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:02.406700 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e5b27-389e-4d51-bf0d-7e0cb76ee51b None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:02.416483 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e5b27-389e-4d51-bf0d-7e0cb76ee51b None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:02.421829 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf45e668-b9bb-4ddb-992a-2102532f5bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:02.422434 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45e668-b9bb-4ddb-992a-2102532f5bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:02.422723 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45e668-b9bb-4ddb-992a-2102532f5bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:02.423005 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45e668-b9bb-4ddb-992a-2102532f5bc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:02.423730 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf45e668-b9bb-4ddb-992a-2102532f5bc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:33:02.424061 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf45e668-b9bb-4ddb-992a-2102532f5bc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:02.425822 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf45e668-b9bb-4ddb-992a-2102532f5bc4 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:02.425952 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfb2af-eba9-4c36-acab-15659970941c None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:02.426143 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfb2af-eba9-4c36-acab-15659970941c None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:02.426421 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfb2af-eba9-4c36-acab-15659970941c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:02.438225 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1404/2841] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:33:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:33:02.442519 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf45e668-b9bb-4ddb-992a-2102532f5bc4 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:02.446467 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-59dfb2af-eba9-4c36-acab-15659970941c None None] MFA Rules not processed for user `1d39439278814d4faac4cfb1e71aa4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:02.448740 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-59dfb2af-eba9-4c36-acab-15659970941c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:02.452376 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf45e668-b9bb-4ddb-992a-2102532f5bc4 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:02.457124 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b206895-f588-4c17-960e-b83a03602359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:02.457728 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b206895-f588-4c17-960e-b83a03602359 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:02.458015 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b206895-f588-4c17-960e-b83a03602359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:02.458296 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b206895-f588-4c17-960e-b83a03602359 admin admin] PATH_INFO: `/v3/projects` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:02.458919 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b206895-f588-4c17-960e-b83a03602359 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:02.460836 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b206895-f588-4c17-960e-b83a03602359 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:02.506232 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1438/2842] 10.222.0.23 () {58 vars in 967 bytes} [Mon Aug 8 02:33:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:33:02.518926 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfb2af-eba9-4c36-acab-15659970941c None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:02.520246 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-59dfb2af-eba9-4c36-acab-15659970941c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:02.568705 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1405/2843] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:33:02 2022] POST /identity/v3/projects => generated 377 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:33:02.572720 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b206895-f588-4c17-960e-b83a03602359 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:02.594709 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfb2af-eba9-4c36-acab-15659970941c None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:02.622137 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:02.625910 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:02.636963 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b206895-f588-4c17-960e-b83a03602359 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:02.642232 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef4f4d-7461-4aee-bd65-fcb28a0b48ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:02.642834 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef4f4d-7461-4aee-bd65-fcb28a0b48ab admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:02.643120 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef4f4d-7461-4aee-bd65-fcb28a0b48ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:02.643425 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef4f4d-7461-4aee-bd65-fcb28a0b48ab admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:02.644047 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef4f4d-7461-4aee-bd65-fcb28a0b48ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:02.645958 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef4f4d-7461-4aee-bd65-fcb28a0b48ab admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:02.655656 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff850e-3c9c-489d-89b0-04aecd6a6f21 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c212009b6a44e1bad92769630116408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:02.656268 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff850e-3c9c-489d-89b0-04aecd6a6f21 service swift] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:02.656551 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff850e-3c9c-489d-89b0-04aecd6a6f21 service swift] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:02.656929 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff850e-3c9c-489d-89b0-04aecd6a6f21 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:02.710086 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff850e-3c9c-489d-89b0-04aecd6a6f21 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:02.711689 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff850e-3c9c-489d-89b0-04aecd6a6f21 service swift] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:02.719863 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1439/2844] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 8 02:33:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 08 02:33:02.765208 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1406/2845] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:33:02 2022] POST /identity/v3/users => generated 289 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 02:33:02.769378 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff850e-3c9c-489d-89b0-04aecd6a6f21 service swift] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:02.780230 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff850e-3c9c-489d-89b0-04aecd6a6f21 service swift] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:02.784805 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d526795-42d7-494d-aaf5-ae1a91b7a1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:02.785490 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d526795-42d7-494d-aaf5-ae1a91b7a1e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:02.785991 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d526795-42d7-494d-aaf5-ae1a91b7a1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:02.786421 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d526795-42d7-494d-aaf5-ae1a91b7a1e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:02.787437 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d526795-42d7-494d-aaf5-ae1a91b7a1e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:02.789952 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d526795-42d7-494d-aaf5-ae1a91b7a1e7 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:02.798772 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1440/2846] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:02.802778 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef4f4d-7461-4aee-bd65-fcb28a0b48ab admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:02.813241 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef4f4d-7461-4aee-bd65-fcb28a0b48ab admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:02.818059 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d5449-e3c8-4611-ab6f-db9d332ca279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:02.818652 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d5449-e3c8-4611-ab6f-db9d332ca279 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:02.818923 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d5449-e3c8-4611-ab6f-db9d332ca279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:02.819223 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d5449-e3c8-4611-ab6f-db9d332ca279 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:02.819893 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d5449-e3c8-4611-ab6f-db9d332ca279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:02.821464 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d5449-e3c8-4611-ab6f-db9d332ca279 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:02.832031 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1407/2847] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:33:02.835992 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d526795-42d7-494d-aaf5-ae1a91b7a1e7 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:02.846345 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d526795-42d7-494d-aaf5-ae1a91b7a1e7 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:02.851112 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58e923-e288-4ba4-ba56-9c360453ad2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:02.851784 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58e923-e288-4ba4-ba56-9c360453ad2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:02.852068 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58e923-e288-4ba4-ba56-9c360453ad2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:02.852368 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58e923-e288-4ba4-ba56-9c360453ad2a admin admin] PATH_INFO: `/v3/projects/3b1243a02ce84785a1f1e3a6ebd54329/users/bcc0a386c73448bb9568a761e1864fa8/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:02.867010 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58e923-e288-4ba4-ba56-9c360453ad2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b1243a02ce84785a1f1e3a6ebd54329, user_id=bcc0a386c73448bb9568a761e1864fa8, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:02.869664 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58e923-e288-4ba4-ba56-9c360453ad2a admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:02.935870 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1441/2848] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:33:02 2022] PUT /identity/v3/projects/3b1243a02ce84785a1f1e3a6ebd54329/users/bcc0a386c73448bb9568a761e1864fa8/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:02.947041 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56bdf63-1571-4382-9bad-ae34e8b47c10 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:02.947333 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56bdf63-1571-4382-9bad-ae34e8b47c10 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:02.947645 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56bdf63-1571-4382-9bad-ae34e8b47c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:02.980686 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-b56bdf63-1571-4382-9bad-ae34e8b47c10 None None] MFA Rules not processed for user `bcc0a386c73448bb9568a761e1864fa8`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:02.981894 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-b56bdf63-1571-4382-9bad-ae34e8b47c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:03.047339 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1408/2849] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:33:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:03.058867 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58e923-e288-4ba4-ba56-9c360453ad2a admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:03.061442 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-2b58e923-e288-4ba4-ba56-9c360453ad2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:03.119263 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58e923-e288-4ba4-ba56-9c360453ad2a admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:03.123145 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631fe241-2d7e-4f5d-8248-a80044c1d77a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63640b6bedd4e64b16657a34eb40f3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:03.123783 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fe241-2d7e-4f5d-8248-a80044c1d77a service cinder] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:03.124068 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fe241-2d7e-4f5d-8248-a80044c1d77a service cinder] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:03.124347 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fe241-2d7e-4f5d-8248-a80044c1d77a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:03.132444 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631fe241-2d7e-4f5d-8248-a80044c1d77a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:03.133860 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631fe241-2d7e-4f5d-8248-a80044c1d77a service cinder] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:03.143212 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1442/2850] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:03.491843 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35e96d-fd13-459c-9125-6fd3b4d1062c None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:03.492295 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35e96d-fd13-459c-9125-6fd3b4d1062c None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:03.492401 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35e96d-fd13-459c-9125-6fd3b4d1062c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:03.511567 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-8b35e96d-fd13-459c-9125-6fd3b4d1062c None None] MFA Rules not processed for user `1d39439278814d4faac4cfb1e71aa4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:03.513506 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-8b35e96d-fd13-459c-9125-6fd3b4d1062c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:03.569575 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1409/2851] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 8 02:33:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:03.581854 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631fe241-2d7e-4f5d-8248-a80044c1d77a service cinder] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:03.621358 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:03.646814 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631fe241-2d7e-4f5d-8248-a80044c1d77a service cinder] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:03.651889 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9070fc-f732-4caa-a308-59fe23cf7aac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c212009b6a44e1bad92769630116408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:03.659415 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9070fc-f732-4caa-a308-59fe23cf7aac service swift] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:03.659415 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9070fc-f732-4caa-a308-59fe23cf7aac service swift] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:03.659415 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9070fc-f732-4caa-a308-59fe23cf7aac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:03.660945 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9070fc-f732-4caa-a308-59fe23cf7aac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:03.662508 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9070fc-f732-4caa-a308-59fe23cf7aac service swift] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:03.670554 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1443/2852] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 8 02:33:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:33:04.356968 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986198b1-fe36-4448-81f1-a1415a9e79a9 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:04.357251 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986198b1-fe36-4448-81f1-a1415a9e79a9 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:04.357623 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986198b1-fe36-4448-81f1-a1415a9e79a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:04.377592 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-986198b1-fe36-4448-81f1-a1415a9e79a9 None None] MFA Rules not processed for user `1d39439278814d4faac4cfb1e71aa4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:04.378732 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-986198b1-fe36-4448-81f1-a1415a9e79a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:04.386010 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1410/2853] 10.222.0.23 () {58 vars in 967 bytes} [Mon Aug 8 02:33:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:04.401875 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9070fc-f732-4caa-a308-59fe23cf7aac service swift] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:04.413654 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9070fc-f732-4caa-a308-59fe23cf7aac service swift] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:04.418602 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5405307-caab-49f9-baac-56b273fcec68 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c212009b6a44e1bad92769630116408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:04.419225 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5405307-caab-49f9-baac-56b273fcec68 service swift] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:04.419643 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5405307-caab-49f9-baac-56b273fcec68 service swift] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:04.419924 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5405307-caab-49f9-baac-56b273fcec68 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:04.428820 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5405307-caab-49f9-baac-56b273fcec68 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:04.430450 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5405307-caab-49f9-baac-56b273fcec68 service swift] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:04.438896 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1444/2854] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 8 02:33:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 08 02:33:07.240976 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986198b1-fe36-4448-81f1-a1415a9e79a9 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:07.242550 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-986198b1-fe36-4448-81f1-a1415a9e79a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:07.307485 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:07.385919 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986198b1-fe36-4448-81f1-a1415a9e79a9 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:07.390835 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf3cf0-188b-4297-9e23-c2364eb32332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:07.391545 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf3cf0-188b-4297-9e23-c2364eb32332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:07.391854 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf3cf0-188b-4297-9e23-c2364eb32332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:07.392113 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf3cf0-188b-4297-9e23-c2364eb32332 admin admin] PATH_INFO: `/v3/users/e3125d45a380477b8380c2ea8a94ccc0` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:07.393249 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf3cf0-188b-4297-9e23-c2364eb32332 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3125d45a380477b8380c2ea8a94ccc0)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:07.395282 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf3cf0-188b-4297-9e23-c2364eb32332 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:07.600527 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-8fbf3cf0-188b-4297-9e23-c2364eb32332 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3125d45a380477b8380c2ea8a94ccc0'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:07.689688 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-8fbf3cf0-188b-4297-9e23-c2364eb32332 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3125d45a380477b8380c2ea8a94ccc0'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:07.690327 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-8fbf3cf0-188b-4297-9e23-c2364eb32332 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3125d45a380477b8380c2ea8a94ccc0'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:07.690941 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-8fbf3cf0-188b-4297-9e23-c2364eb32332 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3125d45a380477b8380c2ea8a94ccc0'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:07.703570 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-8fbf3cf0-188b-4297-9e23-c2364eb32332 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3125d45a380477b8380c2ea8a94ccc0'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:07.716702 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1411/2855] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:33:07 2022] DELETE /identity/v3/users/e3125d45a380477b8380c2ea8a94ccc0 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:07.722115 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9caf3b9-a0c4-4770-8e87-1072afddf171 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:07.722557 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9caf3b9-a0c4-4770-8e87-1072afddf171 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:07.726789 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9caf3b9-a0c4-4770-8e87-1072afddf171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:07.752975 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-b9caf3b9-a0c4-4770-8e87-1072afddf171 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:07.755050 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-b9caf3b9-a0c4-4770-8e87-1072afddf171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:07.812958 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1445/2856] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:33:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:07.823386 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf3cf0-188b-4297-9e23-c2364eb32332 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:07.824996 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-8fbf3cf0-188b-4297-9e23-c2364eb32332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:07.900114 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf3cf0-188b-4297-9e23-c2364eb32332 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:07.903804 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1775469-7fea-42c3-8c4f-258cb77e97d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:07.904397 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1775469-7fea-42c3-8c4f-258cb77e97d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:07.904745 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1775469-7fea-42c3-8c4f-258cb77e97d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:07.905587 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1775469-7fea-42c3-8c4f-258cb77e97d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:07.914802 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1775469-7fea-42c3-8c4f-258cb77e97d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:07.916314 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1775469-7fea-42c3-8c4f-258cb77e97d1 service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:07.925683 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1412/2857] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:08.186551 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9caf3b9-a0c4-4770-8e87-1072afddf171 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:08.194398 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-b9caf3b9-a0c4-4770-8e87-1072afddf171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:08.205467 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9caf3b9-a0c4-4770-8e87-1072afddf171 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:08.211026 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dff8bc-ae38-45ee-86d2-4bd0f448e9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:08.211697 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dff8bc-ae38-45ee-86d2-4bd0f448e9ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:08.212170 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dff8bc-ae38-45ee-86d2-4bd0f448e9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:08.212458 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dff8bc-ae38-45ee-86d2-4bd0f448e9ce admin admin] PATH_INFO: `/v3/projects/2930b32d1eec41f79195cf50c2f724d3` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:08.213851 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dff8bc-ae38-45ee-86d2-4bd0f448e9ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=2930b32d1eec41f79195cf50c2f724d3)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:08.216177 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dff8bc-ae38-45ee-86d2-4bd0f448e9ce admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:08.359479 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-a1dff8bc-ae38-45ee-86d2-4bd0f448e9ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2930b32d1eec41f79195cf50c2f724d3', 'request_id': 'req-a1dff8bc-ae38-45ee-86d2-4bd0f448e9ce'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:08.365062 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-a1dff8bc-ae38-45ee-86d2-4bd0f448e9ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2930b32d1eec41f79195cf50c2f724d3', 'request_id': 'req-a1dff8bc-ae38-45ee-86d2-4bd0f448e9ce'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:08.371564 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-a1dff8bc-ae38-45ee-86d2-4bd0f448e9ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2930b32d1eec41f79195cf50c2f724d3', 'request_id': 'req-a1dff8bc-ae38-45ee-86d2-4bd0f448e9ce'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:08.449449 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-a1dff8bc-ae38-45ee-86d2-4bd0f448e9ce admin admin] The token cache is being invalidate because project 2930b32d1eec41f79195cf50c2f724d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:33:08.449676 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-a1dff8bc-ae38-45ee-86d2-4bd0f448e9ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:08.450255 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-a1dff8bc-ae38-45ee-86d2-4bd0f448e9ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:08.451830 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1446/2858] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:33:08 2022] DELETE /identity/v3/projects/2930b32d1eec41f79195cf50c2f724d3 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:13.155673 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db266698-1009-40a1-9d60-f99b02cdcb2f None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:13.156188 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db266698-1009-40a1-9d60-f99b02cdcb2f None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:13.156302 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db266698-1009-40a1-9d60-f99b02cdcb2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:13.161036 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:13.205515 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-db266698-1009-40a1-9d60-f99b02cdcb2f None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:13.206706 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-db266698-1009-40a1-9d60-f99b02cdcb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:13.266006 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1413/2859] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Aug 8 02:33:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:13.282137 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dff8bc-ae38-45ee-86d2-4bd0f448e9ce admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:13.283649 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-a1dff8bc-ae38-45ee-86d2-4bd0f448e9ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:13.319900 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:13.387075 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dff8bc-ae38-45ee-86d2-4bd0f448e9ce admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:13.392764 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d288fc-5e41-4afb-adcd-b04cd9a77a07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:13.393369 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d288fc-5e41-4afb-adcd-b04cd9a77a07 service nova] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:13.393650 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d288fc-5e41-4afb-adcd-b04cd9a77a07 service nova] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:13.393924 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d288fc-5e41-4afb-adcd-b04cd9a77a07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:13.402311 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d288fc-5e41-4afb-adcd-b04cd9a77a07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:13.403919 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d288fc-5e41-4afb-adcd-b04cd9a77a07 service nova] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:13.413527 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1447/2860] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:15.099622 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db266698-1009-40a1-9d60-f99b02cdcb2f None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:15.101095 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-db266698-1009-40a1-9d60-f99b02cdcb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:15.199966 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db266698-1009-40a1-9d60-f99b02cdcb2f None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:15.207940 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61db084-76fd-4d38-afcb-8d34d78d6eb3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43a39dd539974180a8165e34de57b552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:15.208633 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61db084-76fd-4d38-afcb-8d34d78d6eb3 service placement] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:15.208916 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61db084-76fd-4d38-afcb-8d34d78d6eb3 service placement] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:15.210656 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61db084-76fd-4d38-afcb-8d34d78d6eb3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:15.212074 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-c61db084-76fd-4d38-afcb-8d34d78d6eb3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:15.226511 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61db084-76fd-4d38-afcb-8d34d78d6eb3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:15.228803 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61db084-76fd-4d38-afcb-8d34d78d6eb3 service placement] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:15.243170 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1414/2861] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:16.756588 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3924bb1-2645-4624-ac2a-207ddb7eb557 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:16.757147 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3924bb1-2645-4624-ac2a-207ddb7eb557 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:16.757147 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3924bb1-2645-4624-ac2a-207ddb7eb557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:16.776737 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-a3924bb1-2645-4624-ac2a-207ddb7eb557 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:16.778006 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-a3924bb1-2645-4624-ac2a-207ddb7eb557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:16.785856 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1448/2862] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Aug 8 02:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:16.804653 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61db084-76fd-4d38-afcb-8d34d78d6eb3 service placement] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:16.819034 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61db084-76fd-4d38-afcb-8d34d78d6eb3 service placement] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:16.825220 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f37979-4caa-47cf-974c-df184cd7c6b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:16.825827 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f37979-4caa-47cf-974c-df184cd7c6b7 service nova] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:16.826109 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f37979-4caa-47cf-974c-df184cd7c6b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:16.826384 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f37979-4caa-47cf-974c-df184cd7c6b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:16.835755 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f37979-4caa-47cf-974c-df184cd7c6b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:16.837369 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f37979-4caa-47cf-974c-df184cd7c6b7 service nova] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:16.847413 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1415/2863] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:18.933673 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3924bb1-2645-4624-ac2a-207ddb7eb557 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:18.935114 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-a3924bb1-2645-4624-ac2a-207ddb7eb557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:18.946749 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3924bb1-2645-4624-ac2a-207ddb7eb557 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:18.951293 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec4f85-78e6-4e11-8d11-694bcc27951e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:18.951937 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec4f85-78e6-4e11-8d11-694bcc27951e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:18.952219 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec4f85-78e6-4e11-8d11-694bcc27951e admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:18.952491 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec4f85-78e6-4e11-8d11-694bcc27951e admin admin] PATH_INFO: `/v3/users/bcc0a386c73448bb9568a761e1864fa8` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:18.954091 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec4f85-78e6-4e11-8d11-694bcc27951e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcc0a386c73448bb9568a761e1864fa8)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:18.956023 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec4f85-78e6-4e11-8d11-694bcc27951e admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:19.185630 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-88ec4f85-78e6-4e11-8d11-694bcc27951e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcc0a386c73448bb9568a761e1864fa8'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:19.264097 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-88ec4f85-78e6-4e11-8d11-694bcc27951e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcc0a386c73448bb9568a761e1864fa8'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:19.264717 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-88ec4f85-78e6-4e11-8d11-694bcc27951e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcc0a386c73448bb9568a761e1864fa8'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:19.277423 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-88ec4f85-78e6-4e11-8d11-694bcc27951e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcc0a386c73448bb9568a761e1864fa8'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:19.284154 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-88ec4f85-78e6-4e11-8d11-694bcc27951e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcc0a386c73448bb9568a761e1864fa8'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:19.289946 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1449/2864] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:33:18 2022] DELETE /identity/v3/users/bcc0a386c73448bb9568a761e1864fa8 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:19.294474 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285edac-75bb-44c7-b4fd-e2b73ea1cd31 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:19.294932 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285edac-75bb-44c7-b4fd-e2b73ea1cd31 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:19.295027 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285edac-75bb-44c7-b4fd-e2b73ea1cd31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:19.313886 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-4285edac-75bb-44c7-b4fd-e2b73ea1cd31 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:19.315059 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-4285edac-75bb-44c7-b4fd-e2b73ea1cd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:19.344969 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=100 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:19.373830 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1416/2865] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:19.391832 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec4f85-78e6-4e11-8d11-694bcc27951e admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:19.391832 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-88ec4f85-78e6-4e11-8d11-694bcc27951e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:19.447054 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec4f85-78e6-4e11-8d11-694bcc27951e admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:19.450591 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d7199-25e8-4cc3-8db6-94af9efb2561 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:19.451190 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d7199-25e8-4cc3-8db6-94af9efb2561 service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:19.451506 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d7199-25e8-4cc3-8db6-94af9efb2561 service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:19.451784 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d7199-25e8-4cc3-8db6-94af9efb2561 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:19.462180 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d7199-25e8-4cc3-8db6-94af9efb2561 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:19.463702 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d7199-25e8-4cc3-8db6-94af9efb2561 service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:19.468000 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:19.474544 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1450/2866] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:19.589211 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0db31d-d2f4-42a7-bb55-41f7532c77f1 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:19.589499 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0db31d-d2f4-42a7-bb55-41f7532c77f1 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:19.590028 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0db31d-d2f4-42a7-bb55-41f7532c77f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:19.610497 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-2a0db31d-d2f4-42a7-bb55-41f7532c77f1 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:19.611736 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-2a0db31d-d2f4-42a7-bb55-41f7532c77f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:19.619550 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1417/2867] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Aug 8 02:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:19.634271 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d7199-25e8-4cc3-8db6-94af9efb2561 service neutron] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:19.635686 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-389d7199-25e8-4cc3-8db6-94af9efb2561 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:19.709550 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d7199-25e8-4cc3-8db6-94af9efb2561 service neutron] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:19.716096 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97061437-3a32-4003-8912-3dc931fbd680 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:19.716783 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97061437-3a32-4003-8912-3dc931fbd680 service nova] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:19.717062 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97061437-3a32-4003-8912-3dc931fbd680 service nova] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:19.717334 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97061437-3a32-4003-8912-3dc931fbd680 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:19.728228 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97061437-3a32-4003-8912-3dc931fbd680 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:19.730061 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97061437-3a32-4003-8912-3dc931fbd680 service nova] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:19.743474 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1451/2868] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:20.045458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0db31d-d2f4-42a7-bb55-41f7532c77f1 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:20.046903 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-2a0db31d-d2f4-42a7-bb55-41f7532c77f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:20.060203 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0db31d-d2f4-42a7-bb55-41f7532c77f1 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:20.065337 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b4120-926c-4ec7-b60d-5b737ccbe19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:20.066049 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b4120-926c-4ec7-b60d-5b737ccbe19a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:20.066333 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b4120-926c-4ec7-b60d-5b737ccbe19a admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:20.066610 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b4120-926c-4ec7-b60d-5b737ccbe19a admin admin] PATH_INFO: `/v3/projects/3b1243a02ce84785a1f1e3a6ebd54329` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:20.067856 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b4120-926c-4ec7-b60d-5b737ccbe19a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b1243a02ce84785a1f1e3a6ebd54329)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:20.069786 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b4120-926c-4ec7-b60d-5b737ccbe19a admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:20.176134 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-200b4120-926c-4ec7-b60d-5b737ccbe19a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b1243a02ce84785a1f1e3a6ebd54329', 'request_id': 'req-200b4120-926c-4ec7-b60d-5b737ccbe19a'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:20.181591 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-200b4120-926c-4ec7-b60d-5b737ccbe19a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b1243a02ce84785a1f1e3a6ebd54329', 'request_id': 'req-200b4120-926c-4ec7-b60d-5b737ccbe19a'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:20.187665 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-200b4120-926c-4ec7-b60d-5b737ccbe19a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b1243a02ce84785a1f1e3a6ebd54329', 'request_id': 'req-200b4120-926c-4ec7-b60d-5b737ccbe19a'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:20.265191 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-200b4120-926c-4ec7-b60d-5b737ccbe19a admin admin] The token cache is being invalidate because project 3b1243a02ce84785a1f1e3a6ebd54329 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:33:20.265473 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-200b4120-926c-4ec7-b60d-5b737ccbe19a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:20.266682 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-200b4120-926c-4ec7-b60d-5b737ccbe19a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:33:20.268224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1418/2869] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:33:20 2022] DELETE /identity/v3/projects/3b1243a02ce84785a1f1e3a6ebd54329 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:33:22.870977 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095a611-169c-43fb-a25e-f12f73b8173a None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:22.871587 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095a611-169c-43fb-a25e-f12f73b8173a None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:22.871690 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095a611-169c-43fb-a25e-f12f73b8173a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:22.892742 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-3095a611-169c-43fb-a25e-f12f73b8173a None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:22.893944 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-3095a611-169c-43fb-a25e-f12f73b8173a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:22.952629 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1452/2870] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Aug 8 02:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 02:33:22.970595 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b4120-926c-4ec7-b60d-5b737ccbe19a admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:22.972009 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-200b4120-926c-4ec7-b60d-5b737ccbe19a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:23.049081 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b4120-926c-4ec7-b60d-5b737ccbe19a admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:23.054794 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c763d-f7a5-4c35-8d0d-55c7f552ded0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:23.055496 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c763d-f7a5-4c35-8d0d-55c7f552ded0 service nova] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:23.055780 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c763d-f7a5-4c35-8d0d-55c7f552ded0 service nova] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:23.056058 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c763d-f7a5-4c35-8d0d-55c7f552ded0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:23.064832 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c763d-f7a5-4c35-8d0d-55c7f552ded0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:23.069478 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c763d-f7a5-4c35-8d0d-55c7f552ded0 service nova] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:23.076031 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1419/2871] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:33:26.156324 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6373aa3-4624-406f-a030-db360c1f07c9 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:26.156864 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6373aa3-4624-406f-a030-db360c1f07c9 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:26.156973 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6373aa3-4624-406f-a030-db360c1f07c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:26.176805 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-e6373aa3-4624-406f-a030-db360c1f07c9 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:33:26.177986 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-e6373aa3-4624-406f-a030-db360c1f07c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:33:26.185743 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1453/2872] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Aug 8 02:33:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:33:26.212051 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c763d-f7a5-4c35-8d0d-55c7f552ded0 service nova] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:26.223902 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c763d-f7a5-4c35-8d0d-55c7f552ded0 service nova] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:33:26.229394 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89afec0-8276-488b-9c9f-9769f3826825 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:33:26.229965 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89afec0-8276-488b-9c9f-9769f3826825 service nova] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:33:26.230247 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89afec0-8276-488b-9c9f-9769f3826825 service nova] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:33:26.230522 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89afec0-8276-488b-9c9f-9769f3826825 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:33:26.239114 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89afec0-8276-488b-9c9f-9769f3826825 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:33:26.240696 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89afec0-8276-488b-9c9f-9769f3826825 service nova] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:33:26.250930 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1420/2873] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:33:36.171710 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=65 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:36.245913 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=81,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:59.941744 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6373aa3-4624-406f-a030-db360c1f07c9 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:33:59.943153 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-e6373aa3-4624-406f-a030-db360c1f07c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:00.012440 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6373aa3-4624-406f-a030-db360c1f07c9 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:00.017653 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bd756-43a1-4126-b333-1bf5f0be294d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43a39dd539974180a8165e34de57b552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:00.018268 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bd756-43a1-4126-b333-1bf5f0be294d service placement] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:00.018552 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bd756-43a1-4126-b333-1bf5f0be294d service placement] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:00.018828 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bd756-43a1-4126-b333-1bf5f0be294d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:00.020593 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-974bd756-43a1-4126-b333-1bf5f0be294d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:00.033424 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974bd756-43a1-4126-b333-1bf5f0be294d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:00.035050 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974bd756-43a1-4126-b333-1bf5f0be294d service placement] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:00.046580 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1454/2874] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:33:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:00.170301 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89afec0-8276-488b-9c9f-9769f3826825 service nova] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:00.171805 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-b89afec0-8276-488b-9c9f-9769f3826825 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:00.185434 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89afec0-8276-488b-9c9f-9769f3826825 service nova] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:00.190322 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5cf020-1ecb-45e2-9cfc-3b3bd878d08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:00.190910 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cf020-1ecb-45e2-9cfc-3b3bd878d08f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:00.191200 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cf020-1ecb-45e2-9cfc-3b3bd878d08f admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:00.192256 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cf020-1ecb-45e2-9cfc-3b3bd878d08f admin admin] PATH_INFO: `/v3/users/06d56cf3a0314eb194e44ff2c9ca4b3b` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:00.194261 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5cf020-1ecb-45e2-9cfc-3b3bd878d08f admin admin] RBAC: Authorizing `identity:delete_user(user_id=06d56cf3a0314eb194e44ff2c9ca4b3b)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:00.196236 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5cf020-1ecb-45e2-9cfc-3b3bd878d08f admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:00.488907 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-9b5cf020-1ecb-45e2-9cfc-3b3bd878d08f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06d56cf3a0314eb194e44ff2c9ca4b3b'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:00.603935 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-9b5cf020-1ecb-45e2-9cfc-3b3bd878d08f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06d56cf3a0314eb194e44ff2c9ca4b3b'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:00.604557 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-9b5cf020-1ecb-45e2-9cfc-3b3bd878d08f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06d56cf3a0314eb194e44ff2c9ca4b3b'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:00.605162 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-9b5cf020-1ecb-45e2-9cfc-3b3bd878d08f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06d56cf3a0314eb194e44ff2c9ca4b3b'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:00.618046 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-9b5cf020-1ecb-45e2-9cfc-3b3bd878d08f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06d56cf3a0314eb194e44ff2c9ca4b3b'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:00.630343 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1421/2875] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:00 2022] DELETE /identity/v3/users/06d56cf3a0314eb194e44ff2c9ca4b3b => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:00.888820 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bd756-43a1-4126-b333-1bf5f0be294d service placement] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:00.907665 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bd756-43a1-4126-b333-1bf5f0be294d service placement] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:00.995830 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590cfc59-834a-4ab5-a13b-a9228ca66693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:00.996550 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590cfc59-834a-4ab5-a13b-a9228ca66693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:00.996899 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590cfc59-834a-4ab5-a13b-a9228ca66693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:00.997240 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590cfc59-834a-4ab5-a13b-a9228ca66693 admin admin] PATH_INFO: `/v3/projects/d8014abf90124e639ec68832c03b2bea` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:00.998536 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590cfc59-834a-4ab5-a13b-a9228ca66693 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8014abf90124e639ec68832c03b2bea)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:01.000606 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590cfc59-834a-4ab5-a13b-a9228ca66693 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:01.135574 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-590cfc59-834a-4ab5-a13b-a9228ca66693 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8014abf90124e639ec68832c03b2bea', 'request_id': 'req-590cfc59-834a-4ab5-a13b-a9228ca66693'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:01.140955 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-590cfc59-834a-4ab5-a13b-a9228ca66693 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8014abf90124e639ec68832c03b2bea', 'request_id': 'req-590cfc59-834a-4ab5-a13b-a9228ca66693'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:01.147068 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-590cfc59-834a-4ab5-a13b-a9228ca66693 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8014abf90124e639ec68832c03b2bea', 'request_id': 'req-590cfc59-834a-4ab5-a13b-a9228ca66693'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:01.232406 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-590cfc59-834a-4ab5-a13b-a9228ca66693 admin admin] The token cache is being invalidate because project d8014abf90124e639ec68832c03b2bea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:01.232748 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-590cfc59-834a-4ab5-a13b-a9228ca66693 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:01.233394 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-590cfc59-834a-4ab5-a13b-a9228ca66693 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:01.234881 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1455/2876] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:00 2022] DELETE /identity/v3/projects/d8014abf90124e639ec68832c03b2bea => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:08.935130 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958b44d-acf5-4608-9c35-1e9f58ccc38d None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:08.935601 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958b44d-acf5-4608-9c35-1e9f58ccc38d None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:08.935731 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958b44d-acf5-4608-9c35-1e9f58ccc38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:08.965026 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-5958b44d-acf5-4608-9c35-1e9f58ccc38d None None] MFA Rules not processed for user `1d39439278814d4faac4cfb1e71aa4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:08.966486 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-5958b44d-acf5-4608-9c35-1e9f58ccc38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:09.019392 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1422/2877] 10.222.0.23 () {58 vars in 967 bytes} [Mon Aug 8 02:34:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:09.194317 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590cfc59-834a-4ab5-a13b-a9228ca66693 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:09.195791 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-590cfc59-834a-4ab5-a13b-a9228ca66693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:09.218905 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:09.265663 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590cfc59-834a-4ab5-a13b-a9228ca66693 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:09.270546 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf4757d-e82c-4765-b58b-c049b87f322a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c212009b6a44e1bad92769630116408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:09.271150 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4757d-e82c-4765-b58b-c049b87f322a service swift] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:09.271499 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4757d-e82c-4765-b58b-c049b87f322a service swift] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:09.271774 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4757d-e82c-4765-b58b-c049b87f322a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:09.279644 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf4757d-e82c-4765-b58b-c049b87f322a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:09.283729 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf4757d-e82c-4765-b58b-c049b87f322a service swift] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:09.288989 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1456/2878] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 8 02:34:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 02:34:18.073119 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958b44d-acf5-4608-9c35-1e9f58ccc38d None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:18.075155 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-5958b44d-acf5-4608-9c35-1e9f58ccc38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:18.140925 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958b44d-acf5-4608-9c35-1e9f58ccc38d None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:18.145500 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b531fdf4-085d-48c5-bce7-bbc6e2267d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:18.146171 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531fdf4-085d-48c5-bce7-bbc6e2267d07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:18.146438 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531fdf4-085d-48c5-bce7-bbc6e2267d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:18.146717 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531fdf4-085d-48c5-bce7-bbc6e2267d07 admin admin] PATH_INFO: `/v3/users/e83d227094f4419a9d98021636f8b1f1` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:18.147960 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b531fdf4-085d-48c5-bce7-bbc6e2267d07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e83d227094f4419a9d98021636f8b1f1)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:18.149878 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b531fdf4-085d-48c5-bce7-bbc6e2267d07 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:18.160318 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:18.473384 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-b531fdf4-085d-48c5-bce7-bbc6e2267d07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e83d227094f4419a9d98021636f8b1f1'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:18.580275 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-b531fdf4-085d-48c5-bce7-bbc6e2267d07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e83d227094f4419a9d98021636f8b1f1'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:18.580892 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-b531fdf4-085d-48c5-bce7-bbc6e2267d07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e83d227094f4419a9d98021636f8b1f1'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:18.581495 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-b531fdf4-085d-48c5-bce7-bbc6e2267d07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e83d227094f4419a9d98021636f8b1f1'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:18.593995 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-b531fdf4-085d-48c5-bce7-bbc6e2267d07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e83d227094f4419a9d98021636f8b1f1'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:18.606515 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1423/2879] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:18 2022] DELETE /identity/v3/users/e83d227094f4419a9d98021636f8b1f1 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:18.851007 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf4757d-e82c-4765-b58b-c049b87f322a service swift] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:18.862154 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf4757d-e82c-4765-b58b-c049b87f322a service swift] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:18.917648 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667f604-ff30-4d83-a607-aef937d5a12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:18.918276 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667f604-ff30-4d83-a607-aef937d5a12f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:18.918617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667f604-ff30-4d83-a607-aef937d5a12f admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:18.918889 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667f604-ff30-4d83-a607-aef937d5a12f admin admin] PATH_INFO: `/v3/projects/baf3b3071297476086f6f52eb812756c` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:18.920010 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667f604-ff30-4d83-a607-aef937d5a12f admin admin] RBAC: Authorizing `identity:delete_project(project_id=baf3b3071297476086f6f52eb812756c)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:18.921942 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667f604-ff30-4d83-a607-aef937d5a12f admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:19.030835 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-3667f604-ff30-4d83-a607-aef937d5a12f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baf3b3071297476086f6f52eb812756c', 'request_id': 'req-3667f604-ff30-4d83-a607-aef937d5a12f'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:19.036173 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-3667f604-ff30-4d83-a607-aef937d5a12f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baf3b3071297476086f6f52eb812756c', 'request_id': 'req-3667f604-ff30-4d83-a607-aef937d5a12f'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:19.042455 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-3667f604-ff30-4d83-a607-aef937d5a12f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baf3b3071297476086f6f52eb812756c', 'request_id': 'req-3667f604-ff30-4d83-a607-aef937d5a12f'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:19.131468 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-3667f604-ff30-4d83-a607-aef937d5a12f admin admin] The token cache is being invalidate because project baf3b3071297476086f6f52eb812756c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:19.131760 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-3667f604-ff30-4d83-a607-aef937d5a12f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:19.132373 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-3667f604-ff30-4d83-a607-aef937d5a12f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:19.133871 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1457/2880] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:18 2022] DELETE /identity/v3/projects/baf3b3071297476086f6f52eb812756c => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 02:34:19.137942 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b531fdf4-085d-48c5-bce7-bbc6e2267d07 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:19.139594 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-b531fdf4-085d-48c5-bce7-bbc6e2267d07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:19.152697 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b531fdf4-085d-48c5-bce7-bbc6e2267d07 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:19.220866 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7265e2-49e7-4dd2-8d44-1bc7a48edfad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:19.221407 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7265e2-49e7-4dd2-8d44-1bc7a48edfad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:19.221687 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7265e2-49e7-4dd2-8d44-1bc7a48edfad admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:19.221960 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7265e2-49e7-4dd2-8d44-1bc7a48edfad admin admin] PATH_INFO: `/v3/users/74b03fa601f84b3b9e0cafedac7ebc00` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:19.223083 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7265e2-49e7-4dd2-8d44-1bc7a48edfad admin admin] RBAC: Authorizing `identity:delete_user(user_id=74b03fa601f84b3b9e0cafedac7ebc00)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:19.225534 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7265e2-49e7-4dd2-8d44-1bc7a48edfad admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:19.415628 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-4f7265e2-49e7-4dd2-8d44-1bc7a48edfad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74b03fa601f84b3b9e0cafedac7ebc00'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:19.498550 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-4f7265e2-49e7-4dd2-8d44-1bc7a48edfad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74b03fa601f84b3b9e0cafedac7ebc00'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:19.499107 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-4f7265e2-49e7-4dd2-8d44-1bc7a48edfad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74b03fa601f84b3b9e0cafedac7ebc00'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:19.499742 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-4f7265e2-49e7-4dd2-8d44-1bc7a48edfad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74b03fa601f84b3b9e0cafedac7ebc00'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:19.511864 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-4f7265e2-49e7-4dd2-8d44-1bc7a48edfad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74b03fa601f84b3b9e0cafedac7ebc00'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:19.524453 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1424/2881] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:34:19 2022] DELETE /identity/v3/users/74b03fa601f84b3b9e0cafedac7ebc00 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:19.820576 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667f604-ff30-4d83-a607-aef937d5a12f admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:19.822102 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-3667f604-ff30-4d83-a607-aef937d5a12f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:19.835882 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667f604-ff30-4d83-a607-aef937d5a12f admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:19.873595 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:19.891622 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4bcc67-7cd9-4a79-9749-23789ef74313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:19.892253 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bcc67-7cd9-4a79-9749-23789ef74313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:19.892535 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bcc67-7cd9-4a79-9749-23789ef74313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:19.892810 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bcc67-7cd9-4a79-9749-23789ef74313 admin admin] PATH_INFO: `/v3/projects/8072f48f3da342f49b1cf77d440af727` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:19.893949 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4bcc67-7cd9-4a79-9749-23789ef74313 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8072f48f3da342f49b1cf77d440af727)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:19.895891 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4bcc67-7cd9-4a79-9749-23789ef74313 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:20.042189 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-4b4bcc67-7cd9-4a79-9749-23789ef74313 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8072f48f3da342f49b1cf77d440af727', 'request_id': 'req-4b4bcc67-7cd9-4a79-9749-23789ef74313'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:20.047452 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-4b4bcc67-7cd9-4a79-9749-23789ef74313 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8072f48f3da342f49b1cf77d440af727', 'request_id': 'req-4b4bcc67-7cd9-4a79-9749-23789ef74313'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:20.053491 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-4b4bcc67-7cd9-4a79-9749-23789ef74313 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8072f48f3da342f49b1cf77d440af727', 'request_id': 'req-4b4bcc67-7cd9-4a79-9749-23789ef74313'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:20.151289 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-4b4bcc67-7cd9-4a79-9749-23789ef74313 admin admin] The token cache is being invalidate because project 8072f48f3da342f49b1cf77d440af727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:34:20.151547 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-4b4bcc67-7cd9-4a79-9749-23789ef74313 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:20.152164 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-4b4bcc67-7cd9-4a79-9749-23789ef74313 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:34:20.153653 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1458/2882] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:34:19 2022] DELETE /identity/v3/projects/8072f48f3da342f49b1cf77d440af727 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:20.158642 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb04be-cf4e-4de9-b298-ac20a2549715 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:20.159108 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb04be-cf4e-4de9-b298-ac20a2549715 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:20.159215 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb04be-cf4e-4de9-b298-ac20a2549715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:20.172744 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:20.179111 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-d7eb04be-cf4e-4de9-b298-ac20a2549715 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:20.180341 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-d7eb04be-cf4e-4de9-b298-ac20a2549715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:20.237033 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1425/2883] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:20.301556 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ec4e6-d060-4610-a9f9-d9b8aca4c4cb None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:20.301838 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ec4e6-d060-4610-a9f9-d9b8aca4c4cb None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:20.302114 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ec4e6-d060-4610-a9f9-d9b8aca4c4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:20.322383 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-ff5ec4e6-d060-4610-a9f9-d9b8aca4c4cb None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:20.323611 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-ff5ec4e6-d060-4610-a9f9-d9b8aca4c4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:20.331376 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1459/2884] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:20.335698 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb04be-cf4e-4de9-b298-ac20a2549715 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:20.345469 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb04be-cf4e-4de9-b298-ac20a2549715 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:20.350593 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3db038-21ca-4472-baaa-c98cfbfe0996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:20.351301 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3db038-21ca-4472-baaa-c98cfbfe0996 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:20.351621 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3db038-21ca-4472-baaa-c98cfbfe0996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:20.351900 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3db038-21ca-4472-baaa-c98cfbfe0996 admin admin] PATH_INFO: `/v3/domains` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:20.352702 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3db038-21ca-4472-baaa-c98cfbfe0996 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 02:34:20.353129 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3db038-21ca-4472-baaa-c98cfbfe0996 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:20.354768 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3db038-21ca-4472-baaa-c98cfbfe0996 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:20.367333 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1426/2885] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 02:34:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 02:34:20.371696 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ec4e6-d060-4610-a9f9-d9b8aca4c4cb None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:20.381617 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ec4e6-d060-4610-a9f9-d9b8aca4c4cb None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:20.388381 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c36d5f-eb4e-4494-843d-ce12d0488458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:20.388381 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c36d5f-eb4e-4494-843d-ce12d0488458 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:20.388381 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c36d5f-eb4e-4494-843d-ce12d0488458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:20.388381 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c36d5f-eb4e-4494-843d-ce12d0488458 admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:20.388780 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c36d5f-eb4e-4494-843d-ce12d0488458 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:20.390291 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c36d5f-eb4e-4494-843d-ce12d0488458 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:20.518619 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1460/2886] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:34:20 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:20.522842 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3db038-21ca-4472-baaa-c98cfbfe0996 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:20.532615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3db038-21ca-4472-baaa-c98cfbfe0996 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:20.589462 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff7e76-10e1-47c3-b82b-af6efe9cb917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:20.590063 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff7e76-10e1-47c3-b82b-af6efe9cb917 admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:20.590346 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff7e76-10e1-47c3-b82b-af6efe9cb917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:20.590622 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff7e76-10e1-47c3-b82b-af6efe9cb917 admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:20.591537 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff7e76-10e1-47c3-b82b-af6efe9cb917 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:20.593551 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff7e76-10e1-47c3-b82b-af6efe9cb917 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:20.723497 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1427/2887] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:34:20 2022] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:20.728213 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c36d5f-eb4e-4494-843d-ce12d0488458 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:20.738315 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c36d5f-eb4e-4494-843d-ce12d0488458 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:20.743469 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ec0bb-fd22-4626-8334-05a1d2f62418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:20.744060 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ec0bb-fd22-4626-8334-05a1d2f62418 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:20.744427 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ec0bb-fd22-4626-8334-05a1d2f62418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:20.744705 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ec0bb-fd22-4626-8334-05a1d2f62418 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:20.745336 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ec0bb-fd22-4626-8334-05a1d2f62418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:20.746942 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ec0bb-fd22-4626-8334-05a1d2f62418 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:20.756749 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1461/2888] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:20.760737 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff7e76-10e1-47c3-b82b-af6efe9cb917 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:20.770708 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff7e76-10e1-47c3-b82b-af6efe9cb917 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:20.775241 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54262af-fa0a-4418-a1cd-2d517d4d5a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:20.775857 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54262af-fa0a-4418-a1cd-2d517d4d5a91 admin admin] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:20.776138 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54262af-fa0a-4418-a1cd-2d517d4d5a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:20.776412 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54262af-fa0a-4418-a1cd-2d517d4d5a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:20.777044 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54262af-fa0a-4418-a1cd-2d517d4d5a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:20.778615 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54262af-fa0a-4418-a1cd-2d517d4d5a91 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:20.789371 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1428/2889] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:20.793337 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ec0bb-fd22-4626-8334-05a1d2f62418 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:20.803918 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ec0bb-fd22-4626-8334-05a1d2f62418 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:20.808465 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d770b-3eea-4a2e-b28e-e4b565c94675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:20.809106 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d770b-3eea-4a2e-b28e-e4b565c94675 admin admin] REQUEST_METHOD: `PUT` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:20.809393 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d770b-3eea-4a2e-b28e-e4b565c94675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:20.809674 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d770b-3eea-4a2e-b28e-e4b565c94675 admin admin] PATH_INFO: `/v3/projects/dfc3e915ff8e4775a165a276168969e0/users/b1402ad257614dbc941bf1c25661aec3/roles/5691bce246d6452990f13933e19f2825` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:20.823885 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d770b-3eea-4a2e-b28e-e4b565c94675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfc3e915ff8e4775a165a276168969e0, user_id=b1402ad257614dbc941bf1c25661aec3, role_id=5691bce246d6452990f13933e19f2825)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:20.826519 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d770b-3eea-4a2e-b28e-e4b565c94675 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:20.934660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1462/2890] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:20 2022] PUT /identity/v3/projects/dfc3e915ff8e4775a165a276168969e0/users/b1402ad257614dbc941bf1c25661aec3/roles/5691bce246d6452990f13933e19f2825 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:20.939660 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad89af1-2aa7-4d9e-96b0-975ed2150078 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:20.939948 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad89af1-2aa7-4d9e-96b0-975ed2150078 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:20.940223 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad89af1-2aa7-4d9e-96b0-975ed2150078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:20.960241 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-dad89af1-2aa7-4d9e-96b0-975ed2150078 None None] MFA Rules not processed for user `b1ada570ae344936898861ab4af182fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:20.961425 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-dad89af1-2aa7-4d9e-96b0-975ed2150078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:21.017754 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1429/2891] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:21.027843 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d770b-3eea-4a2e-b28e-e4b565c94675 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:21.029524 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-070d770b-3eea-4a2e-b28e-e4b565c94675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:21.102857 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:21.106987 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d770b-3eea-4a2e-b28e-e4b565c94675 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:21.110721 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d9ed6-77d3-487f-8329-7ff8099ac50b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:21.111346 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d9ed6-77d3-487f-8329-7ff8099ac50b service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:21.111694 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d9ed6-77d3-487f-8329-7ff8099ac50b service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:21.111925 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d9ed6-77d3-487f-8329-7ff8099ac50b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:21.121082 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d9ed6-77d3-487f-8329-7ff8099ac50b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:21.122500 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d9ed6-77d3-487f-8329-7ff8099ac50b service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:21.131850 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1463/2892] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:27.357262 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319699c-1d5c-4f75-b270-acb9e96c8310 None None] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:27.357761 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319699c-1d5c-4f75-b270-acb9e96c8310 None None] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:27.357761 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319699c-1d5c-4f75-b270-acb9e96c8310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:27.389624 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:27.401625 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.auth.core [None req-0319699c-1d5c-4f75-b270-acb9e96c8310 None None] MFA Rules not processed for user `b1402ad257614dbc941bf1c25661aec3`. Rule list: `[]` (Enabled: `True`). {{(pid=80638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:27.403147 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-0319699c-1d5c-4f75-b270-acb9e96c8310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:27.470418 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1430/2893] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:34:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:27.474911 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d9ed6-77d3-487f-8329-7ff8099ac50b service neutron] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:27.484959 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d9ed6-77d3-487f-8329-7ff8099ac50b service neutron] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:27.489603 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16750fcd-8f4b-4c36-8101-ac0219f6b2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:27.490219 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16750fcd-8f4b-4c36-8101-ac0219f6b2b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:27.490501 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16750fcd-8f4b-4c36-8101-ac0219f6b2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:27.490775 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16750fcd-8f4b-4c36-8101-ac0219f6b2b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:27.491460 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16750fcd-8f4b-4c36-8101-ac0219f6b2b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:27.493364 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16750fcd-8f4b-4c36-8101-ac0219f6b2b3 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:27.570622 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1464/2894] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 02:34:27 2022] POST /identity/v3/projects => generated 371 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:27.575071 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319699c-1d5c-4f75-b270-acb9e96c8310 None None] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:27.587135 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319699c-1d5c-4f75-b270-acb9e96c8310 None None] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:27.645888 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d5fae-a695-4074-8eda-62450592761b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:27.647478 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d5fae-a695-4074-8eda-62450592761b admin admin] REQUEST_METHOD: `POST` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:27.647896 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d5fae-a695-4074-8eda-62450592761b admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:27.648304 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d5fae-a695-4074-8eda-62450592761b admin admin] PATH_INFO: `/v3/users` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:27.649238 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d5fae-a695-4074-8eda-62450592761b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:27.651144 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d5fae-a695-4074-8eda-62450592761b admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:27.752865 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1431/2895] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 02:34:27 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 02:34:27.757395 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16750fcd-8f4b-4c36-8101-ac0219f6b2b3 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:27.767625 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16750fcd-8f4b-4c36-8101-ac0219f6b2b3 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:27.772201 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe4d09-3d77-4c6b-a52e-bbfa6dfc07e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:27.772790 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe4d09-3d77-4c6b-a52e-bbfa6dfc07e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:27.773072 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe4d09-3d77-4c6b-a52e-bbfa6dfc07e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:27.773342 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe4d09-3d77-4c6b-a52e-bbfa6dfc07e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:27.774007 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe4d09-3d77-4c6b-a52e-bbfa6dfc07e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:27.775569 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe4d09-3d77-4c6b-a52e-bbfa6dfc07e6 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:27.787399 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1465/2896] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:27.791948 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d5fae-a695-4074-8eda-62450592761b admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:27.803371 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d5fae-a695-4074-8eda-62450592761b admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:27.808274 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5c133-22d1-486a-9567-234349e65df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:27.809031 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5c133-22d1-486a-9567-234349e65df4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:27.809382 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5c133-22d1-486a-9567-234349e65df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:27.809731 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5c133-22d1-486a-9567-234349e65df4 admin admin] PATH_INFO: `/v3/projects/aca7de2d18b944f9a4821a495f9be923/users/959391c426ce4c8797e386d53c1a245e/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:27.829303 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5c133-22d1-486a-9567-234349e65df4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aca7de2d18b944f9a4821a495f9be923, user_id=959391c426ce4c8797e386d53c1a245e, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:27.831942 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5c133-22d1-486a-9567-234349e65df4 admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:27.941232 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1432/2897] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:27 2022] PUT /identity/v3/projects/aca7de2d18b944f9a4821a495f9be923/users/959391c426ce4c8797e386d53c1a245e/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:27.945791 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe4d09-3d77-4c6b-a52e-bbfa6dfc07e6 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:27.956735 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe4d09-3d77-4c6b-a52e-bbfa6dfc07e6 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:28.015478 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f5150-f9d6-4964-921c-7c9742fdef0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:28.016097 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f5150-f9d6-4964-921c-7c9742fdef0b admin admin] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:28.016382 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f5150-f9d6-4964-921c-7c9742fdef0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:28.016660 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f5150-f9d6-4964-921c-7c9742fdef0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:28.017302 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f5150-f9d6-4964-921c-7c9742fdef0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:28.018980 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f5150-f9d6-4964-921c-7c9742fdef0b admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:28.029477 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1466/2898] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 02:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 02:34:28.033620 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5c133-22d1-486a-9567-234349e65df4 admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:28.044350 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5c133-22d1-486a-9567-234349e65df4 admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:28.049321 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5d520-8760-4f9c-b224-a99eb15590ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:28.054583 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5d520-8760-4f9c-b224-a99eb15590ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:28.054583 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5d520-8760-4f9c-b224-a99eb15590ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:28.054583 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5d520-8760-4f9c-b224-a99eb15590ee admin admin] PATH_INFO: `/v3/projects/aca7de2d18b944f9a4821a495f9be923/users/959391c426ce4c8797e386d53c1a245e/roles/84da65a75e544d1191ec53cb6b05aa73` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:28.054583 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5d520-8760-4f9c-b224-a99eb15590ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=aca7de2d18b944f9a4821a495f9be923, user_id=959391c426ce4c8797e386d53c1a245e, role_id=84da65a75e544d1191ec53cb6b05aa73)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:28.057749 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5d520-8760-4f9c-b224-a99eb15590ee admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:28.067093 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1433/2899] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 02:34:28 2022] PUT /identity/v3/projects/aca7de2d18b944f9a4821a495f9be923/users/959391c426ce4c8797e386d53c1a245e/roles/84da65a75e544d1191ec53cb6b05aa73 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:34:33.740971 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b9347-799e-402d-a726-a71a499929ad None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:33.741497 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b9347-799e-402d-a726-a71a499929ad None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:33.741694 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b9347-799e-402d-a726-a71a499929ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:33.772003 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-4c7b9347-799e-402d-a726-a71a499929ad None None] MFA Rules not processed for user `959391c426ce4c8797e386d53c1a245e`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:33.773546 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-4c7b9347-799e-402d-a726-a71a499929ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:33.865462 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1467/2900] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:34:33 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:33.881765 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5d520-8760-4f9c-b224-a99eb15590ee admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:34:33.884048 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-10d5d520-8760-4f9c-b224-a99eb15590ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:33.943760 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:33.964677 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5d520-8760-4f9c-b224-a99eb15590ee admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:34:33.970491 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7d729-f2cf-4426-9fc5-a88d84e2311e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:34:33.971142 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7d729-f2cf-4426-9fc5-a88d84e2311e service nova] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:33.971432 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7d729-f2cf-4426-9fc5-a88d84e2311e service nova] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:33.971687 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7d729-f2cf-4426-9fc5-a88d84e2311e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:34.035862 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d7d729-f2cf-4426-9fc5-a88d84e2311e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:34:34.035862 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d7d729-f2cf-4426-9fc5-a88d84e2311e service nova] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:34:34.042458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1434/2901] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:34:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:34:36.706451 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b844fef-2133-4bbc-a5d2-460d64d95ac5 None None] REQUEST_METHOD: `POST` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:34:36.707492 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b844fef-2133-4bbc-a5d2-460d64d95ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:34:36.707762 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b844fef-2133-4bbc-a5d2-460d64d95ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:34:36.728326 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.auth.core [None req-1b844fef-2133-4bbc-a5d2-460d64d95ac5 None None] MFA Rules not processed for user `b1402ad257614dbc941bf1c25661aec3`. Rule list: `[]` (Enabled: `True`). {{(pid=80637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 02:34:36.730730 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-1b844fef-2133-4bbc-a5d2-460d64d95ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:34:36.736485 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1468/2902] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 02:34:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 02:34:44.186189 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=31 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:46.723019 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=85,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:05.744815 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7d729-f2cf-4426-9fc5-a88d84e2311e service nova] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:35:05.797787 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7d729-f2cf-4426-9fc5-a88d84e2311e service nova] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:35:05.801373 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc3a5c-c7f7-49a4-b874-06c51e8e7a01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:35:05.801967 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc3a5c-c7f7-49a4-b874-06c51e8e7a01 service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:35:05.802250 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc3a5c-c7f7-49a4-b874-06c51e8e7a01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:35:05.802527 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc3a5c-c7f7-49a4-b874-06c51e8e7a01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:35:05.811153 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc3a5c-c7f7-49a4-b874-06c51e8e7a01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:35:05.812599 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc3a5c-c7f7-49a4-b874-06c51e8e7a01 service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:35:05.821659 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1435/2903] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:35:05 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 02:35:15.817687 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=26 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:36:21.295438 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b844fef-2133-4bbc-a5d2-460d64d95ac5 None None] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:36:21.305664 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b844fef-2133-4bbc-a5d2-460d64d95ac5 None None] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:36:21.309616 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1affff-8dab-41ac-a047-56371396dffa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:36:21.310296 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1affff-8dab-41ac-a047-56371396dffa service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:36:21.310575 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1affff-8dab-41ac-a047-56371396dffa service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:36:21.310850 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1affff-8dab-41ac-a047-56371396dffa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:36:21.312881 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-9d1affff-8dab-41ac-a047-56371396dffa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:36:21.323315 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1affff-8dab-41ac-a047-56371396dffa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:36:21.324755 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1affff-8dab-41ac-a047-56371396dffa service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:36:21.332658 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1469/2904] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:36:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:36:31.329065 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=6 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:37:03.472641 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc3a5c-c7f7-49a4-b874-06c51e8e7a01 service neutron] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:37:03.481419 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc3a5c-c7f7-49a4-b874-06c51e8e7a01 service neutron] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:37:03.485041 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a137de-988e-43e7-8e57-dd353baca3a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:37:03.485620 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a137de-988e-43e7-8e57-dd353baca3a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:37:03.485899 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a137de-988e-43e7-8e57-dd353baca3a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:37:03.486170 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a137de-988e-43e7-8e57-dd353baca3a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:37:03.488538 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-89a137de-988e-43e7-8e57-dd353baca3a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:37:03.502037 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a137de-988e-43e7-8e57-dd353baca3a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:37:03.503522 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a137de-988e-43e7-8e57-dd353baca3a6 service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:37:03.515283 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1436/2905] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:37:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:37:04.701589 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1affff-8dab-41ac-a047-56371396dffa service neutron] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:37:04.710116 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1affff-8dab-41ac-a047-56371396dffa service neutron] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:37:04.713764 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0bae8b-7f6d-413b-b437-70146d6b4ae0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:37:04.714356 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bae8b-7f6d-413b-b437-70146d6b4ae0 service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:37:04.714640 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bae8b-7f6d-413b-b437-70146d6b4ae0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:37:04.714919 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bae8b-7f6d-413b-b437-70146d6b4ae0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:37:04.716649 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-1a0bae8b-7f6d-413b-b437-70146d6b4ae0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:37:04.730918 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0bae8b-7f6d-413b-b437-70146d6b4ae0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:37:04.732284 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0bae8b-7f6d-413b-b437-70146d6b4ae0 service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:37:04.743765 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1470/2906] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:37:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:37:13.510128 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=6 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:37:14.738915 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=6 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:37:18.344432 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a137de-988e-43e7-8e57-dd353baca3a6 service neutron] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:37:18.346863 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-89a137de-988e-43e7-8e57-dd353baca3a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:37:18.357728 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a137de-988e-43e7-8e57-dd353baca3a6 service neutron] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:37:18.361937 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e160735-993b-4655-b1d4-7b4255e1464e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:37:18.362681 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e160735-993b-4655-b1d4-7b4255e1464e service neutron] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:37:18.362997 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e160735-993b-4655-b1d4-7b4255e1464e service neutron] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:37:18.363276 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e160735-993b-4655-b1d4-7b4255e1464e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:37:18.365149 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-6e160735-993b-4655-b1d4-7b4255e1464e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:37:18.375717 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e160735-993b-4655-b1d4-7b4255e1464e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:37:18.377200 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e160735-993b-4655-b1d4-7b4255e1464e service neutron] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:37:18.392445 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1437/2907] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:37:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:37:18.468561 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0bae8b-7f6d-413b-b437-70146d6b4ae0 service neutron] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:37:18.477910 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0bae8b-7f6d-413b-b437-70146d6b4ae0 service neutron] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:37:18.481654 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b39a0-4f46-4a41-b71e-f53fab28f769 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4c5732acb844369140e8d970577f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:37:18.482278 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b39a0-4f46-4a41-b71e-f53fab28f769 service neutron] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:37:18.482561 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b39a0-4f46-4a41-b71e-f53fab28f769 service neutron] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:37:18.482833 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b39a0-4f46-4a41-b71e-f53fab28f769 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:37:18.484604 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-d06b39a0-4f46-4a41-b71e-f53fab28f769 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:37:18.498395 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b39a0-4f46-4a41-b71e-f53fab28f769 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:37:18.499856 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b39a0-4f46-4a41-b71e-f53fab28f769 service neutron] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:37:18.511081 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1471/2908] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:37:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:37:18.581487 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e160735-993b-4655-b1d4-7b4255e1464e service neutron] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:37:18.582978 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-6e160735-993b-4655-b1d4-7b4255e1464e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:37:18.654262 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e160735-993b-4655-b1d4-7b4255e1464e service neutron] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:37:18.659264 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52be2b-887f-44d8-b973-a4adff7b4c6b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43a39dd539974180a8165e34de57b552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:37:18.659900 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52be2b-887f-44d8-b973-a4adff7b4c6b service placement] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:37:18.660185 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52be2b-887f-44d8-b973-a4adff7b4c6b service placement] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:37:18.660463 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52be2b-887f-44d8-b973-a4adff7b4c6b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:37:18.662227 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-8c52be2b-887f-44d8-b973-a4adff7b4c6b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:37:18.673604 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c52be2b-887f-44d8-b973-a4adff7b4c6b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:37:18.675158 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c52be2b-887f-44d8-b973-a4adff7b4c6b service placement] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:37:18.685307 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1438/2909] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:37:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:37:19.339132 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b39a0-4f46-4a41-b71e-f53fab28f769 service neutron] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:37:19.351482 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b39a0-4f46-4a41-b71e-f53fab28f769 service neutron] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:37:19.356987 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5650abe-6f7c-4040-9d1f-07c9ec91dc57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:37:19.360543 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5650abe-6f7c-4040-9d1f-07c9ec91dc57 service nova] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:37:19.360543 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5650abe-6f7c-4040-9d1f-07c9ec91dc57 service nova] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:37:19.360543 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5650abe-6f7c-4040-9d1f-07c9ec91dc57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:37:19.360543 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-d5650abe-6f7c-4040-9d1f-07c9ec91dc57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:37:19.372492 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5650abe-6f7c-4040-9d1f-07c9ec91dc57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:37:19.374172 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5650abe-6f7c-4040-9d1f-07c9ec91dc57 service nova] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:37:19.385434 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1472/2910] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:37:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:37:28.681147 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=38 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:37:29.380414 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=12 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:38:18.602266 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52be2b-887f-44d8-b973-a4adff7b4c6b service placement] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:18.613364 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52be2b-887f-44d8-b973-a4adff7b4c6b service placement] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:18.631684 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c624e15-1c70-4f1a-af18-18df77374a6c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43a39dd539974180a8165e34de57b552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:18.631684 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c624e15-1c70-4f1a-af18-18df77374a6c service placement] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:18.631684 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c624e15-1c70-4f1a-af18-18df77374a6c service placement] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:18.631684 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c624e15-1c70-4f1a-af18-18df77374a6c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:18.632109 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-2c624e15-1c70-4f1a-af18-18df77374a6c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:38:18.632494 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c624e15-1c70-4f1a-af18-18df77374a6c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:18.634091 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c624e15-1c70-4f1a-af18-18df77374a6c service placement] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:18.643987 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1439/2911] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:38:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:38:28.639761 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=6 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:38:44.851678 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5650abe-6f7c-4040-9d1f-07c9ec91dc57 service nova] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:44.852972 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-d5650abe-6f7c-4040-9d1f-07c9ec91dc57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:38:44.868761 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5650abe-6f7c-4040-9d1f-07c9ec91dc57 service nova] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:44.876033 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95f6cb-02b6-4fb9-a501-7cfba50d5d5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89e0c7d62444e4b75d3f4da49b2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:44.880519 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95f6cb-02b6-4fb9-a501-7cfba50d5d5b service nova] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:44.880519 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95f6cb-02b6-4fb9-a501-7cfba50d5d5b service nova] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:44.880519 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95f6cb-02b6-4fb9-a501-7cfba50d5d5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:44.880519 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-5a95f6cb-02b6-4fb9-a501-7cfba50d5d5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:38:44.893577 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95f6cb-02b6-4fb9-a501-7cfba50d5d5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:44.895174 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95f6cb-02b6-4fb9-a501-7cfba50d5d5b service nova] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:44.907173 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1473/2912] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:38:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:38:54.902086 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=6 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:38:56.094605 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c624e15-1c70-4f1a-af18-18df77374a6c service placement] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:56.105616 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c624e15-1c70-4f1a-af18-18df77374a6c service placement] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:56.111461 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4072728-736c-42f2-babf-e8004b99c9f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43a39dd539974180a8165e34de57b552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:56.112086 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4072728-736c-42f2-babf-e8004b99c9f1 service placement] REQUEST_METHOD: `GET` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:56.112372 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4072728-736c-42f2-babf-e8004b99c9f1 service placement] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:56.112651 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4072728-736c-42f2-babf-e8004b99c9f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:56.114407 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-a4072728-736c-42f2-babf-e8004b99c9f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:38:56.126630 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4072728-736c-42f2-babf-e8004b99c9f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:56.128237 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4072728-736c-42f2-babf-e8004b99c9f1 service placement] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:56.138349 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1440/2913] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:38:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:38:56.213640 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95f6cb-02b6-4fb9-a501-7cfba50d5d5b service nova] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:56.274403 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95f6cb-02b6-4fb9-a501-7cfba50d5d5b service nova] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:56.279055 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90bd93-86f2-4a73-8bd6-7d0ca9e250a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:56.279701 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90bd93-86f2-4a73-8bd6-7d0ca9e250a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:56.279986 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90bd93-86f2-4a73-8bd6-7d0ca9e250a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:56.280263 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90bd93-86f2-4a73-8bd6-7d0ca9e250a7 admin admin] PATH_INFO: `/v3/users/b1402ad257614dbc941bf1c25661aec3` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:56.281403 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a90bd93-86f2-4a73-8bd6-7d0ca9e250a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1402ad257614dbc941bf1c25661aec3)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:56.283339 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a90bd93-86f2-4a73-8bd6-7d0ca9e250a7 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:56.455647 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-0a90bd93-86f2-4a73-8bd6-7d0ca9e250a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1402ad257614dbc941bf1c25661aec3'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:56.527695 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-0a90bd93-86f2-4a73-8bd6-7d0ca9e250a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1402ad257614dbc941bf1c25661aec3'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:56.528302 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-0a90bd93-86f2-4a73-8bd6-7d0ca9e250a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1402ad257614dbc941bf1c25661aec3'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:56.544085 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-0a90bd93-86f2-4a73-8bd6-7d0ca9e250a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1402ad257614dbc941bf1c25661aec3'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:56.551786 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-0a90bd93-86f2-4a73-8bd6-7d0ca9e250a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1402ad257614dbc941bf1c25661aec3'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:56.557850 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1474/2914] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:38:56 2022] DELETE /identity/v3/users/b1402ad257614dbc941bf1c25661aec3 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:38:56.821124 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4072728-736c-42f2-babf-e8004b99c9f1 service placement] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:56.835096 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4072728-736c-42f2-babf-e8004b99c9f1 service placement] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:56.899872 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c54a8c-76ec-4376-aef0-f24ab8b6d1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:56.900585 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c54a8c-76ec-4376-aef0-f24ab8b6d1ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:56.900930 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c54a8c-76ec-4376-aef0-f24ab8b6d1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:56.901162 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c54a8c-76ec-4376-aef0-f24ab8b6d1ba admin admin] PATH_INFO: `/v3/projects/dfc3e915ff8e4775a165a276168969e0` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:56.902292 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c54a8c-76ec-4376-aef0-f24ab8b6d1ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfc3e915ff8e4775a165a276168969e0)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:56.904224 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c54a8c-76ec-4376-aef0-f24ab8b6d1ba admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:57.002572 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-14c54a8c-76ec-4376-aef0-f24ab8b6d1ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfc3e915ff8e4775a165a276168969e0', 'request_id': 'req-14c54a8c-76ec-4376-aef0-f24ab8b6d1ba'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:57.007955 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-14c54a8c-76ec-4376-aef0-f24ab8b6d1ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfc3e915ff8e4775a165a276168969e0', 'request_id': 'req-14c54a8c-76ec-4376-aef0-f24ab8b6d1ba'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:57.014188 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-14c54a8c-76ec-4376-aef0-f24ab8b6d1ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfc3e915ff8e4775a165a276168969e0', 'request_id': 'req-14c54a8c-76ec-4376-aef0-f24ab8b6d1ba'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:57.119794 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-14c54a8c-76ec-4376-aef0-f24ab8b6d1ba admin admin] The token cache is being invalidate because project dfc3e915ff8e4775a165a276168969e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:38:57.120444 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-14c54a8c-76ec-4376-aef0-f24ab8b6d1ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:57.120784 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-14c54a8c-76ec-4376-aef0-f24ab8b6d1ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:57.122274 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1441/2915] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:38:56 2022] DELETE /identity/v3/projects/dfc3e915ff8e4775a165a276168969e0 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:38:57.126230 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90bd93-86f2-4a73-8bd6-7d0ca9e250a7 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:57.127787 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-0a90bd93-86f2-4a73-8bd6-7d0ca9e250a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:38:57.141559 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90bd93-86f2-4a73-8bd6-7d0ca9e250a7 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:57.204935 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f39ac-a028-4880-86ef-b4e0ef348322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:57.205573 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f39ac-a028-4880-86ef-b4e0ef348322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:57.205858 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f39ac-a028-4880-86ef-b4e0ef348322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:57.206138 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f39ac-a028-4880-86ef-b4e0ef348322 admin admin] PATH_INFO: `/v3/users/959391c426ce4c8797e386d53c1a245e` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:57.207279 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f39ac-a028-4880-86ef-b4e0ef348322 admin admin] RBAC: Authorizing `identity:delete_user(user_id=959391c426ce4c8797e386d53c1a245e)` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:57.209224 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f39ac-a028-4880-86ef-b4e0ef348322 admin admin] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:57.230533 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:38:57.386161 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-1f2f39ac-a028-4880-86ef-b4e0ef348322 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '959391c426ce4c8797e386d53c1a245e'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:57.451681 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-1f2f39ac-a028-4880-86ef-b4e0ef348322 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '959391c426ce4c8797e386d53c1a245e'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:57.452294 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-1f2f39ac-a028-4880-86ef-b4e0ef348322 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '959391c426ce4c8797e386d53c1a245e'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:57.464944 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-1f2f39ac-a028-4880-86ef-b4e0ef348322 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '959391c426ce4c8797e386d53c1a245e'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:57.471535 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.notifications [None req-1f2f39ac-a028-4880-86ef-b4e0ef348322 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '959391c426ce4c8797e386d53c1a245e'} {{(pid=80637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:57.477508 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1475/2916] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 02:38:57 2022] DELETE /identity/v3/users/959391c426ce4c8797e386d53c1a245e => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:38:57.729737 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c54a8c-76ec-4376-aef0-f24ab8b6d1ba admin admin] Authenticating user token {{(pid=80638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:38:57.732759 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.fernet_utils [None req-14c54a8c-76ec-4376-aef0-f24ab8b6d1ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:38:57.745235 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c54a8c-76ec-4376-aef0-f24ab8b6d1ba admin admin] Validating token access rules against request {{(pid=80638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:38:57.803164 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89e1c8-69c0-49a8-aa63-4db5fe0616fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ada570ae344936898861ab4af182fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b600a834cd24825ac13e271234139ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:38:57.803903 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89e1c8-69c0-49a8-aa63-4db5fe0616fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:38:57.804186 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89e1c8-69c0-49a8-aa63-4db5fe0616fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:38:57.804461 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89e1c8-69c0-49a8-aa63-4db5fe0616fc admin admin] PATH_INFO: `/v3/projects/aca7de2d18b944f9a4821a495f9be923` {{(pid=80638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:38:57.805584 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e89e1c8-69c0-49a8-aa63-4db5fe0616fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=aca7de2d18b944f9a4821a495f9be923)` {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:38:57.807523 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e89e1c8-69c0-49a8-aa63-4db5fe0616fc admin admin] RBAC: Authorization granted {{(pid=80638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:38:57.829606 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:38:57.916108 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-6e89e1c8-69c0-49a8-aa63-4db5fe0616fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aca7de2d18b944f9a4821a495f9be923', 'request_id': 'req-6e89e1c8-69c0-49a8-aa63-4db5fe0616fc'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:57.921423 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-6e89e1c8-69c0-49a8-aa63-4db5fe0616fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aca7de2d18b944f9a4821a495f9be923', 'request_id': 'req-6e89e1c8-69c0-49a8-aa63-4db5fe0616fc'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:57.929247 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-6e89e1c8-69c0-49a8-aa63-4db5fe0616fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aca7de2d18b944f9a4821a495f9be923', 'request_id': 'req-6e89e1c8-69c0-49a8-aa63-4db5fe0616fc'} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:58.011343 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-6e89e1c8-69c0-49a8-aa63-4db5fe0616fc admin admin] The token cache is being invalidate because project aca7de2d18b944f9a4821a495f9be923 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 02:38:58.011585 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-6e89e1c8-69c0-49a8-aa63-4db5fe0616fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:58.012201 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG keystone.notifications [None req-6e89e1c8-69c0-49a8-aa63-4db5fe0616fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 02:38:58.013688 dv-cinder-740146-18-smb devstack@keystone.service[80638]: [pid: 80638|app: 0|req: 1442/2917] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 02:38:57 2022] DELETE /identity/v3/projects/aca7de2d18b944f9a4821a495f9be923 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 02:39:07.613658 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:08.029458 dv-cinder-740146-18-smb devstack@keystone.service[80638]: DEBUG dbcounter [-] [80638] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:23.561029 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f39ac-a028-4880-86ef-b4e0ef348322 admin admin] Authenticating user token {{(pid=80637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 02:43:23.562429 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-1f2f39ac-a028-4880-86ef-b4e0ef348322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:23.699246 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f39ac-a028-4880-86ef-b4e0ef348322 admin admin] Validating token access rules against request {{(pid=80637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 02:43:23.756716 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24e4b6-b971-40bd-bf0b-fb02db9766d2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43a39dd539974180a8165e34de57b552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe178f5bce64a009bf690031676c89f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 02:43:23.757316 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24e4b6-b971-40bd-bf0b-fb02db9766d2 service placement] REQUEST_METHOD: `GET` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 02:43:23.757599 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24e4b6-b971-40bd-bf0b-fb02db9766d2 service placement] SCRIPT_NAME: `/identity` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 02:43:23.757872 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24e4b6-b971-40bd-bf0b-fb02db9766d2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 02:43:23.760192 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.fernet_utils [None req-2e24e4b6-b971-40bd-bf0b-fb02db9766d2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 02:43:23.770902 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e24e4b6-b971-40bd-bf0b-fb02db9766d2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 02:43:23.772489 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e24e4b6-b971-40bd-bf0b-fb02db9766d2 service placement] RBAC: Authorization granted {{(pid=80637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 02:43:23.782119 dv-cinder-740146-18-smb devstack@keystone.service[80637]: [pid: 80637|app: 0|req: 1476/2918] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 02:43:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 02:43:33.777955 dv-cinder-740146-18-smb devstack@keystone.service[80637]: DEBUG dbcounter [-] [80637] Writing DB stats keystone:SELECT=89 {{(pid=80637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}